-- Logs begin at Thu 2022-07-21 15:19:23 UTC, end at Thu 2022-07-21 16:32:42 UTC. -- Jul 21 15:50:55.046212 dv-cinder-850668-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 15:50:55.055496 dv-cinder-850668-1-smb devstack@keystone.service[80243]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 15:50:55.058230 dv-cinder-850668-1-smb devstack@keystone.service[80243]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 15:50:55 2022] *** Jul 21 15:50:55.058395 dv-cinder-850668-1-smb devstack@keystone.service[80243]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 15:50:55.058395 dv-cinder-850668-1-smb devstack@keystone.service[80243]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 15:50:55.058395 dv-cinder-850668-1-smb devstack@keystone.service[80243]: nodename: dv-cinder-850668-1-smb Jul 21 15:50:55.058395 dv-cinder-850668-1-smb devstack@keystone.service[80243]: machine: x86_64 Jul 21 15:50:55.058395 dv-cinder-850668-1-smb devstack@keystone.service[80243]: clock source: unix Jul 21 15:50:55.058395 dv-cinder-850668-1-smb devstack@keystone.service[80243]: pcre jit disabled Jul 21 15:50:55.058395 dv-cinder-850668-1-smb devstack@keystone.service[80243]: detected number of CPU cores: 4 Jul 21 15:50:55.058395 dv-cinder-850668-1-smb devstack@keystone.service[80243]: current working directory: / Jul 21 15:50:55.058395 dv-cinder-850668-1-smb devstack@keystone.service[80243]: detected binary path: /usr/bin/uwsgi-core Jul 21 15:50:55.058395 dv-cinder-850668-1-smb devstack@keystone.service[80243]: your processes number limit is 47680 Jul 21 15:50:55.059018 dv-cinder-850668-1-smb devstack@keystone.service[80243]: your memory page size is 4096 bytes Jul 21 15:50:55.059018 dv-cinder-850668-1-smb devstack@keystone.service[80243]: detected max file descriptor number: 2048 Jul 21 15:50:55.059018 dv-cinder-850668-1-smb devstack@keystone.service[80243]: lock engine: pthread robust mutexes Jul 21 15:50:55.059018 dv-cinder-850668-1-smb devstack@keystone.service[80243]: thunder lock: enabled Jul 21 15:50:55.059018 dv-cinder-850668-1-smb devstack@keystone.service[80243]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 15:50:55.059018 dv-cinder-850668-1-smb devstack@keystone.service[80243]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 15:50:55.102596 dv-cinder-850668-1-smb devstack@keystone.service[80243]: Python main interpreter initialized at 0x55a38a2859c0 Jul 21 15:50:55.102596 dv-cinder-850668-1-smb devstack@keystone.service[80243]: python threads support enabled Jul 21 15:50:55.102596 dv-cinder-850668-1-smb devstack@keystone.service[80243]: your server socket listen backlog is limited to 100 connections Jul 21 15:50:55.102596 dv-cinder-850668-1-smb devstack@keystone.service[80243]: your mercy for graceful operations on workers is 90 seconds Jul 21 15:50:55.102977 dv-cinder-850668-1-smb devstack@keystone.service[80243]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 15:50:55.103041 dv-cinder-850668-1-smb devstack@keystone.service[80243]: *** Operational MODE: preforking *** Jul 21 15:50:55.103301 dv-cinder-850668-1-smb devstack@keystone.service[80243]: *** uWSGI is running in multiple interpreter mode *** Jul 21 15:50:55.103301 dv-cinder-850668-1-smb devstack@keystone.service[80243]: spawned uWSGI master process (pid: 80243) Jul 21 15:50:55.103509 dv-cinder-850668-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 21 15:50:55.104550 dv-cinder-850668-1-smb devstack@keystone.service[80243]: spawned uWSGI worker 1 (pid: 80252, cores: 1) Jul 21 15:50:55.104550 dv-cinder-850668-1-smb devstack@keystone.service[80243]: spawned uWSGI worker 2 (pid: 80253, cores: 1) Jul 21 15:50:55.104550 dv-cinder-850668-1-smb devstack@keystone.service[80243]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 15:51:00.550348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 15:51:00.550348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: from cryptography.utils import int_from_bytes Jul 21 15:51:00.551148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 15:51:00.551148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: from cryptography.utils import int_from_bytes Jul 21 15:51:00.552922 dv-cinder-850668-1-smb devstack@keystone.service[80253]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 15:51:00.552922 dv-cinder-850668-1-smb devstack@keystone.service[80253]: from cryptography.utils import int_from_bytes Jul 21 15:51:00.553425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 15:51:00.553425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: from cryptography.utils import int_from_bytes Jul 21 15:51:00.600021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 15:51:00.600227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 15:51:00.600359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] command line args: [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 15:51:00.600658 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 15:51:00.600816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ================================================================================ {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 15:51:00.601091 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] admin_token = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.601336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] config_dir = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.601540 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.601696 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] config_source = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.601904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] debug = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.602081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.602851 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.602978 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 15:51:00.603055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.603055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.603171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 15:51:00.603244 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.603324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] command line args: [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 15:51:00.603390 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.604042 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 15:51:00.604130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] log_config_append = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.604130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.604242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ================================================================================ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 15:51:00.604314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] log_dir = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.604314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] log_file = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.604430 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] admin_token = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.604489 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.604551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] config_dir = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.604620 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.604680 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.604737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.604952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] config_source = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.605037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.605106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] debug = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.605174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.605355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.605432 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.605607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.605689 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.605836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.605927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.606067 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.606151 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.606325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.606439 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.606519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.606655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.606744 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.607046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.607292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.607405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_config_append = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.607499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.607571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.607709 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_dir = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.607876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.608053 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.608198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.608343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] publish_errors = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.608432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.608512 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.608652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.608762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.608830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.608990 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.609082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.609236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.609347 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.609424 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.609525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] standard_threads = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.609668 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.609758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.609915 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.610004 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.610157 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.610240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.610356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] use_journal = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.610474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.610550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] use_json = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.610678 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] use_stderr = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.610760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.610893 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] use_syslog = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.610994 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.611132 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.611216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.611392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.611469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.611664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.611740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.611918 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.612163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.612240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.612405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] publish_errors = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.612496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.612644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.612725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.612899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.612981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.613132 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.613216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.613379 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.613455 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.613609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.613687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.613869 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.613960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] standard_threads = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.614107 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.614183 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.614660 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.614741 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.614927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.615019 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.615104 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] use_journal = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.615175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.615272 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] use_json = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.615415 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.615516 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] use_stderr = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.615658 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.615736 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] use_syslog = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.615923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.616013 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 15:51:00.616187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.616263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.616434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.616518 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.616673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.616768 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.616909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.616984 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.617157 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.617243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.617392 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.617472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.617635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.617717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.617866 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.617939 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.618096 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.618178 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.618329 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.618405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.618564 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.618642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.618792 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.618901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.619060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.619137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.619292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.619369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.619523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.619600 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.619767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.619842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.619998 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.620091 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.620251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.620328 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.620499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.620574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.620734 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.620818 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.620966 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.621041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.621199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.621274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.621432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.621509 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.621664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.621747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.621897 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.621990 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.622128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.622234 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.622374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.622509 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.622626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.622778 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.622900 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.623037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.623114 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.623283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.623365 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.623513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.623592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.623769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.623845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.624017 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.624093 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.624248 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.624338 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.624489 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.624612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.624725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.624893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.624977 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.625168 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.625250 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.625398 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.625474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.625626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.625711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.625853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.625928 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.626079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.626161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.626322 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.626408 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.626556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.626632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.626834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.626927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.627344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.627482 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.627482 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.627664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.627771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.627867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.627960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.628065 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.628168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.628264 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.628340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.628467 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.628588 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.628684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.628800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.628879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.629037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.629179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.629256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.629483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.629578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.629719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.629803 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.629953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.630030 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.630186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.630273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.630417 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.630501 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.630660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.630736 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.630924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.631019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.631165 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.631243 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.631405 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.631485 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.631643 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.631732 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.631905 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.632045 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.632150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.632344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.632437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.632574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.632653 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.632809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.632887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.633066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.633142 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.633306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.633428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.633545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.633665 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.633778 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.633979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.634065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.634227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.634302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.634461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.634540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.634693 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.634778 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.634963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.635043 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.635207 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.635284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.635456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.635627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.635702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.635772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.635945 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.636053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.636209 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.636365 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.636456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.636672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.636758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.external = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.636909 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.636992 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.637199 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.637275 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.637430 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.637507 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.637662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.password = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.637797 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.637894 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] auth.token = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.638039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.638118 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.638278 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.638355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.638516 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.638593 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.638760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.638870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.639022 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.639103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.639265 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.639342 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.639506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.639585 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.639734 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.639811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.639961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.640044 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.640187 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.640276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.640417 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.640497 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.640646 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.640724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.640882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.640961 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.641113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.641199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.641356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.641434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.641589 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.641667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.641842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.642098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.642285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.642371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.642549 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.642635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.642828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.642914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.643162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.643264 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.external = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.643411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.643493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.643654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.643743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.643893 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.643977 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.644142 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.644226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.password = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.644390 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.644480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] auth.token = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.644628 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.644711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.644858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.644939 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.645100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.645183 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.645351 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.645440 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.645589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.645679 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.645868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.646009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.646095 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.646172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.646320 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.646427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.646585 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.646669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.646855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.646941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.647106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.647188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.647347 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.647436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.647585 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.647682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.647818 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.647959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.648060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.648196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.648337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.648429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.648546 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.648667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.648795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.648921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.649076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.649155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.649321 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.649400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.649583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.649665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.649826 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.649905 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.650074 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.650152 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.650367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.650446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.650566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.650646 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.650851 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.650953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.651099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.651191 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.651405 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.651491 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.651564 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.651658 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.651798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.651877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.652041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.652122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.652272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.652359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.652510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.652589 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.652752 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.652830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.652994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.653087 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.653246 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.653326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.653479 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.653565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.653731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.653822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.653962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.654040 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.654192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.654273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.654435 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.654527 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.654663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.654742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.654920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.655002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.655159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.655278 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.655375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.655569 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.655681 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.655829 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.655924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.656057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.656140 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.656283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.656363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.656523 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.656603 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.656766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.656848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.657011 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.657090 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.657241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.657327 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.657474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.657555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.657724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.657805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.657975 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.658053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.658208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.658287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.658484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.658602 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.658721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.658979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.659074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.659223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.659302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.659464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.659541 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.659704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.659792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.659941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.660020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.660186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.660263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.660411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.660496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.660656 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.660735 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.660886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.660963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.661118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.661204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.661354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.661432 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.661595 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.661674 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.661819 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.661926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.662054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.662134 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.662297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.662379 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.662546 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.662634 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.662794 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.662940 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.663054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.663134 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.663287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.663369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.663524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.663603 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.663761 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.663838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.664005 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.664084 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.664232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.664311 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.664464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.664543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.664708 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.664788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.664951 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.665028 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.665181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.665260 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.665412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.665493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.665644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.665723 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.665870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.665950 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.666108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.666188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.666344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.666421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.666582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.666661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.666872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.666955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.667091 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.667179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.667326 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.667405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.667554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.667634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.667781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.667860 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.668012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.668092 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.668241 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.668322 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.668473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.668553 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.668701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.668779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.668943 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.669024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.669183 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.669260 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.669426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.669504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.669662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.669741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.669903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.669980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.670129 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.670208 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] role.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.670372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.670467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] role.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.670613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.670698 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.670839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.670917 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.671071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.671153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.671305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.671384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.671548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.671627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.671793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.671874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.672025 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.672105 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.672277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.672359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.672505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.672586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.672745 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.672830 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.672975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.673052 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.673201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.673277 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.673426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.673506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.673669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.673748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.673905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.674105 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.674185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.674344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.674423 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.674599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.674685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.674868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.674951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.675125 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.675204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.675357 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.675439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.675590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.675669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.675835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.675913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.676067 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.676148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.676308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.676389 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.676540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.676619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.676770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.676849 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.676999 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] role.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.677077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.677240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] role.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.677320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.677466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.677547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.677707 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.677792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.677950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.678029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.678187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.678267 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.678422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.678510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.678669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.678747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.678933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.679016 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.679176 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.679254 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.679413 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.679491 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.679640 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.679720 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.679883 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.679962 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.680126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.680206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.680369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.680456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.680609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.680687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.680856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.680996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.681083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.681231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.681331 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.681477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.681557 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.681727 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.681814 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.681972 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.682051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.682215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.682295 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.682532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.682620 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.682786 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.682926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.683057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.683138 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.connection = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.683295 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.683385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.683522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.683604 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.683749 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.683828 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.683976 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.684055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.684224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.684306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.684477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.684556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.684721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.684800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.684958 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.685038 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.685185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.685263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.685411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.685491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.685643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.685724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.685874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.685954 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.686117 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.686197 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.686348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.686429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.686590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.686667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.686841 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.686924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.687069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.687149 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.687309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.687399 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.687472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80252) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 15:51:00.687543 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.687774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.688005 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.688239 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.688469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.688708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.688951 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.689176 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.689417 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.689809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.690076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.690322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.690569 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.690807 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.691069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.691302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.691536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.691771 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.692005 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.692256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.692494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.692736 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.692970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.693223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.693457 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.693697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.693923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.694158 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.694388 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 15:51:00.694625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80253) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 15:51:00.718598 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.718887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.719082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.720287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.720518 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.720736 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.727548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.728966 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.755972 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.756187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.756966 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.757175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.905003 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.905896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.953294 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.953508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.953879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:00.954110 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.017778 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.017974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.018062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.018138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.018239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.018359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.018438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.018645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.018768 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.018862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.018948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.019061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.044067 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.044266 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.044368 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.044538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.044630 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.044694 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.044754 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.044929 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.045066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.045137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.045199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.045332 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.045490 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.045580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.056858 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.057094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.069931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.070154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.070416 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.070643 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.070764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.070858 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.070926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.071117 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.071272 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.071362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80252) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.071439 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.071502 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.071649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.071891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80253) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 15:51:01.088684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.088931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 15:51:01.089051 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.089229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 15:51:01.089351 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.089440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 15:51:01.089518 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.089685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.089808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 15:51:01.089919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.090019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.090207 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.090330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.090442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.090533 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.090711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.101731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.102007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.102172 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.102272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.102441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.102550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.102735 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.103035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.110675 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.111037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.114010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.114623 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.114714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.114932 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.115048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.115319 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.115418 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.115597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.115682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.115866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.115952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.116113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.116201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.116373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.116461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.116638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.116727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.116896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.116985 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.117156 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.117290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.117411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.143639 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.143885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.145231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.145492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.145619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.145756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.150695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.150988 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.151113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.151261 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.151387 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.151580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.158459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.158754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.159007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.159291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.163381 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.163636 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.163916 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.164197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.164322 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.164440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.164530 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.164707 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.164830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.165011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.165135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.165221 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.165298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.165506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.165635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.165785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.184355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.184491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.184607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.184701 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.189332 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.189524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.193077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.193366 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.193521 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.193628 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.198572 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.199616 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.202220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.203329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.206062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.206359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.206647 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.206967 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.207245 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.207370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.207515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.207607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.207948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.208229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.208507 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.208781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.226548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.226947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.227230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.227489 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.228378 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.228753 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.229080 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.229323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.235400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.237187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.237311 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.237426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.238980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.239212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.240913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.241194 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.241471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.241773 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.242064 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.242803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.243131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.243409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.243682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.243946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.256361 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.256647 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.256931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.257212 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.257494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.257767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.258041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.258582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.259170 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.259472 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.259746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.260019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.260292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.260636 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.280703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.284163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.284464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.287693 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.287830 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.289387 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.291034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.291307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.291435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.291583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.293343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.295131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.295417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.295713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.298934 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.300584 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.303806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.304088 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.304238 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.304330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.304605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.305762 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.309020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.309280 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.309590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.309864 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.313744 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.314031 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.314293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.319206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.319490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.319770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.322244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80253) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.322498 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.322783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.323078 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.323340 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.323611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.323883 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.324114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.324413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.324677 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.324945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.325174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.325425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.325695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80253) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.327640 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80252) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 15:51:01.327914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.328190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.328464 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.328738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.329024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.329299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.329583 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.329858 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.330127 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.330428 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.330690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.330971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.331239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80252) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 15:51:01.363205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a38a2859c0 pid: 80253 (default app) Jul 21 15:51:01.367238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01984701-cae5-4f07-967f-06c73b0ddd9e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:01.367528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01984701-cae5-4f07-967f-06c73b0ddd9e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:01.367798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01984701-cae5-4f07-967f-06c73b0ddd9e None None] PATH_INFO: `/v3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:01.369316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a38a2859c0 pid: 80252 (default app) Jul 21 15:51:01.372053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Thu Jul 21 15:51:01 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:08.981874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a4d04-0349-46c4-9873-b49fbd4d47d1 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:08.982904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a4d04-0349-46c4-9873-b49fbd4d47d1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:08.982904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a4d04-0349-46c4-9873-b49fbd4d47d1 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:08.988948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:08 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:08.996354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53316881-1333-4fa1-8a40-f185d29499bd None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:08.996811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53316881-1333-4fa1-8a40-f185d29499bd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:08.996927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53316881-1333-4fa1-8a40-f185d29499bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:09.072332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: INFO dbcounter [None req-53316881-1333-4fa1-8a40-f185d29499bd None None] Registered counter for database keystone Jul 21 15:51:09.097183 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG oslo_db.sqlalchemy.engines [None req-53316881-1333-4fa1-8a40-f185d29499bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80253) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 15:51:09.109887 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writer thread running {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 15:51:09.292798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG passlib.handlers.bcrypt [None req-53316881-1333-4fa1-8a40-f185d29499bd None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80253) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 15:51:09.293123 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG passlib.handlers.bcrypt [None req-53316881-1333-4fa1-8a40-f185d29499bd None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80253) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 15:51:09.347571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-53316881-1333-4fa1-8a40-f185d29499bd None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:09.349209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-53316881-1333-4fa1-8a40-f185d29499bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:09.479504 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 15:51:09.684571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a4d04-0349-46c4-9873-b49fbd4d47d1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:09.757577 dv-cinder-850668-1-smb devstack@keystone.service[80252]: INFO dbcounter [None req-ae8a4d04-0349-46c4-9873-b49fbd4d47d1 None None] Registered counter for database keystone Jul 21 15:51:09.779331 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG oslo_db.sqlalchemy.engines [None req-ae8a4d04-0349-46c4-9873-b49fbd4d47d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80252) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 15:51:09.791312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writer thread running {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 15:51:09.912266 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a4d04-0349-46c4-9873-b49fbd4d47d1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:09.917246 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f04e2c-968c-495c-8b3b-86bec96bcc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:09.917941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04e2c-968c-495c-8b3b-86bec96bcc83 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:09.918224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04e2c-968c-495c-8b3b-86bec96bcc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:09.918501 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04e2c-968c-495c-8b3b-86bec96bcc83 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:09.927488 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f04e2c-968c-495c-8b3b-86bec96bcc83 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:09.979082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a9f04e2c-968c-495c-8b3b-86bec96bcc83 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 15:51:09.979346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f04e2c-968c-495c-8b3b-86bec96bcc83 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:09.990132 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Jul 21 15:51:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 15:51:09.996622 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53316881-1333-4fa1-8a40-f185d29499bd None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:10.011928 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53316881-1333-4fa1-8a40-f185d29499bd None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:10.017447 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad60a07-4d51-44b6-9fa4-f91f8496909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:10.018687 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad60a07-4d51-44b6-9fa4-f91f8496909a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:10.019013 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad60a07-4d51-44b6-9fa4-f91f8496909a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:10.019289 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad60a07-4d51-44b6-9fa4-f91f8496909a admin admin] PATH_INFO: `/v3/projects/ab5b6764e1c145b69436e883cfb29e46` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:10.023558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad60a07-4d51-44b6-9fa4-f91f8496909a admin admin] RBAC: Authorizing `identity:get_project(project_id=ab5b6764e1c145b69436e883cfb29e46)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:10.073770 dv-cinder-850668-1-smb devstack@keystone.service[80253]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3ad60a07-4d51-44b6-9fa4-f91f8496909a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 15:51:10.074096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad60a07-4d51-44b6-9fa4-f91f8496909a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:10.078672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Jul 21 15:51:09 2022] GET /identity/v3/projects/ab5b6764e1c145b69436e883cfb29e46 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:12.088170 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea36572-4d59-4489-afd7-69900f1559fe None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:12.088746 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea36572-4d59-4489-afd7-69900f1559fe None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:12.088746 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea36572-4d59-4489-afd7-69900f1559fe None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:12.093070 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:12.098915 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eebbc-01f5-427e-8f8f-cd808248634d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:12.099454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eebbc-01f5-427e-8f8f-cd808248634d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:12.099577 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1eebbc-01f5-427e-8f8f-cd808248634d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:12.119658 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3f1eebbc-01f5-427e-8f8f-cd808248634d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:12.121251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3f1eebbc-01f5-427e-8f8f-cd808248634d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:12.129680 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 15:51:12.152187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea36572-4d59-4489-afd7-69900f1559fe None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:12.165535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea36572-4d59-4489-afd7-69900f1559fe None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:12.172726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48263522-7294-4195-89dd-5ef6f901e8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:12.173873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48263522-7294-4195-89dd-5ef6f901e8fe admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:12.174369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48263522-7294-4195-89dd-5ef6f901e8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:12.174995 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48263522-7294-4195-89dd-5ef6f901e8fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:12.185404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48263522-7294-4195-89dd-5ef6f901e8fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:12.187270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48263522-7294-4195-89dd-5ef6f901e8fe admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:12.197524 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Jul 21 15:51:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 15:51:12.203579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1eebbc-01f5-427e-8f8f-cd808248634d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:12.213514 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1eebbc-01f5-427e-8f8f-cd808248634d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:12.219402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911c1ef-b0b3-41b7-9b30-43f8824488af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:12.220300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911c1ef-b0b3-41b7-9b30-43f8824488af admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:12.220584 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911c1ef-b0b3-41b7-9b30-43f8824488af admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:12.220859 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911c1ef-b0b3-41b7-9b30-43f8824488af admin admin] PATH_INFO: `/v3/users/a71b1bb7d4ea44e095e9e4bdd64ff70b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:12.222493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911c1ef-b0b3-41b7-9b30-43f8824488af admin admin] RBAC: Authorizing `identity:get_user(user_id=a71b1bb7d4ea44e095e9e4bdd64ff70b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:12.224420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911c1ef-b0b3-41b7-9b30-43f8824488af admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:12.226058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Jul 21 15:51:12 2022] GET /identity/v3/users/a71b1bb7d4ea44e095e9e4bdd64ff70b => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:14.293672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecdb72-e1d0-4aeb-9a82-227853f1ce8c None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:14.294285 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecdb72-e1d0-4aeb-9a82-227853f1ce8c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:14.294285 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecdb72-e1d0-4aeb-9a82-227853f1ce8c None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:14.295782 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:14.301378 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8a6d1-0713-45b0-88f0-6babb61d4bf3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:14.301800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8a6d1-0713-45b0-88f0-6babb61d4bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:14.302032 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8a6d1-0713-45b0-88f0-6babb61d4bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:14.307575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4bf98-b4d5-4df4-a3c0-cc6bd09a2091 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:14.307864 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4bf98-b4d5-4df4-a3c0-cc6bd09a2091 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:14.308153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca4bf98-b4d5-4df4-a3c0-cc6bd09a2091 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:14.309464 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:51:14.314552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0ab32-2456-46b6-b523-863700a012c4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:14.314854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0ab32-2456-46b6-b523-863700a012c4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:14.315161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0ab32-2456-46b6-b523-863700a012c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:14.321019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-19c8a6d1-0713-45b0-88f0-6babb61d4bf3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:14.322384 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-19c8a6d1-0713-45b0-88f0-6babb61d4bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:14.354090 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG passlib.handlers.bcrypt [None req-29b0ab32-2456-46b6-b523-863700a012c4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80252) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 15:51:14.354507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG passlib.handlers.bcrypt [None req-29b0ab32-2456-46b6-b523-863700a012c4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80252) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 15:51:14.399642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-29b0ab32-2456-46b6-b523-863700a012c4 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:14.401237 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-29b0ab32-2456-46b6-b523-863700a012c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:14.410264 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:14.433606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8a6d1-0713-45b0-88f0-6babb61d4bf3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:14.458402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:14.509466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:14.532719 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0ab32-2456-46b6-b523-863700a012c4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:14.542360 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8a6d1-0713-45b0-88f0-6babb61d4bf3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:14.577729 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef04db-cd29-469e-ab15-17a036279c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:14.578556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef04db-cd29-469e-ab15-17a036279c6d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:14.578854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef04db-cd29-469e-ab15-17a036279c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:14.579157 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ef04db-cd29-469e-ab15-17a036279c6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:14.590369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ef04db-cd29-469e-ab15-17a036279c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a4ef04db-cd29-469e-ab15-17a036279c6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:14.601659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:14.602671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:14.603524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:14.603524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:14.603524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:14.603524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:14.603524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:14.603524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:14.603524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:14.603524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:14.603524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:14.603524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:14.603524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:14.603524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:14.603524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:51:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:14.609250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef04db-cd29-469e-ab15-17a036279c6d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:14.638210 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0ab32-2456-46b6-b523-863700a012c4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:14.640945 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:14.679373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecad653-0bc6-40e3-9d61-e67a44acd8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:14.680375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecad653-0bc6-40e3-9d61-e67a44acd8af None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:14.680693 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecad653-0bc6-40e3-9d61-e67a44acd8af None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:14.681001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecad653-0bc6-40e3-9d61-e67a44acd8af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:14.695919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:14.714982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ef04db-cd29-469e-ab15-17a036279c6d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:14.751021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecad653-0bc6-40e3-9d61-e67a44acd8af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:14.751197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338984f-4a86-4f61-8ecc-0bb6d7d7456d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:14.751731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338984f-4a86-4f61-8ecc-0bb6d7d7456d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:14.752018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338984f-4a86-4f61-8ecc-0bb6d7d7456d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:14.752297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b338984f-4a86-4f61-8ecc-0bb6d7d7456d None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:14.752672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecad653-0bc6-40e3-9d61-e67a44acd8af None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:14.753196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338984f-4a86-4f61-8ecc-0bb6d7d7456d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:14.753520 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338984f-4a86-4f61-8ecc-0bb6d7d7456d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:14.754978 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b338984f-4a86-4f61-8ecc-0bb6d7d7456d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:14.767101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:14.772783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338984f-4a86-4f61-8ecc-0bb6d7d7456d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:14.849465 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:51:14.856131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecad653-0bc6-40e3-9d61-e67a44acd8af None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:14.860822 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:14.879127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b338984f-4a86-4f61-8ecc-0bb6d7d7456d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:14.912888 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d6674-5e4f-4a0f-b086-ee4c1e51331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:14.913788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d6674-5e4f-4a0f-b086-ee4c1e51331e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:14.914074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d6674-5e4f-4a0f-b086-ee4c1e51331e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:14.914756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d6674-5e4f-4a0f-b086-ee4c1e51331e None admin] PATH_INFO: `/v3/users/a71b1bb7d4ea44e095e9e4bdd64ff70b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:14.916214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d6674-5e4f-4a0f-b086-ee4c1e51331e None admin] RBAC: Authorizing `identity:get_user(user_id=a71b1bb7d4ea44e095e9e4bdd64ff70b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:14.917708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d6674-5e4f-4a0f-b086-ee4c1e51331e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:14.919597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:14 2022] GET /identity/v3/users/a71b1bb7d4ea44e095e9e4bdd64ff70b => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:14.925802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d6674-5e4f-4a0f-b086-ee4c1e51331e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:14.942220 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:14.962779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecad653-0bc6-40e3-9d61-e67a44acd8af None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:14.996207 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072b1dd-9d58-4e5b-b580-1761ca949d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:14.996952 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072b1dd-9d58-4e5b-b580-1761ca949d74 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:14.997237 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072b1dd-9d58-4e5b-b580-1761ca949d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:14.997516 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3072b1dd-9d58-4e5b-b580-1761ca949d74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:15.017136 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072b1dd-9d58-4e5b-b580-1761ca949d74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:15.018735 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3072b1dd-9d58-4e5b-b580-1761ca949d74 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:15.028311 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d6674-5e4f-4a0f-b086-ee4c1e51331e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:15.039477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-3072b1dd-9d58-4e5b-b580-1761ca949d74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:51:15.039477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:15.039477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:15.039477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:15.039477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:15.039477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:15.039477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:15.039477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:15.039477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:15.039477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:15.039477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:15.039477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:15.039477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:51:15.039477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:51:15.039477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:15.040504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:15.041459 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:51:15.041459 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:51:15.041459 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:51:15.041459 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:15.041459 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 9/18] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:51:15.046638 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072b1dd-9d58-4e5b-b580-1761ca949d74 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:15.064491 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a1d1c-4d03-4f49-b8cb-15e44709cce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:15.065601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a1d1c-4d03-4f49-b8cb-15e44709cce0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:15.065994 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a1d1c-4d03-4f49-b8cb-15e44709cce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:15.066400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a1d1c-4d03-4f49-b8cb-15e44709cce0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:15.068141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a1d1c-4d03-4f49-b8cb-15e44709cce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:15.070251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a1d1c-4d03-4f49-b8cb-15e44709cce0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:15.072556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 10/19] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:15.085498 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a1d1c-4d03-4f49-b8cb-15e44709cce0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:15.104679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:15.156341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3072b1dd-9d58-4e5b-b580-1761ca949d74 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:15.176950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:15.201250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a1d1c-4d03-4f49-b8cb-15e44709cce0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:15.202081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6e432-8843-4262-a796-6815f9516205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:15.202840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6e432-8843-4262-a796-6815f9516205 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:15.203238 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6e432-8843-4262-a796-6815f9516205 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:15.203482 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6e432-8843-4262-a796-6815f9516205 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:15.204229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6e432-8843-4262-a796-6815f9516205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:15.204537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6e432-8843-4262-a796-6815f9516205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:15.206006 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6e432-8843-4262-a796-6815f9516205 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:15.223833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 10/20] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:15.240071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4bf11-5f12-4606-961b-1ee8e5a6c93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:15.240767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4bf11-5f12-4606-961b-1ee8e5a6c93c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:15.241102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4bf11-5f12-4606-961b-1ee8e5a6c93c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:15.241381 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4bf11-5f12-4606-961b-1ee8e5a6c93c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:15.242257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4bf11-5f12-4606-961b-1ee8e5a6c93c None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.domain.id=default, user.id=a71b1bb7d4ea44e095e9e4bdd64ff70b) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:15.242569 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4bf11-5f12-4606-961b-1ee8e5a6c93c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:15.244131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4bf11-5f12-4606-961b-1ee8e5a6c93c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:15.252414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 11/21] 10.222.0.64 () {56 vars in 1322 bytes} [Thu Jul 21 15:51:15 2022] GET /identity/v3/role_assignments?user.id=a71b1bb7d4ea44e095e9e4bdd64ff70b&scope.domain.id=default&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 233 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:17.708578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3012d-85b8-49fd-a29f-5762b779d591 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:17.709109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3012d-85b8-49fd-a29f-5762b779d591 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:17.709210 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3012d-85b8-49fd-a29f-5762b779d591 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:17.710839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 11/22] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:17.716376 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec77edf-e0d1-4e49-8b20-aa2aff2b6736 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:17.716802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec77edf-e0d1-4e49-8b20-aa2aff2b6736 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:17.716938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec77edf-e0d1-4e49-8b20-aa2aff2b6736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:17.740101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-dec77edf-e0d1-4e49-8b20-aa2aff2b6736 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:17.741312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dec77edf-e0d1-4e49-8b20-aa2aff2b6736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:17.813303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544bfcce-75bb-4588-99b1-9e105a24cdd7 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:17.813661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544bfcce-75bb-4588-99b1-9e105a24cdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:17.813994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544bfcce-75bb-4588-99b1-9e105a24cdd7 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:17.816181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 12/23] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:17.829714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02b555-c590-4691-a092-3111c261096e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:17.830027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02b555-c590-4691-a092-3111c261096e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:17.830273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02b555-c590-4691-a092-3111c261096e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:17.857232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 12/24] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:17.859972 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ee02b555-c590-4691-a092-3111c261096e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:17.861224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ee02b555-c590-4691-a092-3111c261096e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:17.919978 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec77edf-e0d1-4e49-8b20-aa2aff2b6736 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:17.981154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 13/25] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:17.982263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e296c2f-6e98-4173-8f77-20e7b8668e69 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:17.982561 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e296c2f-6e98-4173-8f77-20e7b8668e69 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:17.982871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e296c2f-6e98-4173-8f77-20e7b8668e69 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:17.984173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 14/26] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:17.989632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8efb3e-ffbf-43f7-99cd-af9ce88bd028 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:17.990281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8efb3e-ffbf-43f7-99cd-af9ce88bd028 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:17.990620 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8efb3e-ffbf-43f7-99cd-af9ce88bd028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:18.018198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:18.022769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6c8efb3e-ffbf-43f7-99cd-af9ce88bd028 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:18.028656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6c8efb3e-ffbf-43f7-99cd-af9ce88bd028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:18.045803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec77edf-e0d1-4e49-8b20-aa2aff2b6736 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:18.083096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29d455-1549-4a43-81ed-d64dce9913b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:18.084163 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29d455-1549-4a43-81ed-d64dce9913b0 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:18.084678 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29d455-1549-4a43-81ed-d64dce9913b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:18.085164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29d455-1549-4a43-81ed-d64dce9913b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:18.086176 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29d455-1549-4a43-81ed-d64dce9913b0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:18.087888 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29d455-1549-4a43-81ed-d64dce9913b0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:18.105617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:18.133920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 15/27] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:18.135100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8efb3e-ffbf-43f7-99cd-af9ce88bd028 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:18.233271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 13/28] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 21 15:51:17 2022] POST /identity/v3/roles => generated 219 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 15:51:18.235363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ca50c-2771-4501-a9aa-7de324b20261 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:18.235858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ca50c-2771-4501-a9aa-7de324b20261 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:18.236368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ca50c-2771-4501-a9aa-7de324b20261 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:18.238198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 14/29] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:18.239257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ca50c-2771-4501-a9aa-7de324b20261 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:18.251751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8efb3e-ffbf-43f7-99cd-af9ce88bd028 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:18.290563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9e4e3-b49f-4943-a892-e633e69b9ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:18.292022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9e4e3-b49f-4943-a892-e633e69b9ccc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:18.292683 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9e4e3-b49f-4943-a892-e633e69b9ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:18.293152 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9e4e3-b49f-4943-a892-e633e69b9ccc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:18.305821 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9e4e3-b49f-4943-a892-e633e69b9ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:18.310162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9e4e3-b49f-4943-a892-e633e69b9ccc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:18.347186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-baa9e4e3-b49f-4943-a892-e633e69b9ccc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:51:18.347186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:18.347186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:18.347186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:18.347186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:18.347186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:18.347186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:18.347186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:18.347186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:18.347186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:18.347186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:18.347186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:18.347186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:51:18.347186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:51:18.347186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:18.348057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:18.348839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:51:18.348839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:51:18.348839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:51:18.348839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:18.353658 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 16/30] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:18.356933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f04bfe-5fec-42b9-8438-cf2e4a1066fc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:18.358991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f04bfe-5fec-42b9-8438-cf2e4a1066fc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:18.360264 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f04bfe-5fec-42b9-8438-cf2e4a1066fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:18.394978 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f8f04bfe-5fec-42b9-8438-cf2e4a1066fc None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:18.398671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f8f04bfe-5fec-42b9-8438-cf2e4a1066fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:18.424774 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:18.427175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ca50c-2771-4501-a9aa-7de324b20261 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:18.469348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09df1b-e736-4f80-a56b-3da2f79e7089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:18.470374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09df1b-e736-4f80-a56b-3da2f79e7089 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:18.470853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09df1b-e736-4f80-a56b-3da2f79e7089 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:18.471328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09df1b-e736-4f80-a56b-3da2f79e7089 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:18.472359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09df1b-e736-4f80-a56b-3da2f79e7089 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:18.474224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09df1b-e736-4f80-a56b-3da2f79e7089 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:18.477557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:18.493045 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 17/31] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:18.494199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f04bfe-5fec-42b9-8438-cf2e4a1066fc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:18.497895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 15/32] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 21 15:51:18 2022] POST /identity/v3/roles => generated 225 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:51:18.544778 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09df1b-e736-4f80-a56b-3da2f79e7089 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:18.616183 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f04bfe-5fec-42b9-8438-cf2e4a1066fc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:18.673020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bece8fa-2df8-44a9-9ead-a8775274110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:18.673978 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bece8fa-2df8-44a9-9ead-a8775274110c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:18.674525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bece8fa-2df8-44a9-9ead-a8775274110c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:18.674969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bece8fa-2df8-44a9-9ead-a8775274110c None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:18.675992 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bece8fa-2df8-44a9-9ead-a8775274110c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:18.676550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bece8fa-2df8-44a9-9ead-a8775274110c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:18.678137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bece8fa-2df8-44a9-9ead-a8775274110c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:18.695978 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 18/33] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:18.698363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09df1b-e736-4f80-a56b-3da2f79e7089 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:18.701659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bece8fa-2df8-44a9-9ead-a8775274110c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:18.736206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:18.738682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091caff-8181-4f77-b1a0-427b289b74d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:18.740975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091caff-8181-4f77-b1a0-427b289b74d7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:18.740975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091caff-8181-4f77-b1a0-427b289b74d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:18.740975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091caff-8181-4f77-b1a0-427b289b74d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:18.751597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2091caff-8181-4f77-b1a0-427b289b74d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-2091caff-8181-4f77-b1a0-427b289b74d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:18.760733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:18.761802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:18.762731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:18.762731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:18.762731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:18.762731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:18.762731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:18.762731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:18.762731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:18.762731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:18.762731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:18.762731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:18.762731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:18.762731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:18.762731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 16/34] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:51:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:18.769467 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091caff-8181-4f77-b1a0-427b289b74d7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:18.839085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:18.855255 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bece8fa-2df8-44a9-9ead-a8775274110c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:18.892887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea88cda-f8db-4891-88ac-c66490cdb4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:18.893730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea88cda-f8db-4891-88ac-c66490cdb4d9 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:18.893974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea88cda-f8db-4891-88ac-c66490cdb4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:18.894275 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea88cda-f8db-4891-88ac-c66490cdb4d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:18.895330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea88cda-f8db-4891-88ac-c66490cdb4d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:18.897026 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea88cda-f8db-4891-88ac-c66490cdb4d9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:18.899684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2091caff-8181-4f77-b1a0-427b289b74d7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:18.938725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ecf10-7008-4db8-afda-6a5b6ce52631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:18.939499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ecf10-7008-4db8-afda-6a5b6ce52631 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:18.939789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ecf10-7008-4db8-afda-6a5b6ce52631 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:18.940150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ecf10-7008-4db8-afda-6a5b6ce52631 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:18.940984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ecf10-7008-4db8-afda-6a5b6ce52631 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:18.941305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ecf10-7008-4db8-afda-6a5b6ce52631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:18.942929 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ecf10-7008-4db8-afda-6a5b6ce52631 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:18.953226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 17/35] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:18.959926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ecf10-7008-4db8-afda-6a5b6ce52631 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:19.054449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 19/36] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 15:51:18 2022] POST /identity/v3/projects => generated 301 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 15:51:19.073294 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ecf10-7008-4db8-afda-6a5b6ce52631 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:19.093143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:19.114597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7f3020-66ad-4bb4-a8d2-c93fcf6f271f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:19.116212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f3020-66ad-4bb4-a8d2-c93fcf6f271f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:19.116653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f3020-66ad-4bb4-a8d2-c93fcf6f271f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:19.117076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7f3020-66ad-4bb4-a8d2-c93fcf6f271f None admin] PATH_INFO: `/v3/users/a71b1bb7d4ea44e095e9e4bdd64ff70b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:19.118635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f3020-66ad-4bb4-a8d2-c93fcf6f271f None admin] RBAC: Authorizing `identity:get_user(user_id=a71b1bb7d4ea44e095e9e4bdd64ff70b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:19.120345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7f3020-66ad-4bb4-a8d2-c93fcf6f271f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:19.122285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 18/37] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:18 2022] GET /identity/v3/users/a71b1bb7d4ea44e095e9e4bdd64ff70b => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:19.129203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea88cda-f8db-4891-88ac-c66490cdb4d9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:19.203850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68b9cf-aa0e-45e7-af5b-ae11ee0500a1 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:19.204301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68b9cf-aa0e-45e7-af5b-ae11ee0500a1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:19.204687 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a68b9cf-aa0e-45e7-af5b-ae11ee0500a1 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:19.206282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 19/38] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:51:19.212323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b12b87-94bf-4e3b-bfcc-1993f966246b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:19.212740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b12b87-94bf-4e3b-bfcc-1993f966246b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:19.213126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b12b87-94bf-4e3b-bfcc-1993f966246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:19.219702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:19.236588 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-93b12b87-94bf-4e3b-bfcc-1993f966246b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:19.238905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-93b12b87-94bf-4e3b-bfcc-1993f966246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:19.266350 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea88cda-f8db-4891-88ac-c66490cdb4d9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:19.309539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d01246-0b24-4b14-a6de-a41aff69cfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:19.310287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d01246-0b24-4b14-a6de-a41aff69cfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:19.310573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d01246-0b24-4b14-a6de-a41aff69cfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:19.310899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d01246-0b24-4b14-a6de-a41aff69cfc2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:19.312159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d01246-0b24-4b14-a6de-a41aff69cfc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:19.313752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d01246-0b24-4b14-a6de-a41aff69cfc2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:19.315519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 20/39] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:19.316763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66582303-954f-462c-bfd5-cd1bb57028a4 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:19.317056 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66582303-954f-462c-bfd5-cd1bb57028a4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:19.317336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66582303-954f-462c-bfd5-cd1bb57028a4 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:19.318748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 21/40] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:19.320982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 20/41] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:19.323303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66582303-954f-462c-bfd5-cd1bb57028a4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:19.323886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31542944-bb81-40ef-93d7-0c981d661128 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:19.324292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31542944-bb81-40ef-93d7-0c981d661128 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:19.324569 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31542944-bb81-40ef-93d7-0c981d661128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:19.342115 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-31542944-bb81-40ef-93d7-0c981d661128 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:19.343724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-31542944-bb81-40ef-93d7-0c981d661128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:19.411128 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 21/42] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:19.412006 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31542944-bb81-40ef-93d7-0c981d661128 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:19.441053 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66582303-954f-462c-bfd5-cd1bb57028a4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:19.462438 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:19.478145 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077f589-6a5a-4ba4-b313-f1ad6b9bccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:19.479082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077f589-6a5a-4ba4-b313-f1ad6b9bccea None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:19.479470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077f589-6a5a-4ba4-b313-f1ad6b9bccea None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:19.479759 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077f589-6a5a-4ba4-b313-f1ad6b9bccea None admin] PATH_INFO: `/v3/domains/default/users/a71b1bb7d4ea44e095e9e4bdd64ff70b/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:19.482419 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077f589-6a5a-4ba4-b313-f1ad6b9bccea None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a71b1bb7d4ea44e095e9e4bdd64ff70b, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:19.483951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077f589-6a5a-4ba4-b313-f1ad6b9bccea None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:19.497104 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:19.502479 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 22/43] 10.222.0.64 () {58 vars in 1361 bytes} [Thu Jul 21 15:51:19 2022] PUT /identity/v3/domains/default/users/a71b1bb7d4ea44e095e9e4bdd64ff70b/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 15:51:19.503367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077f589-6a5a-4ba4-b313-f1ad6b9bccea None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:19.539308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31542944-bb81-40ef-93d7-0c981d661128 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:19.584052 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cff34-798b-484b-86e7-354ce48a9af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:19.584764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cff34-798b-484b-86e7-354ce48a9af8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:19.585069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cff34-798b-484b-86e7-354ce48a9af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:19.585332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cff34-798b-484b-86e7-354ce48a9af8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:19.586670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cff34-798b-484b-86e7-354ce48a9af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:19.588247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008cff34-798b-484b-86e7-354ce48a9af8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:19.590011 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 22/44] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:19.596491 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cff34-798b-484b-86e7-354ce48a9af8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:19.622594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077f589-6a5a-4ba4-b313-f1ad6b9bccea None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:19.666856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28995e8e-cb14-4050-baca-39618bcf7a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:19.667673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28995e8e-cb14-4050-baca-39618bcf7a4a None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:19.667963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28995e8e-cb14-4050-baca-39618bcf7a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:19.668243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28995e8e-cb14-4050-baca-39618bcf7a4a None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:19.669003 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28995e8e-cb14-4050-baca-39618bcf7a4a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:19.670453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28995e8e-cb14-4050-baca-39618bcf7a4a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:19.687588 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 23/45] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 21 15:51:19 2022] POST /identity/v3/roles => generated 223 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:51:19.838767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008cff34-798b-484b-86e7-354ce48a9af8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:19.854447 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:19.882175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8d543-306d-4fa5-86e2-81201475e8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:19.883117 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8d543-306d-4fa5-86e2-81201475e8e6 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:19.883403 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8d543-306d-4fa5-86e2-81201475e8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:19.883675 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8d543-306d-4fa5-86e2-81201475e8e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:19.884419 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8d543-306d-4fa5-86e2-81201475e8e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:19.885896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8d543-306d-4fa5-86e2-81201475e8e6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:19.915644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 23/46] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 15:51:19 2022] POST /identity/v3/projects => generated 312 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 15:51:21.580124 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eddbb-9ba2-4449-98a3-dc5a1244412a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:21.580639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eddbb-9ba2-4449-98a3-dc5a1244412a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:21.580639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4eddbb-9ba2-4449-98a3-dc5a1244412a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:21.582335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 24/47] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:21.587875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae8d25-9d74-4f69-8cab-7bb0d31f37a1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:21.588279 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae8d25-9d74-4f69-8cab-7bb0d31f37a1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:21.588439 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae8d25-9d74-4f69-8cab-7bb0d31f37a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:21.605650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0dae8d25-9d74-4f69-8cab-7bb0d31f37a1 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:21.607023 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0dae8d25-9d74-4f69-8cab-7bb0d31f37a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:21.677316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 24/48] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:21.700212 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eddbb-9ba2-4449-98a3-dc5a1244412a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:21.766140 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:21.810054 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4eddbb-9ba2-4449-98a3-dc5a1244412a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:21.844561 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7245b9a9-2720-449e-90ea-e983924b20a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:21.845281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245b9a9-2720-449e-90ea-e983924b20a7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:21.845558 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245b9a9-2720-449e-90ea-e983924b20a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:21.845842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7245b9a9-2720-449e-90ea-e983924b20a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:21.858380 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7245b9a9-2720-449e-90ea-e983924b20a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-7245b9a9-2720-449e-90ea-e983924b20a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:21.867661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:21.868556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:21.869392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:21.869392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:21.869392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:21.869392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:21.869392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:21.869392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:21.869392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:21.869392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:21.869392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:21.869392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:21.869392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:21.869392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:21.869392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 25/49] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:51:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:21.874969 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae8d25-9d74-4f69-8cab-7bb0d31f37a1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:21.934633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e64b45-65e8-40ff-8e23-f394b4adbc64 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:21.934938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e64b45-65e8-40ff-8e23-f394b4adbc64 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:21.935230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e64b45-65e8-40ff-8e23-f394b4adbc64 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:21.936690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 26/50] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:21 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:21.942034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8932b-1f53-4b1d-8f54-a0e4aaf37f8b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:21.942337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8932b-1f53-4b1d-8f54-a0e4aaf37f8b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:21.942622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8932b-1f53-4b1d-8f54-a0e4aaf37f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:21.960372 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e5e8932b-1f53-4b1d-8f54-a0e4aaf37f8b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:21.961902 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e5e8932b-1f53-4b1d-8f54-a0e4aaf37f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:21.974656 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:21.982444 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae8d25-9d74-4f69-8cab-7bb0d31f37a1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:22.018177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1007f-7d5a-4ee0-b150-f912ae59ca45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:22.018966 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1007f-7d5a-4ee0-b150-f912ae59ca45 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:22.019256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1007f-7d5a-4ee0-b150-f912ae59ca45 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:22.019534 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1007f-7d5a-4ee0-b150-f912ae59ca45 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:22.020328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1007f-7d5a-4ee0-b150-f912ae59ca45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:22.020666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1007f-7d5a-4ee0-b150-f912ae59ca45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:22.022111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1007f-7d5a-4ee0-b150-f912ae59ca45 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:22.030934 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 25/51] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:22.036757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1007f-7d5a-4ee0-b150-f912ae59ca45 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:22.039175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 27/52] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:22.062085 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8932b-1f53-4b1d-8f54-a0e4aaf37f8b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:22.114669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:22.140533 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1007f-7d5a-4ee0-b150-f912ae59ca45 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:22.167713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8932b-1f53-4b1d-8f54-a0e4aaf37f8b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:22.173855 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002b248-40c6-4061-91ad-d1fad416d5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:22.175069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002b248-40c6-4061-91ad-d1fad416d5be None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:22.175356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002b248-40c6-4061-91ad-d1fad416d5be None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:22.175633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002b248-40c6-4061-91ad-d1fad416d5be None admin] PATH_INFO: `/v3/users/a71b1bb7d4ea44e095e9e4bdd64ff70b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:22.176908 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002b248-40c6-4061-91ad-d1fad416d5be None admin] RBAC: Authorizing `identity:get_user(user_id=a71b1bb7d4ea44e095e9e4bdd64ff70b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:22.178372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002b248-40c6-4061-91ad-d1fad416d5be None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:22.180070 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:22 2022] GET /identity/v3/users/a71b1bb7d4ea44e095e9e4bdd64ff70b => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:22.185522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002b248-40c6-4061-91ad-d1fad416d5be None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:22.207046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac20214-a8e7-47cb-9b7f-31bd54d798cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:22.207870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac20214-a8e7-47cb-9b7f-31bd54d798cf None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:22.208161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac20214-a8e7-47cb-9b7f-31bd54d798cf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:22.208451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac20214-a8e7-47cb-9b7f-31bd54d798cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:22.209652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac20214-a8e7-47cb-9b7f-31bd54d798cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:22.211194 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac20214-a8e7-47cb-9b7f-31bd54d798cf None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:22.212119 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:22.213161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 28/54] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:22.218696 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac20214-a8e7-47cb-9b7f-31bd54d798cf None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:22.286234 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002b248-40c6-4061-91ad-d1fad416d5be None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:22.316339 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac20214-a8e7-47cb-9b7f-31bd54d798cf None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:22.320712 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa167a-494d-4b27-acfd-67e4cdda6b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:22.321529 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa167a-494d-4b27-acfd-67e4cdda6b6b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:22.321817 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa167a-494d-4b27-acfd-67e4cdda6b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:22.322097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa167a-494d-4b27-acfd-67e4cdda6b6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:22.323387 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa167a-494d-4b27-acfd-67e4cdda6b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:22.324916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa167a-494d-4b27-acfd-67e4cdda6b6b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:22.326633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:22.332955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa167a-494d-4b27-acfd-67e4cdda6b6b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:22.438742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:22.443579 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:22.448695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa167a-494d-4b27-acfd-67e4cdda6b6b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:22.462727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94051c95-0ebc-4286-9c02-9290d18e583d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:22.463442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94051c95-0ebc-4286-9c02-9290d18e583d None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:22.463723 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94051c95-0ebc-4286-9c02-9290d18e583d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:22.463994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94051c95-0ebc-4286-9c02-9290d18e583d None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:22.464713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94051c95-0ebc-4286-9c02-9290d18e583d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:22.466162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94051c95-0ebc-4286-9c02-9290d18e583d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:22.485313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93eafb4-efd5-4c1a-b33f-3219b310cea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:22.485991 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eafb4-efd5-4c1a-b33f-3219b310cea6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:22.486345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eafb4-efd5-4c1a-b33f-3219b310cea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:22.486632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93eafb4-efd5-4c1a-b33f-3219b310cea6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:22.487576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93eafb4-efd5-4c1a-b33f-3219b310cea6 None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.domain.id=default, user.id=a71b1bb7d4ea44e095e9e4bdd64ff70b) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:22.487884 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93eafb4-efd5-4c1a-b33f-3219b310cea6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:22.489373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93eafb4-efd5-4c1a-b33f-3219b310cea6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:22.492340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 29/56] 10.222.0.64 () {60 vars in 1140 bytes} [Thu Jul 21 15:51:22 2022] POST /identity/v3/projects => generated 298 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 15:51:22.496031 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1322 bytes} [Thu Jul 21 15:51:22 2022] GET /identity/v3/role_assignments?user.id=a71b1bb7d4ea44e095e9e4bdd64ff70b&scope.domain.id=default&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 530 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:24.524673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6bd0a-befe-4665-988e-0d97e9b55515 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:24.525187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6bd0a-befe-4665-988e-0d97e9b55515 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:24.525187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6bd0a-befe-4665-988e-0d97e9b55515 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:24.526508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 30/58] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:24.531822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd104-5f6d-4949-800b-ba39f3da5ee8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:24.532257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd104-5f6d-4949-800b-ba39f3da5ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:24.532343 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abd104-5f6d-4949-800b-ba39f3da5ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:24.550061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-87abd104-5f6d-4949-800b-ba39f3da5ee8 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:24.551316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-87abd104-5f6d-4949-800b-ba39f3da5ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:24.621449 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 29/59] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:24.645483 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6bd0a-befe-4665-988e-0d97e9b55515 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:24.751915 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6bd0a-befe-4665-988e-0d97e9b55515 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:24.786955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeffb86-fc2f-4b42-971e-bf923abb7795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:24.787700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeffb86-fc2f-4b42-971e-bf923abb7795 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:24.787991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeffb86-fc2f-4b42-971e-bf923abb7795 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:24.788270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeffb86-fc2f-4b42-971e-bf923abb7795 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:24.789582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeffb86-fc2f-4b42-971e-bf923abb7795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:24.791086 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeffb86-fc2f-4b42-971e-bf923abb7795 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:24.792730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 31/60] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:24.799273 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd104-5f6d-4949-800b-ba39f3da5ee8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:24.897474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:24.913954 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abd104-5f6d-4949-800b-ba39f3da5ee8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:24.949656 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06de177-9f14-4630-b4a1-22f54f5ec40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:24.950337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06de177-9f14-4630-b4a1-22f54f5ec40d None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:24.950621 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06de177-9f14-4630-b4a1-22f54f5ec40d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:24.950924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06de177-9f14-4630-b4a1-22f54f5ec40d None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:24.951647 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06de177-9f14-4630-b4a1-22f54f5ec40d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:24.953112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06de177-9f14-4630-b4a1-22f54f5ec40d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:24.980539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 30/61] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:51:24 2022] POST /identity/v3/users => generated 275 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:51:28.094629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c23a2-6280-4a4a-95f5-c57c01d1ee24 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:28.095518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c23a2-6280-4a4a-95f5-c57c01d1ee24 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:28.095971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366c23a2-6280-4a4a-95f5-c57c01d1ee24 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:28.097619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 32/62] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:28.103336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3329c5-2b99-413b-9c1e-23b3a841509f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:28.104127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3329c5-2b99-413b-9c1e-23b3a841509f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:28.104551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3329c5-2b99-413b-9c1e-23b3a841509f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:28.118738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a6a5-9fb9-4073-9130-c93e38c50c18 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:28.119376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a6a5-9fb9-4073-9130-c93e38c50c18 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:28.119853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a6a5-9fb9-4073-9130-c93e38c50c18 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:28.121429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 33/63] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:28.126648 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df91d9-0a54-4d92-8c6c-489b25adac6e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:28.127230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df91d9-0a54-4d92-8c6c-489b25adac6e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:28.127769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df91d9-0a54-4d92-8c6c-489b25adac6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:28.135219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-dd3329c5-2b99-413b-9c1e-23b3a841509f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:28.141107 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dd3329c5-2b99-413b-9c1e-23b3a841509f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:28.157506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a1df91d9-0a54-4d92-8c6c-489b25adac6e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:28.159156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a1df91d9-0a54-4d92-8c6c-489b25adac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:28.220069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:28.271918 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 31/64] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:28.281969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 34/65] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:28.296816 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3329c5-2b99-413b-9c1e-23b3a841509f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:28.308355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9636847-7a25-4304-abeb-afd870d484d1 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:28.308650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9636847-7a25-4304-abeb-afd870d484d1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:28.308935 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9636847-7a25-4304-abeb-afd870d484d1 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:28.310331 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 35/66] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:51:28.315931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764d331-3f70-41af-8d00-22a361e89819 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:28.316561 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764d331-3f70-41af-8d00-22a361e89819 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:28.317077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764d331-3f70-41af-8d00-22a361e89819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:28.335223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3764d331-3f70-41af-8d00-22a361e89819 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:28.336630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3764d331-3f70-41af-8d00-22a361e89819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:28.369601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:28.401397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3329c5-2b99-413b-9c1e-23b3a841509f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:28.418883 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 36/67] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:28.420010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764d331-3f70-41af-8d00-22a361e89819 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:28.437127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173dd5a-ba08-4bed-9972-03354d9f91be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:28.438188 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173dd5a-ba08-4bed-9972-03354d9f91be None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:28.438644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173dd5a-ba08-4bed-9972-03354d9f91be None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:28.439103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173dd5a-ba08-4bed-9972-03354d9f91be None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:28.455991 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173dd5a-ba08-4bed-9972-03354d9f91be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1173dd5a-ba08-4bed-9972-03354d9f91be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:28.464667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:28.465798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:28.466756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:28.466756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:28.466756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:28.466756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:28.466756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:28.466756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:28.466756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:28.466756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:28.466756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:28.466756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:28.466756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:28.466756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:28.473822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 32/68] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:28.475089 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173dd5a-ba08-4bed-9972-03354d9f91be None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:28.547850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:28.561551 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764d331-3f70-41af-8d00-22a361e89819 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:28.587724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173dd5a-ba08-4bed-9972-03354d9f91be None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:28.608333 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177f0b1-b7d1-43df-bfd2-2ac834c9f2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:28.609152 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177f0b1-b7d1-43df-bfd2-2ac834c9f2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:28.609442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177f0b1-b7d1-43df-bfd2-2ac834c9f2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:28.609730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177f0b1-b7d1-43df-bfd2-2ac834c9f2d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:28.622168 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:28.625559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c177f0b1-b7d1-43df-bfd2-2ac834c9f2d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:28.628698 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a903dcf-eaa9-4b19-baaf-1678b60b63b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:28.629534 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a903dcf-eaa9-4b19-baaf-1678b60b63b1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:28.629817 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a903dcf-eaa9-4b19-baaf-1678b60b63b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:28.630092 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a903dcf-eaa9-4b19-baaf-1678b60b63b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c177f0b1-b7d1-43df-bfd2-2ac834c9f2d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:28.633423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:28.634270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:28.635065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:28.635065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:28.635065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:28.635065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:28.635065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:28.635065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:28.635065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:28.635065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:28.635065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:28.635065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:28.635065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:28.635065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:28.635065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 37/69] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:51:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:28.635703 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177f0b1-b7d1-43df-bfd2-2ac834c9f2d1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:28.642420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a903dcf-eaa9-4b19-baaf-1678b60b63b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4a903dcf-eaa9-4b19-baaf-1678b60b63b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:28.650828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:28.651697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:28.652451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:28.652451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:28.652451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:28.652451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:28.652451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:28.652451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:28.652451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:28.652451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:28.652451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:28.652451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:28.652451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:51:28.652451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:28.652451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 33/70] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:51:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:28.653691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b40c91-26af-46fe-9c36-b69867d06801 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:28.653691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b40c91-26af-46fe-9c36-b69867d06801 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:28.653917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b40c91-26af-46fe-9c36-b69867d06801 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:28.655588 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 34/71] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:28.656342 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b40c91-26af-46fe-9c36-b69867d06801 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:28.749439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177f0b1-b7d1-43df-bfd2-2ac834c9f2d1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:28.772908 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b40c91-26af-46fe-9c36-b69867d06801 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:28.784868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b21d7-71a0-48c8-a35a-b527af5e4b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:28.785845 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b21d7-71a0-48c8-a35a-b527af5e4b80 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:28.786304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b21d7-71a0-48c8-a35a-b527af5e4b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:28.786750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b21d7-71a0-48c8-a35a-b527af5e4b80 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:28.787736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b21d7-71a0-48c8-a35a-b527af5e4b80 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:28.788130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b21d7-71a0-48c8-a35a-b527af5e4b80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:28.789541 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b21d7-71a0-48c8-a35a-b527af5e4b80 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:28.806494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 38/72] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:28.806494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b21d7-71a0-48c8-a35a-b527af5e4b80 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:28.814326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262964f9-1bf0-49f6-8609-b92315895ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:28.815053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262964f9-1bf0-49f6-8609-b92315895ffb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:28.815733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262964f9-1bf0-49f6-8609-b92315895ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:28.816024 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262964f9-1bf0-49f6-8609-b92315895ffb None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:28.817092 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262964f9-1bf0-49f6-8609-b92315895ffb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:28.817416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262964f9-1bf0-49f6-8609-b92315895ffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:28.819018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262964f9-1bf0-49f6-8609-b92315895ffb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:28.823713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:28.829973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 35/73] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:28.831173 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef701b3-cc62-4e47-8cf6-a20abd483f97 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:28.831458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef701b3-cc62-4e47-8cf6-a20abd483f97 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:28.831741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef701b3-cc62-4e47-8cf6-a20abd483f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:28.848224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3ef701b3-cc62-4e47-8cf6-a20abd483f97 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:28.849537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3ef701b3-cc62-4e47-8cf6-a20abd483f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:28.902997 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:28.911203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b21d7-71a0-48c8-a35a-b527af5e4b80 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:28.922882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 36/74] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:28.922882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef701b3-cc62-4e47-8cf6-a20abd483f97 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:28.951998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0f5c3-c140-4d13-9351-bdcc991088d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:28.953009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0f5c3-c140-4d13-9351-bdcc991088d7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:28.953466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0f5c3-c140-4d13-9351-bdcc991088d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:28.953928 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a0f5c3-c140-4d13-9351-bdcc991088d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:28.954840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0f5c3-c140-4d13-9351-bdcc991088d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:28.955311 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0f5c3-c140-4d13-9351-bdcc991088d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:28.957043 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a0f5c3-c140-4d13-9351-bdcc991088d7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:28.965582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 39/75] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:51:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:28.966386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0f5c3-c140-4d13-9351-bdcc991088d7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:29.030656 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef701b3-cc62-4e47-8cf6-a20abd483f97 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:29.054326 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:29.064347 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865193e-6b84-4208-b97d-4c9309628504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:29.065291 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865193e-6b84-4208-b97d-4c9309628504 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:29.065586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865193e-6b84-4208-b97d-4c9309628504 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:29.065864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a865193e-6b84-4208-b97d-4c9309628504 None admin] PATH_INFO: `/v3/users/8925da3e911a4d87957cf78bccc842b7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:29.073370 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a0f5c3-c140-4d13-9351-bdcc991088d7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:29.079847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865193e-6b84-4208-b97d-4c9309628504 None admin] RBAC: Authorizing `identity:get_user(user_id=8925da3e911a4d87957cf78bccc842b7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:29.081398 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a865193e-6b84-4208-b97d-4c9309628504 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:29.083119 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 37/76] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:28 2022] GET /identity/v3/users/8925da3e911a4d87957cf78bccc842b7 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:29.088076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865193e-6b84-4208-b97d-4c9309628504 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:29.106239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd76cb90-6897-468b-a593-b4387694cec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:29.107172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76cb90-6897-468b-a593-b4387694cec8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:29.107461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76cb90-6897-468b-a593-b4387694cec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:29.107747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd76cb90-6897-468b-a593-b4387694cec8 None admin] PATH_INFO: `/v3/users/a71b1bb7d4ea44e095e9e4bdd64ff70b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:29.108965 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76cb90-6897-468b-a593-b4387694cec8 None admin] RBAC: Authorizing `identity:get_user(user_id=a71b1bb7d4ea44e095e9e4bdd64ff70b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:29.110435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd76cb90-6897-468b-a593-b4387694cec8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:29.112181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 40/77] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:28 2022] GET /identity/v3/users/a71b1bb7d4ea44e095e9e4bdd64ff70b => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:29.113384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2e518-f501-4f3e-8679-0f6b16db58d0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:29.113655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2e518-f501-4f3e-8679-0f6b16db58d0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:29.113937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc2e518-f501-4f3e-8679-0f6b16db58d0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:29.118862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 41/78] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:29.118862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2e518-f501-4f3e-8679-0f6b16db58d0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:29.137063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:29.195019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a865193e-6b84-4208-b97d-4c9309628504 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:29.218590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc2e518-f501-4f3e-8679-0f6b16db58d0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:29.228604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd35c06-9f6a-4a57-a94d-377e7677b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:29.229421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd35c06-9f6a-4a57-a94d-377e7677b010 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:29.229702 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd35c06-9f6a-4a57-a94d-377e7677b010 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:29.229979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd35c06-9f6a-4a57-a94d-377e7677b010 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:29.240472 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd35c06-9f6a-4a57-a94d-377e7677b010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-bfd35c06-9f6a-4a57-a94d-377e7677b010 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:29.248111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:29.249020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:29.249789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:29.249789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:29.249789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:29.249789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:29.249789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:29.249789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:29.249789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:29.249789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:29.249789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:29.249789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:29.249789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:29.249789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:29.249789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 38/79] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:29.250404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd35c06-9f6a-4a57-a94d-377e7677b010 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:29.253752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf3b1b-a39a-45f2-9631-2398a56ed956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:29.254647 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf3b1b-a39a-45f2-9631-2398a56ed956 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:29.254963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf3b1b-a39a-45f2-9631-2398a56ed956 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:29.255244 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf3b1b-a39a-45f2-9631-2398a56ed956 None admin] PATH_INFO: `/v3/users/8925da3e911a4d87957cf78bccc842b7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:29.256482 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf3b1b-a39a-45f2-9631-2398a56ed956 None admin] RBAC: Authorizing `identity:get_user(user_id=8925da3e911a4d87957cf78bccc842b7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:29.257954 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf3b1b-a39a-45f2-9631-2398a56ed956 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:29.259759 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 42/80] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:29 2022] GET /identity/v3/users/8925da3e911a4d87957cf78bccc842b7 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:29.260364 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf3b1b-a39a-45f2-9631-2398a56ed956 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:29.281809 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:29.351337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd35c06-9f6a-4a57-a94d-377e7677b010 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:29.352890 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:29.363508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf3b1b-a39a-45f2-9631-2398a56ed956 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:29.387495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca7e7b-e4bd-4854-8d2c-31ad30a3ac18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:29.388160 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca7e7b-e4bd-4854-8d2c-31ad30a3ac18 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:29.388440 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca7e7b-e4bd-4854-8d2c-31ad30a3ac18 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:29.388712 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca7e7b-e4bd-4854-8d2c-31ad30a3ac18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:29.397563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effad702-4206-49b0-b766-de37a7560e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:29.398229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effad702-4206-49b0-b766-de37a7560e5b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:29.398514 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effad702-4206-49b0-b766-de37a7560e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:29.398794 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effad702-4206-49b0-b766-de37a7560e5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:29.454444 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca7e7b-e4bd-4854-8d2c-31ad30a3ac18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:29.455947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca7e7b-e4bd-4854-8d2c-31ad30a3ac18 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:29.466843 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effad702-4206-49b0-b766-de37a7560e5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:29.468340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effad702-4206-49b0-b766-de37a7560e5b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:29.486316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:29.555202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 39/81] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:51:29.556510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77209fa-5ca4-4272-8211-2d8fe8cd2df5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:29.556798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77209fa-5ca4-4272-8211-2d8fe8cd2df5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:29.557071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77209fa-5ca4-4272-8211-2d8fe8cd2df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:29.563035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:29.568848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 43/82] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:51:29.569633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effad702-4206-49b0-b766-de37a7560e5b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:29.579919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e77209fa-5ca4-4272-8211-2d8fe8cd2df5 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:29.581181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e77209fa-5ca4-4272-8211-2d8fe8cd2df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:29.646421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 40/83] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:29.663007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77209fa-5ca4-4272-8211-2d8fe8cd2df5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:29.668777 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effad702-4206-49b0-b766-de37a7560e5b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:29.686772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:29.705430 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c0f06-6429-46fb-8a1f-724c9765e671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:29.706083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c0f06-6429-46fb-8a1f-724c9765e671 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:29.706369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c0f06-6429-46fb-8a1f-724c9765e671 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:29.706649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c0f06-6429-46fb-8a1f-724c9765e671 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:29.707494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c0f06-6429-46fb-8a1f-724c9765e671 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:29.707810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c0f06-6429-46fb-8a1f-724c9765e671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:29.709235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79c0f06-6429-46fb-8a1f-724c9765e671 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:29.717556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 44/84] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:29.723061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c0f06-6429-46fb-8a1f-724c9765e671 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:29.748784 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77209fa-5ca4-4272-8211-2d8fe8cd2df5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:29.777592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:29.782981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c748e9f-5a1d-4e9e-8d13-5eec8ec6ad64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:29.783651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c748e9f-5a1d-4e9e-8d13-5eec8ec6ad64 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:29.783956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c748e9f-5a1d-4e9e-8d13-5eec8ec6ad64 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:29.784283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c748e9f-5a1d-4e9e-8d13-5eec8ec6ad64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:29.827531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79c0f06-6429-46fb-8a1f-724c9765e671 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:29.854321 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c748e9f-5a1d-4e9e-8d13-5eec8ec6ad64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:29.855872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c748e9f-5a1d-4e9e-8d13-5eec8ec6ad64 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:29.861297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988e7f9-5d99-44a4-bf62-7d586f99796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:29.862227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988e7f9-5d99-44a4-bf62-7d586f99796b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:29.862517 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988e7f9-5d99-44a4-bf62-7d586f99796b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:29.862799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988e7f9-5d99-44a4-bf62-7d586f99796b None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:29.864053 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988e7f9-5d99-44a4-bf62-7d586f99796b None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:29.865887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988e7f9-5d99-44a4-bf62-7d586f99796b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:29.867716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 45/85] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:29 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:29.868501 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988e7f9-5d99-44a4-bf62-7d586f99796b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:29.918519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:29.957804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 41/86] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:51:29.958585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c748e9f-5a1d-4e9e-8d13-5eec8ec6ad64 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:29.978836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988e7f9-5d99-44a4-bf62-7d586f99796b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:29.988336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:30.013122 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283300e-2716-4713-87a4-163efba043e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:30.014007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283300e-2716-4713-87a4-163efba043e5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:30.014287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283300e-2716-4713-87a4-163efba043e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:30.014570 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283300e-2716-4713-87a4-163efba043e5 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:30.015852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283300e-2716-4713-87a4-163efba043e5 None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:30.017336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283300e-2716-4713-87a4-163efba043e5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:30.019160 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 46/87] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:29 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:30.019933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283300e-2716-4713-87a4-163efba043e5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:30.057052 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c748e9f-5a1d-4e9e-8d13-5eec8ec6ad64 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:30.091101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c579c-67b9-46b3-9544-3b85cc4919e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:30.091914 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c579c-67b9-46b3-9544-3b85cc4919e7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:30.092198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c579c-67b9-46b3-9544-3b85cc4919e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:30.092475 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c579c-67b9-46b3-9544-3b85cc4919e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:30.093653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c579c-67b9-46b3-9544-3b85cc4919e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:30.095181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c579c-67b9-46b3-9544-3b85cc4919e7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:30.096886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 42/88] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:30.101691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c579c-67b9-46b3-9544-3b85cc4919e7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:30.123455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283300e-2716-4713-87a4-163efba043e5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:30.137810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:30.158432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd65e2-753f-4e7b-b5c0-9f5f8f141adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:30.159410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd65e2-753f-4e7b-b5c0-9f5f8f141adf None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:30.159701 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd65e2-753f-4e7b-b5c0-9f5f8f141adf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:30.159963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd65e2-753f-4e7b-b5c0-9f5f8f141adf None admin] PATH_INFO: `/v3/users/8925da3e911a4d87957cf78bccc842b7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:30.161745 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd65e2-753f-4e7b-b5c0-9f5f8f141adf None admin] RBAC: Authorizing `identity:get_user(user_id=8925da3e911a4d87957cf78bccc842b7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:30.163261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd65e2-753f-4e7b-b5c0-9f5f8f141adf None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:30.164917 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 47/89] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:30 2022] GET /identity/v3/users/8925da3e911a4d87957cf78bccc842b7 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:30.165679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd65e2-753f-4e7b-b5c0-9f5f8f141adf None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:30.200251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:30.203941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c579c-67b9-46b3-9544-3b85cc4919e7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:30.238583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383840c-a448-4030-a899-09bce110ea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:30.239193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383840c-a448-4030-a899-09bce110ea8a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:30.239477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383840c-a448-4030-a899-09bce110ea8a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:30.239758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383840c-a448-4030-a899-09bce110ea8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:30.240951 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383840c-a448-4030-a899-09bce110ea8a None admin] RBAC: Adding query filter params (role.id=64e044de7dcc4949acf8ce7eaf08fdaa, scope.project.id=10efcfb517724a609d32a0457044f00c, user.id=8925da3e911a4d87957cf78bccc842b7) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:30.241265 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383840c-a448-4030-a899-09bce110ea8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:30.242714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0383840c-a448-4030-a899-09bce110ea8a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:30.248126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 43/90] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:30 2022] GET /identity/v3/role_assignments?user.id=8925da3e911a4d87957cf78bccc842b7&scope.project.id=10efcfb517724a609d32a0457044f00c&role.id=64e044de7dcc4949acf8ce7eaf08fdaa => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:30.248911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383840c-a448-4030-a899-09bce110ea8a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:30.266847 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd65e2-753f-4e7b-b5c0-9f5f8f141adf None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:30.306896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab5472-114c-486e-a3e6-c63106e8f304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:30.308319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab5472-114c-486e-a3e6-c63106e8f304 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:30.308604 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab5472-114c-486e-a3e6-c63106e8f304 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:30.308886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab5472-114c-486e-a3e6-c63106e8f304 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:30.310383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab5472-114c-486e-a3e6-c63106e8f304 None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:30.312341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab5472-114c-486e-a3e6-c63106e8f304 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:30.319529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 48/91] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:30 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:30.319529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab5472-114c-486e-a3e6-c63106e8f304 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:30.372443 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0383840c-a448-4030-a899-09bce110ea8a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:30.377554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:30.409853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb0c78-a916-45f4-8122-708413e4a646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:30.410534 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb0c78-a916-45f4-8122-708413e4a646 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:30.410822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb0c78-a916-45f4-8122-708413e4a646 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:30.411110 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb0c78-a916-45f4-8122-708413e4a646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:30.411969 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb0c78-a916-45f4-8122-708413e4a646 None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=10efcfb517724a609d32a0457044f00c, user.id=a71b1bb7d4ea44e095e9e4bdd64ff70b) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:30.412297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb0c78-a916-45f4-8122-708413e4a646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:30.413778 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fb0c78-a916-45f4-8122-708413e4a646 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:30.419714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 44/92] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:30 2022] GET /identity/v3/role_assignments?user.id=a71b1bb7d4ea44e095e9e4bdd64ff70b&scope.project.id=10efcfb517724a609d32a0457044f00c&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:30.420545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb0c78-a916-45f4-8122-708413e4a646 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:30.448880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab5472-114c-486e-a3e6-c63106e8f304 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:30.467593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:30.492041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d79cd-d541-4696-8187-09bbe0ce6684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:30.493022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d79cd-d541-4696-8187-09bbe0ce6684 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:30.493476 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d79cd-d541-4696-8187-09bbe0ce6684 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:30.493924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d79cd-d541-4696-8187-09bbe0ce6684 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:30.494890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d79cd-d541-4696-8187-09bbe0ce6684 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:30.496559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d79cd-d541-4696-8187-09bbe0ce6684 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:30.532619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 49/93] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:51:30 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:51:30.534214 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d79cd-d541-4696-8187-09bbe0ce6684 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:30.556534 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb0c78-a916-45f4-8122-708413e4a646 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:30.610433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec062caf-99c2-492f-b686-70359b572d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:30.611504 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec062caf-99c2-492f-b686-70359b572d0c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:30.612679 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec062caf-99c2-492f-b686-70359b572d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:30.613143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec062caf-99c2-492f-b686-70359b572d0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:30.704341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec062caf-99c2-492f-b686-70359b572d0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:30.706417 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec062caf-99c2-492f-b686-70359b572d0c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:30.716455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d79cd-d541-4696-8187-09bbe0ce6684 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:30.730341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:30.767016 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:30.768285 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b68aa-0060-49f4-a1aa-c5da6d438699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:30.769178 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b68aa-0060-49f4-a1aa-c5da6d438699 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:30.770951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b68aa-0060-49f4-a1aa-c5da6d438699 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:30.771653 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b68aa-0060-49f4-a1aa-c5da6d438699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:30.772706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b68aa-0060-49f4-a1aa-c5da6d438699 None admin] RBAC: Adding query filter params (role.id=e9dc595c6b4248d3b5262b70a90e76c5, scope.project.id=10efcfb517724a609d32a0457044f00c, user.id=8925da3e911a4d87957cf78bccc842b7) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:30.772706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b68aa-0060-49f4-a1aa-c5da6d438699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:30.775850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b68aa-0060-49f4-a1aa-c5da6d438699 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:30.784799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 50/94] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:30 2022] GET /identity/v3/role_assignments?user.id=8925da3e911a4d87957cf78bccc842b7&scope.project.id=10efcfb517724a609d32a0457044f00c&role.id=e9dc595c6b4248d3b5262b70a90e76c5 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:30.835695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 45/95] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:51:30.841747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b68aa-0060-49f4-a1aa-c5da6d438699 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:30.976094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b68aa-0060-49f4-a1aa-c5da6d438699 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:31.011995 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2749c-f511-4e87-96c4-136533df220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:31.013299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2749c-f511-4e87-96c4-136533df220e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:31.013805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2749c-f511-4e87-96c4-136533df220e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:31.014294 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2749c-f511-4e87-96c4-136533df220e None admin] PATH_INFO: `/v3/projects/68dd471255b84f98ae2997d2b48e238e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:31.015833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2749c-f511-4e87-96c4-136533df220e None admin] RBAC: Authorizing `identity:get_project(project_id=68dd471255b84f98ae2997d2b48e238e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:31.017588 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2749c-f511-4e87-96c4-136533df220e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:31.019638 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 51/96] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:30 2022] GET /identity/v3/projects/68dd471255b84f98ae2997d2b48e238e => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:31.026867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec062caf-99c2-492f-b686-70359b572d0c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:31.164482 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec062caf-99c2-492f-b686-70359b572d0c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:31.207172 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:31.217354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e45d3-3131-4e43-8cd9-ed6f0ee6dc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:31.218375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e45d3-3131-4e43-8cd9-ed6f0ee6dc23 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:31.218893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e45d3-3131-4e43-8cd9-ed6f0ee6dc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:31.219407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e45d3-3131-4e43-8cd9-ed6f0ee6dc23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:31.220513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e45d3-3131-4e43-8cd9-ed6f0ee6dc23 None admin] RBAC: Adding query filter params (role.id=64e044de7dcc4949acf8ce7eaf08fdaa, scope.project.id=68dd471255b84f98ae2997d2b48e238e, user.id=8925da3e911a4d87957cf78bccc842b7) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:31.221029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e45d3-3131-4e43-8cd9-ed6f0ee6dc23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:31.222924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e45d3-3131-4e43-8cd9-ed6f0ee6dc23 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:31.231717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 46/97] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:31 2022] GET /identity/v3/role_assignments?user.id=8925da3e911a4d87957cf78bccc842b7&scope.project.id=68dd471255b84f98ae2997d2b48e238e&role.id=64e044de7dcc4949acf8ce7eaf08fdaa => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:32.917832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8878e2-731f-431c-816a-0a8999b84c4e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:32.918883 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8878e2-731f-431c-816a-0a8999b84c4e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:32.919473 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8878e2-731f-431c-816a-0a8999b84c4e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:32.921113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 52/98] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:32.926768 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91200a8-5bc6-4137-8491-9df5ddfc5ba3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:32.927247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91200a8-5bc6-4137-8491-9df5ddfc5ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:32.927422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91200a8-5bc6-4137-8491-9df5ddfc5ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:32.951887 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a91200a8-5bc6-4137-8491-9df5ddfc5ba3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:32.953116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a91200a8-5bc6-4137-8491-9df5ddfc5ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:32.995942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f653c4-a59a-4970-b7da-9f754e570974 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:32.996595 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f653c4-a59a-4970-b7da-9f754e570974 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:32.997075 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f653c4-a59a-4970-b7da-9f754e570974 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:32.998858 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 53/99] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:33.009062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6b47e-0626-4fcd-820e-71a9d556f0be None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:33.009693 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6b47e-0626-4fcd-820e-71a9d556f0be None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:33.010200 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6b47e-0626-4fcd-820e-71a9d556f0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:33.043956 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5dd6b47e-0626-4fcd-820e-71a9d556f0be None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:33.045312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5dd6b47e-0626-4fcd-820e-71a9d556f0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:33.079550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 47/100] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:33.103919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:33.117786 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91200a8-5bc6-4137-8491-9df5ddfc5ba3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:33.170477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 54/101] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:33.222012 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6b47e-0626-4fcd-820e-71a9d556f0be None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:33.303848 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91200a8-5bc6-4137-8491-9df5ddfc5ba3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:33.352087 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:33.379665 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c31f3-b366-4f23-ba39-072d70e51db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:33.380792 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c31f3-b366-4f23-ba39-072d70e51db2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:33.381231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c31f3-b366-4f23-ba39-072d70e51db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:33.381771 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c31f3-b366-4f23-ba39-072d70e51db2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:33.401229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6b47e-0626-4fcd-820e-71a9d556f0be None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:33.403981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c31f3-b366-4f23-ba39-072d70e51db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d95c31f3-b366-4f23-ba39-072d70e51db2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:33.412382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:33.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:33.414519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:33.414519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:33.414519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:33.414519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:33.414519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:33.414519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:33.414519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:33.414519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:33.414519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:33.414519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:33.414519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:33.414519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:33.414519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 48/102] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:51:33.421874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c31f3-b366-4f23-ba39-072d70e51db2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:33.449905 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cdbb2-6218-4004-90af-2beca09de39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:33.451054 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cdbb2-6218-4004-90af-2beca09de39e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:33.451481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cdbb2-6218-4004-90af-2beca09de39e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:33.452195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cdbb2-6218-4004-90af-2beca09de39e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:33.465355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cdbb2-6218-4004-90af-2beca09de39e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e19cdbb2-6218-4004-90af-2beca09de39e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:33.473966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:33.475034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:33.475989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:33.475989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:33.475989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:33.475989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:33.475989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:33.475989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:33.475989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:33.475989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:33.475989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:33.475989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:33.475989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:33.475989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:33.478434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 55/103] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:51:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:51:33.480273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33f229-e255-4e67-9d1c-91541005af69 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:33.482652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33f229-e255-4e67-9d1c-91541005af69 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:33.483239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d33f229-e255-4e67-9d1c-91541005af69 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:33.485571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 56/104] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:33.486927 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33f229-e255-4e67-9d1c-91541005af69 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:33.535198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:33.645376 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c31f3-b366-4f23-ba39-072d70e51db2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:33.677922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d33f229-e255-4e67-9d1c-91541005af69 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:33.683728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276273e5-f877-49f0-9b19-cb1b6e55dcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:33.684611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276273e5-f877-49f0-9b19-cb1b6e55dcbc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:33.685034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276273e5-f877-49f0-9b19-cb1b6e55dcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:33.685448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276273e5-f877-49f0-9b19-cb1b6e55dcbc None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:33.686352 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276273e5-f877-49f0-9b19-cb1b6e55dcbc None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:33.686868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276273e5-f877-49f0-9b19-cb1b6e55dcbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:33.688900 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276273e5-f877-49f0-9b19-cb1b6e55dcbc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:33.698806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 49/105] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:33.700605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912d823-1c42-4697-aa45-d54bc76340b2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:33.701068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912d823-1c42-4697-aa45-d54bc76340b2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:33.701542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912d823-1c42-4697-aa45-d54bc76340b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:33.719846 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4912d823-1c42-4697-aa45-d54bc76340b2 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:33.721551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4912d823-1c42-4697-aa45-d54bc76340b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:33.767707 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:33.772687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcefcb-206a-4bb1-b035-70cfa2fdf4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:33.773384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcefcb-206a-4bb1-b035-70cfa2fdf4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:33.773670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcefcb-206a-4bb1-b035-70cfa2fdf4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:33.773947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcefcb-206a-4bb1-b035-70cfa2fdf4c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:33.774716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcefcb-206a-4bb1-b035-70cfa2fdf4c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:33.775049 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcefcb-206a-4bb1-b035-70cfa2fdf4c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:33.776506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcefcb-206a-4bb1-b035-70cfa2fdf4c4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:33.798361 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 57/106] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:33.799066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcefcb-206a-4bb1-b035-70cfa2fdf4c4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:33.801964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 50/107] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:33.804426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912d823-1c42-4697-aa45-d54bc76340b2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:33.922607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:33.936111 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcefcb-206a-4bb1-b035-70cfa2fdf4c4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:33.941665 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912d823-1c42-4697-aa45-d54bc76340b2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:33.971983 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236557f8-9d18-4f99-8bbf-4ff57c640889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:33.972875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236557f8-9d18-4f99-8bbf-4ff57c640889 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:33.973162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236557f8-9d18-4f99-8bbf-4ff57c640889 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:33.973435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236557f8-9d18-4f99-8bbf-4ff57c640889 None admin] PATH_INFO: `/v3/users/8925da3e911a4d87957cf78bccc842b7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:33.974650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236557f8-9d18-4f99-8bbf-4ff57c640889 None admin] RBAC: Authorizing `identity:get_user(user_id=8925da3e911a4d87957cf78bccc842b7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:33.976158 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236557f8-9d18-4f99-8bbf-4ff57c640889 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:33.977859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 58/108] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:33 2022] GET /identity/v3/users/8925da3e911a4d87957cf78bccc842b7 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:33.978623 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236557f8-9d18-4f99-8bbf-4ff57c640889 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:33.989164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534511b-6ecf-44d2-996b-7bd255465561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:33.991164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534511b-6ecf-44d2-996b-7bd255465561 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:33.991604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534511b-6ecf-44d2-996b-7bd255465561 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:33.992413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534511b-6ecf-44d2-996b-7bd255465561 None admin] PATH_INFO: `/v3/users/a71b1bb7d4ea44e095e9e4bdd64ff70b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:33.994084 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534511b-6ecf-44d2-996b-7bd255465561 None admin] RBAC: Authorizing `identity:get_user(user_id=a71b1bb7d4ea44e095e9e4bdd64ff70b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:33.996751 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534511b-6ecf-44d2-996b-7bd255465561 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:33.999288 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 51/109] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:33 2022] GET /identity/v3/users/a71b1bb7d4ea44e095e9e4bdd64ff70b => generated 247 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:34.000815 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa8977-721b-4e8a-a410-1ee66131251a None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:34.001245 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa8977-721b-4e8a-a410-1ee66131251a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:34.002235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa8977-721b-4e8a-a410-1ee66131251a None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:34.005486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 52/110] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:34.006501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa8977-721b-4e8a-a410-1ee66131251a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:34.063942 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:34.091292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236557f8-9d18-4f99-8bbf-4ff57c640889 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:34.124052 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa8977-721b-4e8a-a410-1ee66131251a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:34.129465 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d80cb-fdde-499a-8d4a-9a8daaa34e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:34.130530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d80cb-fdde-499a-8d4a-9a8daaa34e80 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:34.131088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d80cb-fdde-499a-8d4a-9a8daaa34e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:34.131510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d80cb-fdde-499a-8d4a-9a8daaa34e80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:34.143429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d80cb-fdde-499a-8d4a-9a8daaa34e80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-0a9d80cb-fdde-499a-8d4a-9a8daaa34e80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:34.152649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:34.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:34.154677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:34.154677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:34.154677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:34.154677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:34.154677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:34.154677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:34.154677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:34.154677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:34.154677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:34.154677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:34.154677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:51:34.154677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:34.157288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 59/111] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:51:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:34.158287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d80cb-fdde-499a-8d4a-9a8daaa34e80 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:34.166158 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6415f0f-eca7-4047-8ef6-239bd989b7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:34.167119 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6415f0f-eca7-4047-8ef6-239bd989b7ed None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:34.167383 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6415f0f-eca7-4047-8ef6-239bd989b7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:34.167653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6415f0f-eca7-4047-8ef6-239bd989b7ed None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:34.168858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6415f0f-eca7-4047-8ef6-239bd989b7ed None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:34.170456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6415f0f-eca7-4047-8ef6-239bd989b7ed None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:34.172631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 53/112] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:34 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:34.174101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002de4-5f2c-4daf-9362-066aa358e067 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:34.174261 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002de4-5f2c-4daf-9362-066aa358e067 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:34.174533 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a002de4-5f2c-4daf-9362-066aa358e067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:34.182349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:34.197189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6a002de4-5f2c-4daf-9362-066aa358e067 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:34.198401 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6a002de4-5f2c-4daf-9362-066aa358e067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:34.271102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 54/113] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:34.274049 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d80cb-fdde-499a-8d4a-9a8daaa34e80 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:34.275940 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002de4-5f2c-4daf-9362-066aa358e067 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:34.313103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6108-529f-4f05-acfb-4a3df7aef762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:34.313999 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6108-529f-4f05-acfb-4a3df7aef762 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:34.314552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6108-529f-4f05-acfb-4a3df7aef762 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:34.314552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa6108-529f-4f05-acfb-4a3df7aef762 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:34.315882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa6108-529f-4f05-acfb-4a3df7aef762 None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:34.317388 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa6108-529f-4f05-acfb-4a3df7aef762 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:34.319367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 60/114] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:34 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:34.319944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6108-529f-4f05-acfb-4a3df7aef762 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:34.333421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:34.396864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a002de4-5f2c-4daf-9362-066aa358e067 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:34.410932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:34.426670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa6108-529f-4f05-acfb-4a3df7aef762 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:34.432404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc04e19-eab4-4073-b06d-ac94f13362ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:34.433092 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc04e19-eab4-4073-b06d-ac94f13362ce None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:34.433380 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc04e19-eab4-4073-b06d-ac94f13362ce None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:34.433668 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc04e19-eab4-4073-b06d-ac94f13362ce None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:34.434438 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc04e19-eab4-4073-b06d-ac94f13362ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:34.434750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc04e19-eab4-4073-b06d-ac94f13362ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:34.436203 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc04e19-eab4-4073-b06d-ac94f13362ce None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:34.444225 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 55/115] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:51:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:34.445487 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9537b6-700d-4578-b0f7-1f3a2ed1735a None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:34.445781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9537b6-700d-4578-b0f7-1f3a2ed1735a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:34.446064 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9537b6-700d-4578-b0f7-1f3a2ed1735a None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:34.451457 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 56/116] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:34.451457 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9537b6-700d-4578-b0f7-1f3a2ed1735a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:34.464027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353405da-6175-4e7b-b057-f728952940c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:34.464942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353405da-6175-4e7b-b057-f728952940c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:34.465223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353405da-6175-4e7b-b057-f728952940c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:34.465499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353405da-6175-4e7b-b057-f728952940c3 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c/users/8925da3e911a4d87957cf78bccc842b7/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:34.467496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353405da-6175-4e7b-b057-f728952940c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=10efcfb517724a609d32a0457044f00c, user_id=8925da3e911a4d87957cf78bccc842b7, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:34.468972 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353405da-6175-4e7b-b057-f728952940c3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:34.482475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 61/117] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:51:34 2022] PUT /identity/v3/projects/10efcfb517724a609d32a0457044f00c/users/8925da3e911a4d87957cf78bccc842b7/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:51:34.486996 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353405da-6175-4e7b-b057-f728952940c3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:34.576183 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9537b6-700d-4578-b0f7-1f3a2ed1735a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:34.578513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:34.595330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353405da-6175-4e7b-b057-f728952940c3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:34.618858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edac60-145c-4f41-bea8-82cc31f8a96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:34.619703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edac60-145c-4f41-bea8-82cc31f8a96e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:34.619994 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edac60-145c-4f41-bea8-82cc31f8a96e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:34.620296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edac60-145c-4f41-bea8-82cc31f8a96e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:34.621561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edac60-145c-4f41-bea8-82cc31f8a96e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:34.623113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73edac60-145c-4f41-bea8-82cc31f8a96e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:34.625018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 57/118] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:34.628350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84096e40-a3e6-432e-b08c-819fd79bfb00 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:34.628641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84096e40-a3e6-432e-b08c-819fd79bfb00 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:34.628919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84096e40-a3e6-432e-b08c-819fd79bfb00 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:34.635973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 58/119] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:34.635973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84096e40-a3e6-432e-b08c-819fd79bfb00 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:34.641392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2003c-93fd-455a-8d9c-b636df42be58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:34.642326 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2003c-93fd-455a-8d9c-b636df42be58 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:34.642615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2003c-93fd-455a-8d9c-b636df42be58 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:34.642926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2003c-93fd-455a-8d9c-b636df42be58 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c/users/a71b1bb7d4ea44e095e9e4bdd64ff70b/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:34.645164 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2003c-93fd-455a-8d9c-b636df42be58 None admin] RBAC: Authorizing `identity:create_grant(project_id=10efcfb517724a609d32a0457044f00c, user_id=a71b1bb7d4ea44e095e9e4bdd64ff70b, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:34.646785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f2003c-93fd-455a-8d9c-b636df42be58 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:34.664639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 62/120] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:51:34 2022] PUT /identity/v3/projects/10efcfb517724a609d32a0457044f00c/users/a71b1bb7d4ea44e095e9e4bdd64ff70b/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:51:34.666219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad04b51-9f76-4266-9315-b13ae09b8c05 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:34.666562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad04b51-9f76-4266-9315-b13ae09b8c05 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:34.666925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad04b51-9f76-4266-9315-b13ae09b8c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:34.680833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:34.687980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3ad04b51-9f76-4266-9315-b13ae09b8c05 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:34.689277 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3ad04b51-9f76-4266-9315-b13ae09b8c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:34.774754 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 63/121] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:34.775633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad04b51-9f76-4266-9315-b13ae09b8c05 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:34.782586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84096e40-a3e6-432e-b08c-819fd79bfb00 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:34.833542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c530f2-c54c-4664-b4ab-3119adf0e613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:34.834471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c530f2-c54c-4664-b4ab-3119adf0e613 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:34.834761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c530f2-c54c-4664-b4ab-3119adf0e613 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:34.835072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c530f2-c54c-4664-b4ab-3119adf0e613 None admin] PATH_INFO: `/v3/users/8925da3e911a4d87957cf78bccc842b7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:34.837117 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c530f2-c54c-4664-b4ab-3119adf0e613 None admin] RBAC: Authorizing `identity:get_user(user_id=8925da3e911a4d87957cf78bccc842b7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:34.838636 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c530f2-c54c-4664-b4ab-3119adf0e613 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:34.840519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 59/122] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:34 2022] GET /identity/v3/users/8925da3e911a4d87957cf78bccc842b7 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:34.841714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef680283-e427-45dd-be5f-246376578306 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:34.842012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef680283-e427-45dd-be5f-246376578306 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:34.842294 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef680283-e427-45dd-be5f-246376578306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:34.866167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ef680283-e427-45dd-be5f-246376578306 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:34.867532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ef680283-e427-45dd-be5f-246376578306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:34.905509 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:34.913750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad04b51-9f76-4266-9315-b13ae09b8c05 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:34.945875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 60/123] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:34.947482 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef680283-e427-45dd-be5f-246376578306 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:34.967234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a53252-d135-417c-83a5-95701ff8c245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:34.969813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a53252-d135-417c-83a5-95701ff8c245 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:34.970541 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a53252-d135-417c-83a5-95701ff8c245 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:34.971796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a53252-d135-417c-83a5-95701ff8c245 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:34.972955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a53252-d135-417c-83a5-95701ff8c245 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:34.974463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a53252-d135-417c-83a5-95701ff8c245 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:34.983731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:35.011434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 64/124] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 15:51:34 2022] POST /identity/v3/projects => generated 302 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:51:35.015028 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a53252-d135-417c-83a5-95701ff8c245 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:35.159056 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef680283-e427-45dd-be5f-246376578306 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:35.197172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a53252-d135-417c-83a5-95701ff8c245 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:35.242400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f7db4-68e0-4b4c-b615-9ab6bf9ffa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:35.243289 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f7db4-68e0-4b4c-b615-9ab6bf9ffa4f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:35.243573 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f7db4-68e0-4b4c-b615-9ab6bf9ffa4f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:35.243859 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f7db4-68e0-4b4c-b615-9ab6bf9ffa4f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:35.252256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e671ce-a6f0-481e-b808-98329e20a029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:35.253309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e671ce-a6f0-481e-b808-98329e20a029 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:35.253673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e671ce-a6f0-481e-b808-98329e20a029 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:35.254026 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e671ce-a6f0-481e-b808-98329e20a029 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:35.256740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f7db4-68e0-4b4c-b615-9ab6bf9ffa4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:35.258800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e671ce-a6f0-481e-b808-98329e20a029 None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:35.260335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e671ce-a6f0-481e-b808-98329e20a029 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:35.262473 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 65/125] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:35 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:35.263345 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e671ce-a6f0-481e-b808-98329e20a029 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-2c4f7db4-68e0-4b4c-b615-9ab6bf9ffa4f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:35.269373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:35.270274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:35.271074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:35.271074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:35.271074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:35.271074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:35.271074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:35.271074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:35.271074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:35.271074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:35.271074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:35.271074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:35.271074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:51:35.271074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:35.271074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 61/126] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:35.276814 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f7db4-68e0-4b4c-b615-9ab6bf9ffa4f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:35.309226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:35.339081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:35.387975 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e671ce-a6f0-481e-b808-98329e20a029 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:35.389966 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f7db4-68e0-4b4c-b615-9ab6bf9ffa4f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:35.423830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7764bff-a33b-43f1-ad63-998b30de5f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:35.424571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7764bff-a33b-43f1-ad63-998b30de5f99 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:35.424912 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7764bff-a33b-43f1-ad63-998b30de5f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:35.425195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7764bff-a33b-43f1-ad63-998b30de5f99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:35.425418 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a35e0c-7ee8-41ca-9765-bd4674c59641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:35.426283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a35e0c-7ee8-41ca-9765-bd4674c59641 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:35.426569 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a35e0c-7ee8-41ca-9765-bd4674c59641 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:35.426873 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a35e0c-7ee8-41ca-9765-bd4674c59641 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:35.427651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a35e0c-7ee8-41ca-9765-bd4674c59641 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:35.427962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a35e0c-7ee8-41ca-9765-bd4674c59641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:35.429400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a35e0c-7ee8-41ca-9765-bd4674c59641 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:35.439152 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7764bff-a33b-43f1-ad63-998b30de5f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:35.440043 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 62/127] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:35.440947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a35e0c-7ee8-41ca-9765-bd4674c59641 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c7764bff-a33b-43f1-ad63-998b30de5f99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:35.447474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:35.449225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:35.450241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:35.450241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:35.450241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:35.450241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:35.450241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:35.450241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:35.450241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:35.450241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:35.450241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:35.450241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:35.450241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:35.450241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:35.450241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 66/128] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:35.460560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7764bff-a33b-43f1-ad63-998b30de5f99 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:35.566539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:35.578907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a35e0c-7ee8-41ca-9765-bd4674c59641 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:35.598381 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7764bff-a33b-43f1-ad63-998b30de5f99 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:35.641333 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:35.650381 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b91c2c-0f2c-40e5-b42e-9ef78ca81be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:35.651341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b91c2c-0f2c-40e5-b42e-9ef78ca81be7 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:35.651628 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b91c2c-0f2c-40e5-b42e-9ef78ca81be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:35.651907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b91c2c-0f2c-40e5-b42e-9ef78ca81be7 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c/users/8925da3e911a4d87957cf78bccc842b7/roles/e9dc595c6b4248d3b5262b70a90e76c5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:35.655994 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b91c2c-0f2c-40e5-b42e-9ef78ca81be7 None admin] RBAC: Authorizing `identity:create_grant(project_id=10efcfb517724a609d32a0457044f00c, user_id=8925da3e911a4d87957cf78bccc842b7, role_id=e9dc595c6b4248d3b5262b70a90e76c5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:35.657505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b91c2c-0f2c-40e5-b42e-9ef78ca81be7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:35.669356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35578ab2-67bd-4cf2-a104-fa6f9c65d4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:35.670390 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578ab2-67bd-4cf2-a104-fa6f9c65d4ab None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:35.670918 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578ab2-67bd-4cf2-a104-fa6f9c65d4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:35.671261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578ab2-67bd-4cf2-a104-fa6f9c65d4ab None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:35.679473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 63/129] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:51:35 2022] PUT /identity/v3/projects/10efcfb517724a609d32a0457044f00c/users/8925da3e911a4d87957cf78bccc842b7/roles/e9dc595c6b4248d3b5262b70a90e76c5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:51:35.680652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35578ab2-67bd-4cf2-a104-fa6f9c65d4ab None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:35.680968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b91c2c-0f2c-40e5-b42e-9ef78ca81be7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:35.681502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35578ab2-67bd-4cf2-a104-fa6f9c65d4ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:35.684087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35578ab2-67bd-4cf2-a104-fa6f9c65d4ab None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:35.701643 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 67/130] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:35.708302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35578ab2-67bd-4cf2-a104-fa6f9c65d4ab None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:35.865769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35578ab2-67bd-4cf2-a104-fa6f9c65d4ab None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:35.903644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b91c2c-0f2c-40e5-b42e-9ef78ca81be7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:35.935765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda459d9-40c7-4623-8c08-0bb389c0806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:35.937060 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda459d9-40c7-4623-8c08-0bb389c0806a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:35.937581 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda459d9-40c7-4623-8c08-0bb389c0806a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:35.938056 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda459d9-40c7-4623-8c08-0bb389c0806a None admin] PATH_INFO: `/v3/users/8925da3e911a4d87957cf78bccc842b7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:35.943145 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda459d9-40c7-4623-8c08-0bb389c0806a None admin] RBAC: Authorizing `identity:get_user(user_id=8925da3e911a4d87957cf78bccc842b7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:35.945021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda459d9-40c7-4623-8c08-0bb389c0806a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:35.947080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 68/131] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:35 2022] GET /identity/v3/users/8925da3e911a4d87957cf78bccc842b7 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:35.954641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda459d9-40c7-4623-8c08-0bb389c0806a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:35.977508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e6c9-b659-4515-937f-e0adc0a4c9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:35.978433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e6c9-b659-4515-937f-e0adc0a4c9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:35.978714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e6c9-b659-4515-937f-e0adc0a4c9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:35.979025 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e6c9-b659-4515-937f-e0adc0a4c9d8 None admin] PATH_INFO: `/v3/users/390ec2987ab84c629492b45c072ee2f1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:36.002844 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0e6c9-b659-4515-937f-e0adc0a4c9d8 None admin] RBAC: Authorizing `identity:get_user(user_id=390ec2987ab84c629492b45c072ee2f1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:36.002844 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0e6c9-b659-4515-937f-e0adc0a4c9d8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:36.003257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 64/132] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:35 2022] GET /identity/v3/users/390ec2987ab84c629492b45c072ee2f1 => generated 289 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:36.010147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e6c9-b659-4515-937f-e0adc0a4c9d8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:36.034462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:36.063724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:36.108512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda459d9-40c7-4623-8c08-0bb389c0806a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:36.136909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e6c9-b659-4515-937f-e0adc0a4c9d8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:36.152545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28b2a4-c9a3-4f34-b741-a74ffbb21975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:36.153193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28b2a4-c9a3-4f34-b741-a74ffbb21975 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:36.153480 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28b2a4-c9a3-4f34-b741-a74ffbb21975 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:36.153760 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28b2a4-c9a3-4f34-b741-a74ffbb21975 None admin] PATH_INFO: `/v3/projects/68dd471255b84f98ae2997d2b48e238e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:36.154992 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28b2a4-c9a3-4f34-b741-a74ffbb21975 None admin] RBAC: Authorizing `identity:get_project(project_id=68dd471255b84f98ae2997d2b48e238e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:36.156614 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28b2a4-c9a3-4f34-b741-a74ffbb21975 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:36.158691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 69/133] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:35 2022] GET /identity/v3/projects/68dd471255b84f98ae2997d2b48e238e => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:36.163989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28b2a4-c9a3-4f34-b741-a74ffbb21975 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:36.182357 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b059175-c4c1-41e0-88e6-dce8f44719f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:36.183332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b059175-c4c1-41e0-88e6-dce8f44719f6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:36.183999 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b059175-c4c1-41e0-88e6-dce8f44719f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:36.184449 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b059175-c4c1-41e0-88e6-dce8f44719f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:36.278452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b059175-c4c1-41e0-88e6-dce8f44719f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:36.280739 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b059175-c4c1-41e0-88e6-dce8f44719f6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:36.293384 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:36.304585 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28b2a4-c9a3-4f34-b741-a74ffbb21975 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:36.336444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:36.375375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe8f03-6515-41d3-ba8c-e46675815831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:36.377574 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe8f03-6515-41d3-ba8c-e46675815831 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:36.378927 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe8f03-6515-41d3-ba8c-e46675815831 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:36.380714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe8f03-6515-41d3-ba8c-e46675815831 None admin] PATH_INFO: `/v3/projects/68dd471255b84f98ae2997d2b48e238e/users/8925da3e911a4d87957cf78bccc842b7/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:36.383977 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe8f03-6515-41d3-ba8c-e46675815831 None admin] RBAC: Authorizing `identity:create_grant(project_id=68dd471255b84f98ae2997d2b48e238e, user_id=8925da3e911a4d87957cf78bccc842b7, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:36.386514 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe8f03-6515-41d3-ba8c-e46675815831 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:36.420901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 70/134] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:51:36 2022] PUT /identity/v3/projects/68dd471255b84f98ae2997d2b48e238e/users/8925da3e911a4d87957cf78bccc842b7/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:51:36.460544 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 65/135] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 15:51:36.466923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe8f03-6515-41d3-ba8c-e46675815831 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:36.616131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe8f03-6515-41d3-ba8c-e46675815831 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:36.665714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2f1f4-18f9-456a-bd8c-6fd8a4a3c5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:36.666907 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2f1f4-18f9-456a-bd8c-6fd8a4a3c5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:36.667339 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2f1f4-18f9-456a-bd8c-6fd8a4a3c5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:36.667789 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2f1f4-18f9-456a-bd8c-6fd8a4a3c5b0 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:36.669249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2f1f4-18f9-456a-bd8c-6fd8a4a3c5b0 None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:36.671070 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2f1f4-18f9-456a-bd8c-6fd8a4a3c5b0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:36.673154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 71/136] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:36 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:36.679403 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b059175-c4c1-41e0-88e6-dce8f44719f6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:36.802123 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b059175-c4c1-41e0-88e6-dce8f44719f6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:36.813144 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:36.849935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885041d-d784-4e1e-a4b4-706047faa1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:36.850891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885041d-d784-4e1e-a4b4-706047faa1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:36.851312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885041d-d784-4e1e-a4b4-706047faa1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:36.851724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885041d-d784-4e1e-a4b4-706047faa1c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:36.852737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885041d-d784-4e1e-a4b4-706047faa1c0 None admin] RBAC: Adding query filter params (role.id=6256bf6008374f439ed55b6faad17124, scope.project.id=10efcfb517724a609d32a0457044f00c, user.id=390ec2987ab84c629492b45c072ee2f1) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:36.853193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885041d-d784-4e1e-a4b4-706047faa1c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:36.854895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885041d-d784-4e1e-a4b4-706047faa1c0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:36.861628 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 66/137] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:36 2022] GET /identity/v3/role_assignments?user.id=390ec2987ab84c629492b45c072ee2f1&scope.project.id=10efcfb517724a609d32a0457044f00c&role.id=6256bf6008374f439ed55b6faad17124 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:37.297747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc757e-4720-486f-aa59-9b1e4d81a229 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:37.298744 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc757e-4720-486f-aa59-9b1e4d81a229 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:37.299271 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdc757e-4720-486f-aa59-9b1e4d81a229 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:37.301201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 72/138] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:37.307189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74520f-6258-44b6-87dd-212a41a675ab None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:37.308058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74520f-6258-44b6-87dd-212a41a675ab None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:37.308536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74520f-6258-44b6-87dd-212a41a675ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:37.326542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4a74520f-6258-44b6-87dd-212a41a675ab None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:37.328103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4a74520f-6258-44b6-87dd-212a41a675ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:37.398142 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 67/139] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:37.402715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ce5b-8dad-444d-95d3-26abd9f5b0d2 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:37.403055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ce5b-8dad-444d-95d3-26abd9f5b0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:37.403344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382ce5b-8dad-444d-95d3-26abd9f5b0d2 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:37.406020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 73/140] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:37.410505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b392f9-c131-4f29-b93f-4a1ae8a40479 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:37.410796 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b392f9-c131-4f29-b93f-4a1ae8a40479 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:37.411101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b392f9-c131-4f29-b93f-4a1ae8a40479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:37.425761 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382ce5b-8dad-444d-95d3-26abd9f5b0d2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:37.428179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-10b392f9-c131-4f29-b93f-4a1ae8a40479 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:37.429590 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-10b392f9-c131-4f29-b93f-4a1ae8a40479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:37.475679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:37.506869 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 68/141] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:37.543418 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b392f9-c131-4f29-b93f-4a1ae8a40479 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:37.543838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382ce5b-8dad-444d-95d3-26abd9f5b0d2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:37.581866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28437fad-f57e-4728-9d01-2502756dc82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:37.582702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28437fad-f57e-4728-9d01-2502756dc82d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:37.583091 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28437fad-f57e-4728-9d01-2502756dc82d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:37.583383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28437fad-f57e-4728-9d01-2502756dc82d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:37.594903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28437fad-f57e-4728-9d01-2502756dc82d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:37.598182 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-28437fad-f57e-4728-9d01-2502756dc82d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:37.604562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:37.607467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:37.608234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:37.608234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:37.608234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:37.608234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:37.608234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:37.608234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:37.608234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:37.608234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:37.608234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:37.608234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:37.608234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:37.608234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:37.608234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 74/142] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:51:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:51:37.617486 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28437fad-f57e-4728-9d01-2502756dc82d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:37.736895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b392f9-c131-4f29-b93f-4a1ae8a40479 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:37.790860 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28437fad-f57e-4728-9d01-2502756dc82d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:37.801157 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:37.824501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fe919-4ab9-472f-8fa1-4b930a096639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:37.825491 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fe919-4ab9-472f-8fa1-4b930a096639 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:37.825877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fe919-4ab9-472f-8fa1-4b930a096639 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:37.826264 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480fe919-4ab9-472f-8fa1-4b930a096639 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:37.828458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46978-b708-4ca2-b505-a3e2ffd49b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:37.829345 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46978-b708-4ca2-b505-a3e2ffd49b5c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:37.829768 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46978-b708-4ca2-b505-a3e2ffd49b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:37.830231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46978-b708-4ca2-b505-a3e2ffd49b5c None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:37.831392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a46978-b708-4ca2-b505-a3e2ffd49b5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:37.831881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a46978-b708-4ca2-b505-a3e2ffd49b5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:37.833606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a46978-b708-4ca2-b505-a3e2ffd49b5c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:37.844170 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 75/143] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:37.851150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46978-b708-4ca2-b505-a3e2ffd49b5c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:37.852203 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480fe919-4ab9-472f-8fa1-4b930a096639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-480fe919-4ab9-472f-8fa1-4b930a096639 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:37.868720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:37.869748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:37.870545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:37.870545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:37.870545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:37.870545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:37.870545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:37.870545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:37.870545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:37.870545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:37.870545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:37.870545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:37.870545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:37.870545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:37.870545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 69/144] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:51:37.879838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fe919-4ab9-472f-8fa1-4b930a096639 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:38.045084 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46978-b708-4ca2-b505-a3e2ffd49b5c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:38.083607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:38.102072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480fe919-4ab9-472f-8fa1-4b930a096639 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:38.143627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e331ad9-e130-4748-8f11-dc826edb7c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:38.144549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e331ad9-e130-4748-8f11-dc826edb7c06 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:38.144838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e331ad9-e130-4748-8f11-dc826edb7c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:38.145118 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e331ad9-e130-4748-8f11-dc826edb7c06 None admin] PATH_INFO: `/v3/users/a71b1bb7d4ea44e095e9e4bdd64ff70b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:38.146427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e331ad9-e130-4748-8f11-dc826edb7c06 None admin] RBAC: Authorizing `identity:get_user(user_id=a71b1bb7d4ea44e095e9e4bdd64ff70b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:38.147955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e331ad9-e130-4748-8f11-dc826edb7c06 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:38.149932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 76/145] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:37 2022] GET /identity/v3/users/a71b1bb7d4ea44e095e9e4bdd64ff70b => generated 247 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:38.161560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e331ad9-e130-4748-8f11-dc826edb7c06 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:38.169088 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4db74c-0783-420d-90e7-5142cd9ecbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:38.169982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4db74c-0783-420d-90e7-5142cd9ecbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:38.170438 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4db74c-0783-420d-90e7-5142cd9ecbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:38.170878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4db74c-0783-420d-90e7-5142cd9ecbd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:38.171793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4db74c-0783-420d-90e7-5142cd9ecbd1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:38.172250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4db74c-0783-420d-90e7-5142cd9ecbd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:38.174280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4db74c-0783-420d-90e7-5142cd9ecbd1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:38.193451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 70/146] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:38.201055 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4db74c-0783-420d-90e7-5142cd9ecbd1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:38.231216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:38.397092 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e331ad9-e130-4748-8f11-dc826edb7c06 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:38.403221 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4db74c-0783-420d-90e7-5142cd9ecbd1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:38.440642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956e8bd-378f-4235-bd67-63289bb62e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:38.442131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956e8bd-378f-4235-bd67-63289bb62e13 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:38.442523 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956e8bd-378f-4235-bd67-63289bb62e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:38.442937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956e8bd-378f-4235-bd67-63289bb62e13 None admin] PATH_INFO: `/v3/users/8925da3e911a4d87957cf78bccc842b7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:38.444314 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956e8bd-378f-4235-bd67-63289bb62e13 None admin] RBAC: Authorizing `identity:get_user(user_id=8925da3e911a4d87957cf78bccc842b7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:38.446516 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956e8bd-378f-4235-bd67-63289bb62e13 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:38.448411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 71/147] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:38 2022] GET /identity/v3/users/8925da3e911a4d87957cf78bccc842b7 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:38.454362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956e8bd-378f-4235-bd67-63289bb62e13 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:38.487496 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:38.498579 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4127e6-cbf1-4cf5-94f4-69bf2b8e4030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:38.499314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4127e6-cbf1-4cf5-94f4-69bf2b8e4030 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:38.499602 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4127e6-cbf1-4cf5-94f4-69bf2b8e4030 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:38.499890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4127e6-cbf1-4cf5-94f4-69bf2b8e4030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:38.584372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956e8bd-378f-4235-bd67-63289bb62e13 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:38.648952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923d56f-3c21-4a68-8010-c14ef619342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:38.649533 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923d56f-3c21-4a68-8010-c14ef619342c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:38.649810 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923d56f-3c21-4a68-8010-c14ef619342c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:38.650080 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923d56f-3c21-4a68-8010-c14ef619342c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:38.683935 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4127e6-cbf1-4cf5-94f4-69bf2b8e4030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:38.685472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4127e6-cbf1-4cf5-94f4-69bf2b8e4030 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:38.725974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923d56f-3c21-4a68-8010-c14ef619342c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:38.728179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923d56f-3c21-4a68-8010-c14ef619342c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:38.764036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:38.780762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:38.889712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 77/148] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 15:51:38.889712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c289-75fe-43e0-96f9-d9393a4c98cb None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:38.889712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c289-75fe-43e0-96f9-d9393a4c98cb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:38.889712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5c289-75fe-43e0-96f9-d9393a4c98cb None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:38.889712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 78/149] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:38.889712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d2659-284f-4877-b4e9-994caaa0aab7 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:38.889712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d2659-284f-4877-b4e9-994caaa0aab7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:38.890331 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d2659-284f-4877-b4e9-994caaa0aab7 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:38.891186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 79/150] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:38.896848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44f16b-113f-4edb-9756-37370b6bb86e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:38.897131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44f16b-113f-4edb-9756-37370b6bb86e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:38.897487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44f16b-113f-4edb-9756-37370b6bb86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:38.915404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6d44f16b-113f-4edb-9756-37370b6bb86e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:38.916689 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6d44f16b-113f-4edb-9756-37370b6bb86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:38.920725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 72/151] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 15:51:38.922315 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5b866-3197-41cb-8b67-6ea34d70f679 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:38.922750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5b866-3197-41cb-8b67-6ea34d70f679 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:38.923203 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5b866-3197-41cb-8b67-6ea34d70f679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:38.943286 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-04b5b866-3197-41cb-8b67-6ea34d70f679 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:38.944822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-04b5b866-3197-41cb-8b67-6ea34d70f679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:38.992058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 80/152] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:38.992925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44f16b-113f-4edb-9756-37370b6bb86e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:39.044434 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 73/153] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:39.045549 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5b866-3197-41cb-8b67-6ea34d70f679 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:39.073979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:39.107228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:39.123897 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44f16b-113f-4edb-9756-37370b6bb86e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:39.158948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb96475-c780-4714-9231-dfa90ef4229c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:39.159870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb96475-c780-4714-9231-dfa90ef4229c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:39.159982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5b866-3197-41cb-8b67-6ea34d70f679 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:39.160151 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb96475-c780-4714-9231-dfa90ef4229c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:39.160417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb96475-c780-4714-9231-dfa90ef4229c None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:39.161625 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb96475-c780-4714-9231-dfa90ef4229c None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:39.163151 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb96475-c780-4714-9231-dfa90ef4229c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:39.164911 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 81/154] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:38 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:39.165746 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb96475-c780-4714-9231-dfa90ef4229c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:39.197306 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3434993-e2a8-4f3c-8cdc-e4d03319187d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:39.198202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3434993-e2a8-4f3c-8cdc-e4d03319187d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:39.198485 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3434993-e2a8-4f3c-8cdc-e4d03319187d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:39.198758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3434993-e2a8-4f3c-8cdc-e4d03319187d None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:39.200459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3434993-e2a8-4f3c-8cdc-e4d03319187d None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:39.201813 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3434993-e2a8-4f3c-8cdc-e4d03319187d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:39.204011 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 74/155] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:39 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:39.204804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3434993-e2a8-4f3c-8cdc-e4d03319187d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:39.269363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb96475-c780-4714-9231-dfa90ef4229c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:39.300146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:39.306242 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52498303-c4b5-47b9-91d0-400f8286fecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:39.307315 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498303-c4b5-47b9-91d0-400f8286fecd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:39.307704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498303-c4b5-47b9-91d0-400f8286fecd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:39.308131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498303-c4b5-47b9-91d0-400f8286fecd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:39.309605 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52498303-c4b5-47b9-91d0-400f8286fecd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:39.311224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52498303-c4b5-47b9-91d0-400f8286fecd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:39.312974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 82/156] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:39.313827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52498303-c4b5-47b9-91d0-400f8286fecd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:39.329271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3434993-e2a8-4f3c-8cdc-e4d03319187d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:39.355754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:39.374186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d803fcb-b20b-46c9-97df-562bf80ce343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:39.375417 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d803fcb-b20b-46c9-97df-562bf80ce343 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:39.375701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d803fcb-b20b-46c9-97df-562bf80ce343 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:39.376246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d803fcb-b20b-46c9-97df-562bf80ce343 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:39.389202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d803fcb-b20b-46c9-97df-562bf80ce343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3d803fcb-b20b-46c9-97df-562bf80ce343 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:39.399720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:39.400895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:39.401776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:39.401776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:39.401776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:39.401776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:39.401776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:39.401776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:39.401776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:39.401776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:39.401776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:39.401776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:39.401776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:51:39.401776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:39.403226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 75/157] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:51:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:39.408080 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d803fcb-b20b-46c9-97df-562bf80ce343 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:39.439544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52498303-c4b5-47b9-91d0-400f8286fecd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:39.489245 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788444d6-f08d-4f93-99a4-2451e1ed7c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:39.490694 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788444d6-f08d-4f93-99a4-2451e1ed7c7d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:39.491366 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788444d6-f08d-4f93-99a4-2451e1ed7c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:39.491546 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788444d6-f08d-4f93-99a4-2451e1ed7c7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:39.492443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788444d6-f08d-4f93-99a4-2451e1ed7c7d None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=10efcfb517724a609d32a0457044f00c, user.id=a71b1bb7d4ea44e095e9e4bdd64ff70b) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:39.492761 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788444d6-f08d-4f93-99a4-2451e1ed7c7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:39.495490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788444d6-f08d-4f93-99a4-2451e1ed7c7d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:39.503947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 83/158] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:39 2022] GET /identity/v3/role_assignments?user.id=a71b1bb7d4ea44e095e9e4bdd64ff70b&scope.project.id=10efcfb517724a609d32a0457044f00c&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:39.504799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788444d6-f08d-4f93-99a4-2451e1ed7c7d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:39.545208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d803fcb-b20b-46c9-97df-562bf80ce343 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:39.595955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6263c2b-8ad9-4dd2-a8fb-f0a572c8a29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:39.596971 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6263c2b-8ad9-4dd2-a8fb-f0a572c8a29a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:39.597321 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6263c2b-8ad9-4dd2-a8fb-f0a572c8a29a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:39.597544 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6263c2b-8ad9-4dd2-a8fb-f0a572c8a29a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:39.598686 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6263c2b-8ad9-4dd2-a8fb-f0a572c8a29a None admin] RBAC: Adding query filter params (role.id=64e044de7dcc4949acf8ce7eaf08fdaa, scope.project.id=10efcfb517724a609d32a0457044f00c, user.id=8925da3e911a4d87957cf78bccc842b7) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:39.599508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6263c2b-8ad9-4dd2-a8fb-f0a572c8a29a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:39.601211 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6263c2b-8ad9-4dd2-a8fb-f0a572c8a29a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:39.602019 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:39.608041 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 76/159] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:39 2022] GET /identity/v3/role_assignments?user.id=8925da3e911a4d87957cf78bccc842b7&scope.project.id=10efcfb517724a609d32a0457044f00c&role.id=64e044de7dcc4949acf8ce7eaf08fdaa => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:39.608921 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6263c2b-8ad9-4dd2-a8fb-f0a572c8a29a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:39.659262 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788444d6-f08d-4f93-99a4-2451e1ed7c7d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:39.679440 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:39.709010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8761a1-dd58-4e06-a401-d1f5a7237cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:39.709914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8761a1-dd58-4e06-a401-d1f5a7237cf2 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:39.710111 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8761a1-dd58-4e06-a401-d1f5a7237cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:39.710460 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8761a1-dd58-4e06-a401-d1f5a7237cf2 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:39.711521 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8761a1-dd58-4e06-a401-d1f5a7237cf2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:39.713338 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8761a1-dd58-4e06-a401-d1f5a7237cf2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:39.740630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 84/160] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:51:39 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:51:39.741810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54dfd-834d-4a94-b2a7-f9dea57f3ab6 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:39.742104 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54dfd-834d-4a94-b2a7-f9dea57f3ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:39.742384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b54dfd-834d-4a94-b2a7-f9dea57f3ab6 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:39.744835 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 85/161] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:39.746141 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2000d-e874-4f91-986d-a9692861332c None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:39.746430 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2000d-e874-4f91-986d-a9692861332c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:39.746706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2000d-e874-4f91-986d-a9692861332c None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:39.752612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 86/162] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:39.755207 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981851f1-4886-452d-aee4-b2447ee62aeb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:39.755678 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981851f1-4886-452d-aee4-b2447ee62aeb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:39.756029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981851f1-4886-452d-aee4-b2447ee62aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:39.758234 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6263c2b-8ad9-4dd2-a8fb-f0a572c8a29a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:39.779181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-981851f1-4886-452d-aee4-b2447ee62aeb None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:39.781124 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-981851f1-4886-452d-aee4-b2447ee62aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:39.819192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275541f-fb2b-462b-9341-2fe2c6353dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:39.820409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275541f-fb2b-462b-9341-2fe2c6353dcd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:39.820891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275541f-fb2b-462b-9341-2fe2c6353dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:39.821425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275541f-fb2b-462b-9341-2fe2c6353dcd None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:39.822536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275541f-fb2b-462b-9341-2fe2c6353dcd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:39.823103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275541f-fb2b-462b-9341-2fe2c6353dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:39.825202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275541f-fb2b-462b-9341-2fe2c6353dcd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:39.840923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 77/163] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:51:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:39.842307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657034bb-3b68-40ef-b9b7-fe96c02fa268 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:39.842597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657034bb-3b68-40ef-b9b7-fe96c02fa268 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:39.843540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657034bb-3b68-40ef-b9b7-fe96c02fa268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:39.865419 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-657034bb-3b68-40ef-b9b7-fe96c02fa268 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:39.867050 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-657034bb-3b68-40ef-b9b7-fe96c02fa268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:39.894283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 87/164] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:39.896257 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981851f1-4886-452d-aee4-b2447ee62aeb None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:39.955546 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:39.970730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 78/165] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:39.971974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657034bb-3b68-40ef-b9b7-fe96c02fa268 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:40.013791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:40.017411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981851f1-4886-452d-aee4-b2447ee62aeb None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:40.062396 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3c351-c7e1-4d5c-b455-962227de5f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:40.063487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3c351-c7e1-4d5c-b455-962227de5f5a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:40.063842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3c351-c7e1-4d5c-b455-962227de5f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:40.064186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c3c351-c7e1-4d5c-b455-962227de5f5a None admin] PATH_INFO: `/v3/users/8925da3e911a4d87957cf78bccc842b7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:40.065563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3c351-c7e1-4d5c-b455-962227de5f5a None admin] RBAC: Authorizing `identity:get_user(user_id=8925da3e911a4d87957cf78bccc842b7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:40.067158 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c3c351-c7e1-4d5c-b455-962227de5f5a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:40.068977 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 88/166] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:39 2022] GET /identity/v3/users/8925da3e911a4d87957cf78bccc842b7 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:40.069885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3c351-c7e1-4d5c-b455-962227de5f5a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:40.089247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657034bb-3b68-40ef-b9b7-fe96c02fa268 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:40.134871 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0a633-29e1-4787-83b0-e6902dfb73de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:40.135795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0a633-29e1-4787-83b0-e6902dfb73de None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:40.136147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0a633-29e1-4787-83b0-e6902dfb73de None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:40.136505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea0a633-29e1-4787-83b0-e6902dfb73de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:40.149002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea0a633-29e1-4787-83b0-e6902dfb73de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-1ea0a633-29e1-4787-83b0-e6902dfb73de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:40.158510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:40.159759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:40.160979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:40.160979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:40.160979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:40.160979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:40.160979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:40.160979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:40.160979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:40.160979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:40.160979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:40.160979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:40.160979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:40.160979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:40.162465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 79/167] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:40.163099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0a633-29e1-4787-83b0-e6902dfb73de None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:40.196930 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c3c351-c7e1-4d5c-b455-962227de5f5a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:40.220058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:40.240462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9fdb0-0955-4f4d-a25a-d1af54d06c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:40.241230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9fdb0-0955-4f4d-a25a-d1af54d06c13 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:40.241666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9fdb0-0955-4f4d-a25a-d1af54d06c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:40.241954 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9fdb0-0955-4f4d-a25a-d1af54d06c13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:40.265099 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9fdb0-0955-4f4d-a25a-d1af54d06c13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e4e9fdb0-0955-4f4d-a25a-d1af54d06c13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:40.273753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:40.274923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:40.275903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:40.275903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:40.275903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:40.275903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:40.275903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:40.275903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:40.275903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:40.275903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:40.275903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:40.275903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:40.275903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:51:40.275903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:40.278571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 89/168] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:40.278571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9fdb0-0955-4f4d-a25a-d1af54d06c13 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:40.305108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:40.314204 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea0a633-29e1-4787-83b0-e6902dfb73de None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:40.354550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f22fb-4e98-4a71-8654-0b924acb7e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:40.356500 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f22fb-4e98-4a71-8654-0b924acb7e0d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:40.356904 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f22fb-4e98-4a71-8654-0b924acb7e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:40.357190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340f22fb-4e98-4a71-8654-0b924acb7e0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:40.412896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9fdb0-0955-4f4d-a25a-d1af54d06c13 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:40.452797 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f22fb-4e98-4a71-8654-0b924acb7e0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:40.453626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340f22fb-4e98-4a71-8654-0b924acb7e0d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:40.462044 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7bf3c-dc47-4798-bbf0-5ff2d122ee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:40.463330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7bf3c-dc47-4798-bbf0-5ff2d122ee60 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:40.463762 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7bf3c-dc47-4798-bbf0-5ff2d122ee60 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:40.464702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7bf3c-dc47-4798-bbf0-5ff2d122ee60 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:40.465650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7bf3c-dc47-4798-bbf0-5ff2d122ee60 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:40.466110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7bf3c-dc47-4798-bbf0-5ff2d122ee60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:40.468379 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7bf3c-dc47-4798-bbf0-5ff2d122ee60 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:40.480128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 90/169] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:40.481534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7bf3c-dc47-4798-bbf0-5ff2d122ee60 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:40.531509 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:40.563507 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:40.579449 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 80/170] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:51:40.580099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f22fb-4e98-4a71-8654-0b924acb7e0d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:40.617631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7bf3c-dc47-4798-bbf0-5ff2d122ee60 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:40.664682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3dcb2-46ca-4087-afcb-d53327c40165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:40.665663 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3dcb2-46ca-4087-afcb-d53327c40165 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:40.666093 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3dcb2-46ca-4087-afcb-d53327c40165 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:40.666522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3dcb2-46ca-4087-afcb-d53327c40165 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:40.668036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3dcb2-46ca-4087-afcb-d53327c40165 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:40.668513 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3dcb2-46ca-4087-afcb-d53327c40165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:40.670556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3dcb2-46ca-4087-afcb-d53327c40165 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:40.681227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 91/171] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:40.682716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3dcb2-46ca-4087-afcb-d53327c40165 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:40.736828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340f22fb-4e98-4a71-8654-0b924acb7e0d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:40.799840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:40.802714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3dcb2-46ca-4087-afcb-d53327c40165 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:40.846484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8534a5b-6acd-457c-9b5d-caec8f27c227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:40.849496 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8534a5b-6acd-457c-9b5d-caec8f27c227 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:40.849788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8534a5b-6acd-457c-9b5d-caec8f27c227 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:40.850057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8534a5b-6acd-457c-9b5d-caec8f27c227 None admin] PATH_INFO: `/v3/users/8925da3e911a4d87957cf78bccc842b7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:40.851912 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8534a5b-6acd-457c-9b5d-caec8f27c227 None admin] RBAC: Authorizing `identity:get_user(user_id=8925da3e911a4d87957cf78bccc842b7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:40.853649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8534a5b-6acd-457c-9b5d-caec8f27c227 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:40.857179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 81/172] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:40 2022] GET /identity/v3/users/8925da3e911a4d87957cf78bccc842b7 => generated 275 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:40.864517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8534a5b-6acd-457c-9b5d-caec8f27c227 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:40.865899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12cf11-0cec-46e7-b313-43fd5d3caa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:40.866809 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12cf11-0cec-46e7-b313-43fd5d3caa56 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:40.867113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12cf11-0cec-46e7-b313-43fd5d3caa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:40.867394 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12cf11-0cec-46e7-b313-43fd5d3caa56 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:40.868940 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12cf11-0cec-46e7-b313-43fd5d3caa56 None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:40.870443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12cf11-0cec-46e7-b313-43fd5d3caa56 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:40.879052 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 92/173] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:40 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:40.880013 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12cf11-0cec-46e7-b313-43fd5d3caa56 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:40.967210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:41.053217 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12cf11-0cec-46e7-b313-43fd5d3caa56 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:41.064957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8534a5b-6acd-457c-9b5d-caec8f27c227 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:41.112850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fed0d4-0662-4f80-8f70-3ce8dd90cb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:41.114698 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fed0d4-0662-4f80-8f70-3ce8dd90cb27 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:41.116836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fed0d4-0662-4f80-8f70-3ce8dd90cb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:41.117324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fed0d4-0662-4f80-8f70-3ce8dd90cb27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:41.137166 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10455d60-4ea4-47af-a40b-0744f404849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:41.138555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10455d60-4ea4-47af-a40b-0744f404849b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:41.139073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10455d60-4ea4-47af-a40b-0744f404849b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:41.139546 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10455d60-4ea4-47af-a40b-0744f404849b None admin] PATH_INFO: `/v3/users/390ec2987ab84c629492b45c072ee2f1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:41.141933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10455d60-4ea4-47af-a40b-0744f404849b None admin] RBAC: Authorizing `identity:get_user(user_id=390ec2987ab84c629492b45c072ee2f1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:41.143709 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10455d60-4ea4-47af-a40b-0744f404849b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:41.146558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 82/174] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:40 2022] GET /identity/v3/users/390ec2987ab84c629492b45c072ee2f1 => generated 289 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:41.149299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10455d60-4ea4-47af-a40b-0744f404849b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:41.215229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:41.273876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10455d60-4ea4-47af-a40b-0744f404849b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:41.293144 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fed0d4-0662-4f80-8f70-3ce8dd90cb27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:41.294630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fed0d4-0662-4f80-8f70-3ce8dd90cb27 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:41.306486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:41.320934 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d158d3c-d4d7-4852-aa48-1e7d78f9291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:41.321757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d158d3c-d4d7-4852-aa48-1e7d78f9291e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:41.323470 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d158d3c-d4d7-4852-aa48-1e7d78f9291e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:41.323855 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d158d3c-d4d7-4852-aa48-1e7d78f9291e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:41.324816 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d158d3c-d4d7-4852-aa48-1e7d78f9291e None admin] RBAC: Adding query filter params (role.id=e9dc595c6b4248d3b5262b70a90e76c5, scope.project.id=10efcfb517724a609d32a0457044f00c, user.id=8925da3e911a4d87957cf78bccc842b7) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:41.325430 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d158d3c-d4d7-4852-aa48-1e7d78f9291e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:41.328689 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d158d3c-d4d7-4852-aa48-1e7d78f9291e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:41.340643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 83/175] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:41 2022] GET /identity/v3/role_assignments?user.id=8925da3e911a4d87957cf78bccc842b7&scope.project.id=10efcfb517724a609d32a0457044f00c&role.id=e9dc595c6b4248d3b5262b70a90e76c5 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:41.342652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d158d3c-d4d7-4852-aa48-1e7d78f9291e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:41.513940 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 93/176] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:51:41.521766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fed0d4-0662-4f80-8f70-3ce8dd90cb27 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:41.575758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d158d3c-d4d7-4852-aa48-1e7d78f9291e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:41.655047 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8746dc6-a930-444f-802a-0ca05b26cc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:41.657001 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8746dc6-a930-444f-802a-0ca05b26cc57 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:41.657277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8746dc6-a930-444f-802a-0ca05b26cc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:41.657551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8746dc6-a930-444f-802a-0ca05b26cc57 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:41.659443 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8746dc6-a930-444f-802a-0ca05b26cc57 None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:41.663661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8746dc6-a930-444f-802a-0ca05b26cc57 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:41.666732 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:41.667937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 84/177] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:41 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:41.672698 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8746dc6-a930-444f-802a-0ca05b26cc57 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:41.725542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fed0d4-0662-4f80-8f70-3ce8dd90cb27 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:41.748914 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:41.787559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d624c3-f712-4a99-a79d-27b391e35226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:41.788478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d624c3-f712-4a99-a79d-27b391e35226 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:41.788761 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d624c3-f712-4a99-a79d-27b391e35226 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:41.789041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d624c3-f712-4a99-a79d-27b391e35226 None admin] PATH_INFO: `/v3/projects/68dd471255b84f98ae2997d2b48e238e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:41.790332 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d624c3-f712-4a99-a79d-27b391e35226 None admin] RBAC: Authorizing `identity:get_project(project_id=68dd471255b84f98ae2997d2b48e238e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:41.791936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d624c3-f712-4a99-a79d-27b391e35226 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:41.793915 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 94/178] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:41 2022] GET /identity/v3/projects/68dd471255b84f98ae2997d2b48e238e => generated 312 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:41.795231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8746dc6-a930-444f-802a-0ca05b26cc57 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:41.799536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d624c3-f712-4a99-a79d-27b391e35226 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:41.840853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12794fec-82eb-4846-8f6c-a70b16395713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:41.843054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12794fec-82eb-4846-8f6c-a70b16395713 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:41.843959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12794fec-82eb-4846-8f6c-a70b16395713 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:41.844661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12794fec-82eb-4846-8f6c-a70b16395713 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c/users/390ec2987ab84c629492b45c072ee2f1/roles/6256bf6008374f439ed55b6faad17124` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:41.848200 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12794fec-82eb-4846-8f6c-a70b16395713 None admin] RBAC: Authorizing `identity:create_grant(project_id=10efcfb517724a609d32a0457044f00c, user_id=390ec2987ab84c629492b45c072ee2f1, role_id=6256bf6008374f439ed55b6faad17124)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:41.854013 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12794fec-82eb-4846-8f6c-a70b16395713 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:41.872414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 85/179] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:51:41 2022] PUT /identity/v3/projects/10efcfb517724a609d32a0457044f00c/users/390ec2987ab84c629492b45c072ee2f1/roles/6256bf6008374f439ed55b6faad17124 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:51:41.969866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d624c3-f712-4a99-a79d-27b391e35226 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:42.014485 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23db62-5dbc-4216-b737-4cb371e2d6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:42.015199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23db62-5dbc-4216-b737-4cb371e2d6bf None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:42.015485 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23db62-5dbc-4216-b737-4cb371e2d6bf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:42.015761 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23db62-5dbc-4216-b737-4cb371e2d6bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:42.016624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23db62-5dbc-4216-b737-4cb371e2d6bf None admin] RBAC: Adding query filter params (role.id=64e044de7dcc4949acf8ce7eaf08fdaa, scope.project.id=68dd471255b84f98ae2997d2b48e238e, user.id=8925da3e911a4d87957cf78bccc842b7) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:42.016944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23db62-5dbc-4216-b737-4cb371e2d6bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:42.018452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23db62-5dbc-4216-b737-4cb371e2d6bf None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:42.028459 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:42.032486 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 95/180] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:41 2022] GET /identity/v3/role_assignments?user.id=8925da3e911a4d87957cf78bccc842b7&scope.project.id=68dd471255b84f98ae2997d2b48e238e&role.id=64e044de7dcc4949acf8ce7eaf08fdaa => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:42.507266 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d590f-7cae-4b51-b20d-873006234254 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:42.507619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d590f-7cae-4b51-b20d-873006234254 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:42.507791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d590f-7cae-4b51-b20d-873006234254 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:42.509757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 86/181] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:42.514937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf5274-648d-424a-a34a-0be00d8b6c81 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:42.515395 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf5274-648d-424a-a34a-0be00d8b6c81 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:42.515468 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf5274-648d-424a-a34a-0be00d8b6c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:42.538177 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-acdf5274-648d-424a-a34a-0be00d8b6c81 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:42.539410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-acdf5274-648d-424a-a34a-0be00d8b6c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:42.563859 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cc6d8-d5c8-4f71-a89a-408d8fd48c79 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:42.564193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cc6d8-d5c8-4f71-a89a-408d8fd48c79 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:42.564537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824cc6d8-d5c8-4f71-a89a-408d8fd48c79 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:42.566426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 87/182] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:42.572191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf09a5-0d8a-435a-9007-618b15da8fef None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:42.572481 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf09a5-0d8a-435a-9007-618b15da8fef None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:42.572767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baf09a5-0d8a-435a-9007-618b15da8fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:42.591901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3baf09a5-0d8a-435a-9007-618b15da8fef None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:42.593165 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3baf09a5-0d8a-435a-9007-618b15da8fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:42.618129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 96/183] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:42.642851 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf5274-648d-424a-a34a-0be00d8b6c81 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:42.697456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 88/184] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:42.710496 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e669f6-d90b-4ee9-91ae-170c1f9e4ed3 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:42.710745 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e669f6-d90b-4ee9-91ae-170c1f9e4ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:42.711127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e669f6-d90b-4ee9-91ae-170c1f9e4ed3 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:42.712467 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 89/185] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:51:42.717508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992ba4c-b3b5-4181-8a41-90443e45d8a4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:42.717794 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992ba4c-b3b5-4181-8a41-90443e45d8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:42.718076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992ba4c-b3b5-4181-8a41-90443e45d8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:42.736071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f992ba4c-b3b5-4181-8a41-90443e45d8a4 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:42.737248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f992ba4c-b3b5-4181-8a41-90443e45d8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:42.758591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf5274-648d-424a-a34a-0be00d8b6c81 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:42.788386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:42.791756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:42.795108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4bbd9-bcbc-4d7f-9317-395e7183f8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:42.795929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4bbd9-bcbc-4d7f-9317-395e7183f8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:42.796247 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4bbd9-bcbc-4d7f-9317-395e7183f8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:42.796575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4bbd9-bcbc-4d7f-9317-395e7183f8f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:42.808288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4bbd9-bcbc-4d7f-9317-395e7183f8f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:42.818861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 90/186] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:42.818861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992ba4c-b3b5-4181-8a41-90443e45d8a4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-fdb4bbd9-bcbc-4d7f-9317-395e7183f8f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:42.819071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:42.819891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:42.820700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:42.820700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:42.820700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:42.820700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:42.820700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:42.820700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:42.820700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:42.820700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:42.820700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:42.820700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:42.820700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:42.820700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:42.822260 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 97/187] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:51:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:51:42.826849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4bbd9-bcbc-4d7f-9317-395e7183f8f7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:42.922495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992ba4c-b3b5-4181-8a41-90443e45d8a4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:42.934568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4bbd9-bcbc-4d7f-9317-395e7183f8f7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:42.958266 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907698f-280d-42de-aa95-870c08ea15ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:42.959130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907698f-280d-42de-aa95-870c08ea15ea None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:42.959419 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907698f-280d-42de-aa95-870c08ea15ea None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:42.959699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d907698f-280d-42de-aa95-870c08ea15ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:42.970452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d907698f-280d-42de-aa95-870c08ea15ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:42.970842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc69f4-200d-465e-a630-333b6ad34441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:42.971789 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc69f4-200d-465e-a630-333b6ad34441 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:42.972288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc69f4-200d-465e-a630-333b6ad34441 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:42.972709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc69f4-200d-465e-a630-333b6ad34441 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:42.973650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc69f4-200d-465e-a630-333b6ad34441 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:42.974112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc69f4-200d-465e-a630-333b6ad34441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:42.975684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc69f4-200d-465e-a630-333b6ad34441 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d907698f-280d-42de-aa95-870c08ea15ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:42.978685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:42.979808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:42.980754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:42.980754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:42.980754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:42.980754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:42.980754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:42.980754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:42.980754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:42.980754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:42.980754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:42.980754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:42.980754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:51:42.980754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:42.980754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 91/188] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:51:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:42.981516 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907698f-280d-42de-aa95-870c08ea15ea None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:42.991387 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 98/189] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:42.992419 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc69f4-200d-465e-a630-333b6ad34441 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:43.035348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:43.053809 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:43.095927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d907698f-280d-42de-aa95-870c08ea15ea None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:43.105549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc69f4-200d-465e-a630-333b6ad34441 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:43.134019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdb829-8d55-42ca-99db-afecb3a71f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:43.134853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdb829-8d55-42ca-99db-afecb3a71f0a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:43.135134 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdb829-8d55-42ca-99db-afecb3a71f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:43.135428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fdb829-8d55-42ca-99db-afecb3a71f0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:43.136630 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdb829-8d55-42ca-99db-afecb3a71f0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:43.138096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fdb829-8d55-42ca-99db-afecb3a71f0a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:43.144339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 92/190] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:43.144339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdb829-8d55-42ca-99db-afecb3a71f0a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:43.145920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0259629-9988-49a4-9b3a-692d7552c418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:43.146602 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0259629-9988-49a4-9b3a-692d7552c418 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:43.147002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0259629-9988-49a4-9b3a-692d7552c418 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:43.147314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0259629-9988-49a4-9b3a-692d7552c418 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:43.148046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0259629-9988-49a4-9b3a-692d7552c418 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:43.148356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0259629-9988-49a4-9b3a-692d7552c418 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:43.149771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0259629-9988-49a4-9b3a-692d7552c418 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:43.159361 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 99/191] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:51:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:43.164631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0259629-9988-49a4-9b3a-692d7552c418 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:43.257711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fdb829-8d55-42ca-99db-afecb3a71f0a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:43.271489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:43.279583 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0259629-9988-49a4-9b3a-692d7552c418 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:43.294233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfafc60-c7d6-490f-8b38-fb9deb642df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:43.294746 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:43.295079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfafc60-c7d6-490f-8b38-fb9deb642df8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:43.295368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfafc60-c7d6-490f-8b38-fb9deb642df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:43.295646 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfafc60-c7d6-490f-8b38-fb9deb642df8 None admin] PATH_INFO: `/v3/users/f23c15c5ec264e40a69e6401643a77e7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:43.310341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfafc60-c7d6-490f-8b38-fb9deb642df8 None admin] RBAC: Authorizing `identity:get_user(user_id=f23c15c5ec264e40a69e6401643a77e7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:43.311861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfafc60-c7d6-490f-8b38-fb9deb642df8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:43.313750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 93/192] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:43 2022] GET /identity/v3/users/f23c15c5ec264e40a69e6401643a77e7 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:43.314355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfafc60-c7d6-490f-8b38-fb9deb642df8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:43.322326 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202af37-345a-4f0f-a07d-2e2511cc828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:43.323049 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202af37-345a-4f0f-a07d-2e2511cc828b None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:43.323334 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202af37-345a-4f0f-a07d-2e2511cc828b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:43.323611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202af37-345a-4f0f-a07d-2e2511cc828b None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:43.324324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202af37-345a-4f0f-a07d-2e2511cc828b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:43.325792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202af37-345a-4f0f-a07d-2e2511cc828b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:43.355029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 100/193] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:51:43 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:51:43.356083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202af37-345a-4f0f-a07d-2e2511cc828b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:43.439609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfafc60-c7d6-490f-8b38-fb9deb642df8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:43.497629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e9299-3ea3-41e9-acb7-fa9a1770e974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:43.497629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e9299-3ea3-41e9-acb7-fa9a1770e974 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:43.497629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e9299-3ea3-41e9-acb7-fa9a1770e974 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:43.497980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e9299-3ea3-41e9-acb7-fa9a1770e974 None admin] PATH_INFO: `/v3/users/f23c15c5ec264e40a69e6401643a77e7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:43.502594 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e9299-3ea3-41e9-acb7-fa9a1770e974 None admin] RBAC: Authorizing `identity:get_user(user_id=f23c15c5ec264e40a69e6401643a77e7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:43.504051 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e9299-3ea3-41e9-acb7-fa9a1770e974 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:43.504313 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202af37-345a-4f0f-a07d-2e2511cc828b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:43.506453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 94/194] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:43 2022] GET /identity/v3/users/f23c15c5ec264e40a69e6401643a77e7 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:43.512743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e9299-3ea3-41e9-acb7-fa9a1770e974 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:43.554109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ea9d2-744a-461f-b90c-2e7439a336e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:43.554730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea9d2-744a-461f-b90c-2e7439a336e4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:43.555084 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea9d2-744a-461f-b90c-2e7439a336e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:43.555515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ea9d2-744a-461f-b90c-2e7439a336e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:43.564113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:43.617557 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:43.650413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e9299-3ea3-41e9-acb7-fa9a1770e974 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:43.663779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ea9d2-744a-461f-b90c-2e7439a336e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:43.665309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ea9d2-744a-461f-b90c-2e7439a336e4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:43.703049 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51909c4b-4bd3-4656-990e-b66bcf232ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:43.704023 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51909c4b-4bd3-4656-990e-b66bcf232ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:43.704314 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51909c4b-4bd3-4656-990e-b66bcf232ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:43.704588 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51909c4b-4bd3-4656-990e-b66bcf232ec5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:43.786651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51909c4b-4bd3-4656-990e-b66bcf232ec5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:43.788498 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51909c4b-4bd3-4656-990e-b66bcf232ec5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:43.789914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 101/195] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:51:43.795685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ea9d2-744a-461f-b90c-2e7439a336e4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:43.833508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:43.889568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:43.915455 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 95/196] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 15:51:43.921207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51909c4b-4bd3-4656-990e-b66bcf232ec5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:43.942125 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ea9d2-744a-461f-b90c-2e7439a336e4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:44.017017 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bfc3b-d972-4894-a554-c15524f3f56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:44.017919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bfc3b-d972-4894-a554-c15524f3f56b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:44.018199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bfc3b-d972-4894-a554-c15524f3f56b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:44.018473 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bfc3b-d972-4894-a554-c15524f3f56b None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:44.023590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bfc3b-d972-4894-a554-c15524f3f56b None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:44.025373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bfc3b-d972-4894-a554-c15524f3f56b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:44.027171 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 102/197] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:43 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:44.033174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bfc3b-d972-4894-a554-c15524f3f56b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:44.066943 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51909c4b-4bd3-4656-990e-b66bcf232ec5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:44.106189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cadae-8b51-4509-90e6-e680f85de7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:44.107222 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cadae-8b51-4509-90e6-e680f85de7bb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:44.107504 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cadae-8b51-4509-90e6-e680f85de7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:44.107778 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cadae-8b51-4509-90e6-e680f85de7bb None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:44.110124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944cadae-8b51-4509-90e6-e680f85de7bb None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:44.113118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944cadae-8b51-4509-90e6-e680f85de7bb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:44.117649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 96/198] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:43 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:44.127813 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cadae-8b51-4509-90e6-e680f85de7bb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:44.137308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:44.217451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bfc3b-d972-4894-a554-c15524f3f56b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:44.260434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e3ff2-ef4b-47a0-8a08-bbb2dc7ac3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:44.261103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3ff2-ef4b-47a0-8a08-bbb2dc7ac3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:44.261386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3ff2-ef4b-47a0-8a08-bbb2dc7ac3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:44.261661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e3ff2-ef4b-47a0-8a08-bbb2dc7ac3d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:44.262623 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e3ff2-ef4b-47a0-8a08-bbb2dc7ac3d9 None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=e69f0e40da80459cb7b997f21995950a, user.id=f23c15c5ec264e40a69e6401643a77e7) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:44.263007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e3ff2-ef4b-47a0-8a08-bbb2dc7ac3d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:44.264475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e3ff2-ef4b-47a0-8a08-bbb2dc7ac3d9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:44.270857 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 103/199] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:44 2022] GET /identity/v3/role_assignments?user.id=f23c15c5ec264e40a69e6401643a77e7&scope.project.id=e69f0e40da80459cb7b997f21995950a&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:44.275510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cadae-8b51-4509-90e6-e680f85de7bb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:44.286850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3e78c-8ec2-4f40-8f29-459032be1b72 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:44.286850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3e78c-8ec2-4f40-8f29-459032be1b72 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:44.286850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3e78c-8ec2-4f40-8f29-459032be1b72 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:44.286850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 104/200] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:44.287899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c7c3-b993-4618-858e-e150089f28b4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:44.288187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c7c3-b993-4618-858e-e150089f28b4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:44.288466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199c7c3-b993-4618-858e-e150089f28b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:44.303235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:44.322107 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fd056-d4a4-42e8-b75c-c32f0855f212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:44.322930 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fd056-d4a4-42e8-b75c-c32f0855f212 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:44.323282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fd056-d4a4-42e8-b75c-c32f0855f212 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:44.323645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2fd056-d4a4-42e8-b75c-c32f0855f212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:44.323758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c199c7c3-b993-4618-858e-e150089f28b4 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:44.324581 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fd056-d4a4-42e8-b75c-c32f0855f212 None admin] RBAC: Adding query filter params (role.id=e9dc595c6b4248d3b5262b70a90e76c5, scope.project.id=e69f0e40da80459cb7b997f21995950a, user.id=f23c15c5ec264e40a69e6401643a77e7) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:44.324956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fd056-d4a4-42e8-b75c-c32f0855f212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:44.325058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c199c7c3-b993-4618-858e-e150089f28b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:44.326507 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2fd056-d4a4-42e8-b75c-c32f0855f212 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:44.333039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 97/201] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:44 2022] GET /identity/v3/role_assignments?user.id=f23c15c5ec264e40a69e6401643a77e7&scope.project.id=e69f0e40da80459cb7b997f21995950a&role.id=e9dc595c6b4248d3b5262b70a90e76c5 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:44.460521 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 105/202] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:44.501528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fd056-d4a4-42e8-b75c-c32f0855f212 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:44.579305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:44.609710 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2fd056-d4a4-42e8-b75c-c32f0855f212 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:44.644170 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950040a-e088-4f25-a19b-3d2ae4260259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:44.644983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950040a-e088-4f25-a19b-3d2ae4260259 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:44.645263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950040a-e088-4f25-a19b-3d2ae4260259 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:44.645534 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950040a-e088-4f25-a19b-3d2ae4260259 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:44.663764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950040a-e088-4f25-a19b-3d2ae4260259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4950040a-e088-4f25-a19b-3d2ae4260259 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:44.671539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:44.672391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:44.673297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:44.673297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:44.673297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:44.673297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:44.673297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:44.673297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:44.673297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:44.673297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:44.673297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:44.673297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:44.673297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:51:44.673297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:44.673297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 98/203] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:44.678896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199c7c3-b993-4618-858e-e150089f28b4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:44.816927 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199c7c3-b993-4618-858e-e150089f28b4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:44.848224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:44.858158 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931e769-4c4c-4048-b64d-e3865f8bf501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:44.858891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931e769-4c4c-4048-b64d-e3865f8bf501 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:44.859180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931e769-4c4c-4048-b64d-e3865f8bf501 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:44.859460 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931e769-4c4c-4048-b64d-e3865f8bf501 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:44.860267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931e769-4c4c-4048-b64d-e3865f8bf501 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:44.861014 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931e769-4c4c-4048-b64d-e3865f8bf501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:44.863078 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7931e769-4c4c-4048-b64d-e3865f8bf501 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:44.874913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 106/204] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:44.880455 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950040a-e088-4f25-a19b-3d2ae4260259 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:45.091546 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950040a-e088-4f25-a19b-3d2ae4260259 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:45.126982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:45.134264 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa4702-b8d7-4fbc-98a8-df74e97c01cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:45.135244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa4702-b8d7-4fbc-98a8-df74e97c01cb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:45.135676 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa4702-b8d7-4fbc-98a8-df74e97c01cb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:45.136341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa4702-b8d7-4fbc-98a8-df74e97c01cb None admin] PATH_INFO: `/v3/users/390ec2987ab84c629492b45c072ee2f1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:45.137872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa4702-b8d7-4fbc-98a8-df74e97c01cb None admin] RBAC: Authorizing `identity:get_user(user_id=390ec2987ab84c629492b45c072ee2f1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:45.139771 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa4702-b8d7-4fbc-98a8-df74e97c01cb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:45.142906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 99/205] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:44 2022] GET /identity/v3/users/390ec2987ab84c629492b45c072ee2f1 => generated 289 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:45.147281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931e769-4c4c-4048-b64d-e3865f8bf501 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:45.298849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931e769-4c4c-4048-b64d-e3865f8bf501 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:45.356508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ec064-b203-4ea6-97b0-a952b15d93cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:45.357512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ec064-b203-4ea6-97b0-a952b15d93cd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:45.357994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ec064-b203-4ea6-97b0-a952b15d93cd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:45.358466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ec064-b203-4ea6-97b0-a952b15d93cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:45.438411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:45.449014 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ec064-b203-4ea6-97b0-a952b15d93cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:45.450607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ec064-b203-4ea6-97b0-a952b15d93cd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:45.587466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 107/206] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:51:45.593144 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa4702-b8d7-4fbc-98a8-df74e97c01cb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:45.732723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa4702-b8d7-4fbc-98a8-df74e97c01cb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:45.782389 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a69dcc-9d0e-46ea-8ae5-a0c1a3dc61c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:45.783312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a69dcc-9d0e-46ea-8ae5-a0c1a3dc61c1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:45.783594 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a69dcc-9d0e-46ea-8ae5-a0c1a3dc61c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:45.783867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a69dcc-9d0e-46ea-8ae5-a0c1a3dc61c1 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:45.785262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a69dcc-9d0e-46ea-8ae5-a0c1a3dc61c1 None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:45.786746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a69dcc-9d0e-46ea-8ae5-a0c1a3dc61c1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:45.788758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 100/207] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:45 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:45.796919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ec064-b203-4ea6-97b0-a952b15d93cd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:45.908834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:45.922998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ec064-b203-4ea6-97b0-a952b15d93cd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:45.968339 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f45a8-55a1-4773-957a-35c96b085828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:45.969009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f45a8-55a1-4773-957a-35c96b085828 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:45.969295 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f45a8-55a1-4773-957a-35c96b085828 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:45.969570 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f45a8-55a1-4773-957a-35c96b085828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:45.970422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f45a8-55a1-4773-957a-35c96b085828 None admin] RBAC: Adding query filter params (role.id=6256bf6008374f439ed55b6faad17124, scope.project.id=10efcfb517724a609d32a0457044f00c, user.id=390ec2987ab84c629492b45c072ee2f1) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:45.970735 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f45a8-55a1-4773-957a-35c96b085828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:45.972262 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f45a8-55a1-4773-957a-35c96b085828 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:45.978337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 108/208] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:45 2022] GET /identity/v3/role_assignments?user.id=390ec2987ab84c629492b45c072ee2f1&scope.project.id=10efcfb517724a609d32a0457044f00c&role.id=6256bf6008374f439ed55b6faad17124 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:45.996839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d0868-90ff-444b-aa9c-33f0c9874cd2 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:45.997015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d0868-90ff-444b-aa9c-33f0c9874cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:45.997298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d0868-90ff-444b-aa9c-33f0c9874cd2 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:45.999132 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 101/209] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:46.004571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43777aa-388a-4e32-bf46-4f98e529d249 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:46.004869 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43777aa-388a-4e32-bf46-4f98e529d249 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:46.005151 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43777aa-388a-4e32-bf46-4f98e529d249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:46.032150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d43777aa-388a-4e32-bf46-4f98e529d249 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:46.033422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d43777aa-388a-4e32-bf46-4f98e529d249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:46.105733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9241fd-fcf8-44f4-be11-89b71c628a34 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:46.106064 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9241fd-fcf8-44f4-be11-89b71c628a34 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:46.106284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9241fd-fcf8-44f4-be11-89b71c628a34 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:46.107727 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 102/210] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:46.118964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94449b-9d0b-492b-b1f9-982f8c6328a3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:46.119275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94449b-9d0b-492b-b1f9-982f8c6328a3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:46.119516 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94449b-9d0b-492b-b1f9-982f8c6328a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:46.148877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2b94449b-9d0b-492b-b1f9-982f8c6328a3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:46.150088 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2b94449b-9d0b-492b-b1f9-982f8c6328a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:46.155075 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 109/211] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:46.188380 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43777aa-388a-4e32-bf46-4f98e529d249 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:46.223043 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:46.232495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 103/212] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:46.259064 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94449b-9d0b-492b-b1f9-982f8c6328a3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:46.290317 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:46.304356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43777aa-388a-4e32-bf46-4f98e529d249 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:46.342259 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54024b-98ee-431a-8247-3920871acbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:46.343099 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54024b-98ee-431a-8247-3920871acbce None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:46.343385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54024b-98ee-431a-8247-3920871acbce None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:46.343657 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb54024b-98ee-431a-8247-3920871acbce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:46.344832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54024b-98ee-431a-8247-3920871acbce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:46.346302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb54024b-98ee-431a-8247-3920871acbce None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:46.348231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 110/213] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:46.356366 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54024b-98ee-431a-8247-3920871acbce None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:46.379074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94449b-9d0b-492b-b1f9-982f8c6328a3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:46.416229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b324d4-f707-44a4-8f14-3b65e9e4e382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:46.417384 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b324d4-f707-44a4-8f14-3b65e9e4e382 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:46.417827 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b324d4-f707-44a4-8f14-3b65e9e4e382 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:46.418254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b324d4-f707-44a4-8f14-3b65e9e4e382 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:46.430276 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b324d4-f707-44a4-8f14-3b65e9e4e382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f7b324d4-f707-44a4-8f14-3b65e9e4e382 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:46.438911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:46.439835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:46.440743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:46.440743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:46.440743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:46.440743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:46.440743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:46.440743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:46.440743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:46.440743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:46.440743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:46.440743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:46.440743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:46.440743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:46.443227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 104/214] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:51:46.449314 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b324d4-f707-44a4-8f14-3b65e9e4e382 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:46.463833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb54024b-98ee-431a-8247-3920871acbce None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:46.502713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5ff23-c8b1-4d84-a81a-0751f5fb3c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:46.503475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5ff23-c8b1-4d84-a81a-0751f5fb3c8e None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:46.503756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5ff23-c8b1-4d84-a81a-0751f5fb3c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:46.504049 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5ff23-c8b1-4d84-a81a-0751f5fb3c8e None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:46.505215 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5ff23-c8b1-4d84-a81a-0751f5fb3c8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:46.507219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5ff23-c8b1-4d84-a81a-0751f5fb3c8e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:46.515590 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:46.538667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 111/215] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:51:46 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:51:46.582344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b324d4-f707-44a4-8f14-3b65e9e4e382 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:46.623229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446585af-16f5-4c82-9941-abcaf6384d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:46.623917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446585af-16f5-4c82-9941-abcaf6384d29 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:46.624198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446585af-16f5-4c82-9941-abcaf6384d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:46.624469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446585af-16f5-4c82-9941-abcaf6384d29 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:46.625257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446585af-16f5-4c82-9941-abcaf6384d29 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:46.625563 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446585af-16f5-4c82-9941-abcaf6384d29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:46.627083 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446585af-16f5-4c82-9941-abcaf6384d29 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:46.637191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 105/216] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:46.644162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5ff23-c8b1-4d84-a81a-0751f5fb3c8e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:46.662643 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:46.759846 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5ff23-c8b1-4d84-a81a-0751f5fb3c8e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:46.797563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984ba83-445e-4e6f-b901-6f2e9f74e986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:46.799185 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984ba83-445e-4e6f-b901-6f2e9f74e986 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:46.799618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984ba83-445e-4e6f-b901-6f2e9f74e986 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:46.800097 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984ba83-445e-4e6f-b901-6f2e9f74e986 None admin] PATH_INFO: `/v3/users/8ec738de3eb44cc3afc6a55e0b684941` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:46.817092 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984ba83-445e-4e6f-b901-6f2e9f74e986 None admin] RBAC: Authorizing `identity:get_user(user_id=8ec738de3eb44cc3afc6a55e0b684941)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:46.818796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984ba83-445e-4e6f-b901-6f2e9f74e986 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:46.821043 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 112/217] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:46 2022] GET /identity/v3/users/8ec738de3eb44cc3afc6a55e0b684941 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:46.826901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446585af-16f5-4c82-9941-abcaf6384d29 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:46.857462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bef640-e306-470f-b03f-9e53d13d35b2 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:46.858012 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bef640-e306-470f-b03f-9e53d13d35b2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:46.858447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bef640-e306-470f-b03f-9e53d13d35b2 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:46.860038 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 113/218] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:51:46.865865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1c2b8-9610-484d-a3cd-04f7246683fb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:46.866403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1c2b8-9610-484d-a3cd-04f7246683fb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:46.866993 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1c2b8-9610-484d-a3cd-04f7246683fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:46.887863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7bf1c2b8-9610-484d-a3cd-04f7246683fb None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:46.889324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7bf1c2b8-9610-484d-a3cd-04f7246683fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:46.944636 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446585af-16f5-4c82-9941-abcaf6384d29 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:46.965839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:46.968097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:46.971962 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 114/219] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:46.973538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4729d13-ebde-4c86-9de1-978958f84099 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:46.974116 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4729d13-ebde-4c86-9de1-978958f84099 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:46.974575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4729d13-ebde-4c86-9de1-978958f84099 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:46.975982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 115/220] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:46.981928 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e85a8d-943e-4ed2-bb08-1b024e4cc2db None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:46.982281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e85a8d-943e-4ed2-bb08-1b024e4cc2db None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:46.982668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e85a8d-943e-4ed2-bb08-1b024e4cc2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:46.992847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f667c40-541a-41c0-a200-cb1f808a8b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:46.993726 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f667c40-541a-41c0-a200-cb1f808a8b01 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:46.994165 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f667c40-541a-41c0-a200-cb1f808a8b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:46.994574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f667c40-541a-41c0-a200-cb1f808a8b01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:47.001706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-12e85a8d-943e-4ed2-bb08-1b024e4cc2db None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:47.003394 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-12e85a8d-943e-4ed2-bb08-1b024e4cc2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:47.088891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f667c40-541a-41c0-a200-cb1f808a8b01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:47.089263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 116/221] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:47.090146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e85a8d-943e-4ed2-bb08-1b024e4cc2db None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:47.090318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f667c40-541a-41c0-a200-cb1f808a8b01 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:47.218645 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e85a8d-943e-4ed2-bb08-1b024e4cc2db None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:47.235737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 106/222] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:51:47.237150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f667c40-541a-41c0-a200-cb1f808a8b01 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:47.251269 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:47.257236 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76022b-d5bc-4aee-a499-db66d0dc9ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:47.258236 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76022b-d5bc-4aee-a499-db66d0dc9ecf None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:47.258666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76022b-d5bc-4aee-a499-db66d0dc9ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:47.259131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c76022b-d5bc-4aee-a499-db66d0dc9ecf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:47.261904 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:47.270650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c76022b-d5bc-4aee-a499-db66d0dc9ecf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-9c76022b-d5bc-4aee-a499-db66d0dc9ecf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:47.278849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:47.279743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:47.280533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:47.280533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:47.280533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:47.280533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:47.280533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:47.280533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:47.280533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:47.280533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:47.280533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:47.280533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:47.280533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:47.280533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:47.282921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 117/223] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:51:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:47.288114 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76022b-d5bc-4aee-a499-db66d0dc9ecf None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:47.354120 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f667c40-541a-41c0-a200-cb1f808a8b01 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:47.390267 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121b43a-d0a4-42e7-9035-b7d72045f0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:47.391526 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121b43a-d0a4-42e7-9035-b7d72045f0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:47.392027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121b43a-d0a4-42e7-9035-b7d72045f0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:47.392539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121b43a-d0a4-42e7-9035-b7d72045f0b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:47.403868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6121b43a-d0a4-42e7-9035-b7d72045f0b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:47.412346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c76022b-d5bc-4aee-a499-db66d0dc9ecf None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-6121b43a-d0a4-42e7-9035-b7d72045f0b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:47.412769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:47.413626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:47.414422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:47.414422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:47.414422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:47.414422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:47.414422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:47.414422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:47.414422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:47.414422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:47.414422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:47.414422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:47.414422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:51:47.414422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:47.416877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 107/224] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:51:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:47.417870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121b43a-d0a4-42e7-9035-b7d72045f0b5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:47.467960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39576368-ee23-4c6e-b0ee-c7d75a4d42d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:47.469599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39576368-ee23-4c6e-b0ee-c7d75a4d42d2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:47.470114 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39576368-ee23-4c6e-b0ee-c7d75a4d42d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:47.470590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39576368-ee23-4c6e-b0ee-c7d75a4d42d2 None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:47.472623 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39576368-ee23-4c6e-b0ee-c7d75a4d42d2 None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:47.474872 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39576368-ee23-4c6e-b0ee-c7d75a4d42d2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:47.477665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 118/225] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:47 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:47.478637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39576368-ee23-4c6e-b0ee-c7d75a4d42d2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:47.512837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:47.544823 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121b43a-d0a4-42e7-9035-b7d72045f0b5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:47.546023 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:47.591860 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39576368-ee23-4c6e-b0ee-c7d75a4d42d2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:47.592361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f6244-8e87-4e19-96a5-c5c2ed90dd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:47.593054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f6244-8e87-4e19-96a5-c5c2ed90dd7f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:47.593338 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f6244-8e87-4e19-96a5-c5c2ed90dd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:47.593615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f6244-8e87-4e19-96a5-c5c2ed90dd7f None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:47.594659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f6244-8e87-4e19-96a5-c5c2ed90dd7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:47.595010 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f6244-8e87-4e19-96a5-c5c2ed90dd7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:47.597396 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f6244-8e87-4e19-96a5-c5c2ed90dd7f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:47.613327 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 108/226] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:47.613327 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f6244-8e87-4e19-96a5-c5c2ed90dd7f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:47.635400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532b4f5-6478-4730-8791-5ca0f9b5c93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:47.636480 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532b4f5-6478-4730-8791-5ca0f9b5c93a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:47.637032 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532b4f5-6478-4730-8791-5ca0f9b5c93a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:47.637518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6532b4f5-6478-4730-8791-5ca0f9b5c93a None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:47.638477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532b4f5-6478-4730-8791-5ca0f9b5c93a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:47.639022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532b4f5-6478-4730-8791-5ca0f9b5c93a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:47.640685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6532b4f5-6478-4730-8791-5ca0f9b5c93a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:47.649810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 119/227] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:51:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:47.650947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532b4f5-6478-4730-8791-5ca0f9b5c93a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:47.745214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f6244-8e87-4e19-96a5-c5c2ed90dd7f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:47.779505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6532b4f5-6478-4730-8791-5ca0f9b5c93a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:47.790586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c014aa9-5234-4571-a79f-41f8ee00f76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:47.791652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c014aa9-5234-4571-a79f-41f8ee00f76a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:47.791950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c014aa9-5234-4571-a79f-41f8ee00f76a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:47.792235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c014aa9-5234-4571-a79f-41f8ee00f76a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:47.793093 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c014aa9-5234-4571-a79f-41f8ee00f76a None admin] RBAC: Adding query filter params (role.id=64e044de7dcc4949acf8ce7eaf08fdaa, scope.project.id=e69f0e40da80459cb7b997f21995950a, user.id=8ec738de3eb44cc3afc6a55e0b684941) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:47.793414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c014aa9-5234-4571-a79f-41f8ee00f76a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:47.795555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c014aa9-5234-4571-a79f-41f8ee00f76a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:47.802700 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 109/228] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:47 2022] GET /identity/v3/role_assignments?user.id=8ec738de3eb44cc3afc6a55e0b684941&scope.project.id=e69f0e40da80459cb7b997f21995950a&role.id=64e044de7dcc4949acf8ce7eaf08fdaa => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:47.803564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c014aa9-5234-4571-a79f-41f8ee00f76a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:47.805465 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:47.816429 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:47.837909 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a151a-0609-4698-b5cb-06ff8b9df2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:47.839372 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a151a-0609-4698-b5cb-06ff8b9df2c3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:47.840934 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a151a-0609-4698-b5cb-06ff8b9df2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:47.841453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a151a-0609-4698-b5cb-06ff8b9df2c3 None admin] PATH_INFO: `/v3/users/f23c15c5ec264e40a69e6401643a77e7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:47.844409 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a151a-0609-4698-b5cb-06ff8b9df2c3 None admin] RBAC: Authorizing `identity:get_user(user_id=f23c15c5ec264e40a69e6401643a77e7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:47.848918 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a151a-0609-4698-b5cb-06ff8b9df2c3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:47.855643 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 120/229] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:47 2022] GET /identity/v3/users/f23c15c5ec264e40a69e6401643a77e7 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:47.868472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a151a-0609-4698-b5cb-06ff8b9df2c3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:48.020839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c014aa9-5234-4571-a79f-41f8ee00f76a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:48.046113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a151a-0609-4698-b5cb-06ff8b9df2c3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:48.060008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb61f1-7e5a-494b-a3ed-e2b03e0474b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:48.061327 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb61f1-7e5a-494b-a3ed-e2b03e0474b0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:48.061807 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb61f1-7e5a-494b-a3ed-e2b03e0474b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:48.062288 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb61f1-7e5a-494b-a3ed-e2b03e0474b0 None admin] PATH_INFO: `/v3/users/f23c15c5ec264e40a69e6401643a77e7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:48.064022 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb61f1-7e5a-494b-a3ed-e2b03e0474b0 None admin] RBAC: Authorizing `identity:get_user(user_id=f23c15c5ec264e40a69e6401643a77e7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:48.065825 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb61f1-7e5a-494b-a3ed-e2b03e0474b0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:48.068194 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 110/230] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:47 2022] GET /identity/v3/users/f23c15c5ec264e40a69e6401643a77e7 => generated 283 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:48.073741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb61f1-7e5a-494b-a3ed-e2b03e0474b0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:48.082319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d129f5-7d31-4eae-97ff-3f1233469adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:48.083245 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d129f5-7d31-4eae-97ff-3f1233469adc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:48.083531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d129f5-7d31-4eae-97ff-3f1233469adc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:48.083813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d129f5-7d31-4eae-97ff-3f1233469adc None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:48.085029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d129f5-7d31-4eae-97ff-3f1233469adc None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:48.086507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d129f5-7d31-4eae-97ff-3f1233469adc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:48.094841 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 121/231] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:47 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:48.094841 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d129f5-7d31-4eae-97ff-3f1233469adc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:48.152730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:48.202838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d129f5-7d31-4eae-97ff-3f1233469adc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:48.215903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:48.235630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f932176-fe87-44ae-b955-0a4c9ba8ae67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:48.236558 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f932176-fe87-44ae-b955-0a4c9ba8ae67 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:48.236846 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f932176-fe87-44ae-b955-0a4c9ba8ae67 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:48.237127 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f932176-fe87-44ae-b955-0a4c9ba8ae67 None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a/users/f23c15c5ec264e40a69e6401643a77e7/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:48.241392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f932176-fe87-44ae-b955-0a4c9ba8ae67 None admin] RBAC: Authorizing `identity:create_grant(project_id=e69f0e40da80459cb7b997f21995950a, user_id=f23c15c5ec264e40a69e6401643a77e7, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:48.242882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f932176-fe87-44ae-b955-0a4c9ba8ae67 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:48.268523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 122/232] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:51:48 2022] PUT /identity/v3/projects/e69f0e40da80459cb7b997f21995950a/users/f23c15c5ec264e40a69e6401643a77e7/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:51:48.281859 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb61f1-7e5a-494b-a3ed-e2b03e0474b0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:48.334282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d5005b-d5dd-478a-9ef2-7e3d669a3eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:48.335216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5005b-d5dd-478a-9ef2-7e3d669a3eae None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:48.335498 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5005b-d5dd-478a-9ef2-7e3d669a3eae None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:48.335779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d5005b-d5dd-478a-9ef2-7e3d669a3eae None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:48.338628 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5005b-d5dd-478a-9ef2-7e3d669a3eae None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:48.340210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d5005b-d5dd-478a-9ef2-7e3d669a3eae None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:48.342251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 111/233] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:48 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:48.348664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f932176-fe87-44ae-b955-0a4c9ba8ae67 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:48.466636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f932176-fe87-44ae-b955-0a4c9ba8ae67 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:48.488103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:48.514332 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45db7b6-c8ad-4881-945a-247517ebeb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:48.515345 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45db7b6-c8ad-4881-945a-247517ebeb14 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:48.515631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45db7b6-c8ad-4881-945a-247517ebeb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:48.515913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45db7b6-c8ad-4881-945a-247517ebeb14 None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a/users/f23c15c5ec264e40a69e6401643a77e7/roles/e9dc595c6b4248d3b5262b70a90e76c5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:48.518194 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45db7b6-c8ad-4881-945a-247517ebeb14 None admin] RBAC: Authorizing `identity:create_grant(project_id=e69f0e40da80459cb7b997f21995950a, user_id=f23c15c5ec264e40a69e6401643a77e7, role_id=e9dc595c6b4248d3b5262b70a90e76c5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:48.519749 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45db7b6-c8ad-4881-945a-247517ebeb14 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:48.544062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 123/234] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:51:48 2022] PUT /identity/v3/projects/e69f0e40da80459cb7b997f21995950a/users/f23c15c5ec264e40a69e6401643a77e7/roles/e9dc595c6b4248d3b5262b70a90e76c5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:51:48.940973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ec0c9-ca5f-42b8-b356-38e3bdcc434e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:48.941444 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ec0c9-ca5f-42b8-b356-38e3bdcc434e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:48.941805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ec0c9-ca5f-42b8-b356-38e3bdcc434e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:48.943696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 112/235] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:48.949229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbbc2a-371d-4b32-9c9b-985138b93ee9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:48.949674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbbc2a-371d-4b32-9c9b-985138b93ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:48.949770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecbbc2a-371d-4b32-9c9b-985138b93ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:48.985657 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-aecbbc2a-371d-4b32-9c9b-985138b93ee9 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:48.986881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-aecbbc2a-371d-4b32-9c9b-985138b93ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:49.051864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92122ca5-33bc-4382-b5a6-ccadd09f7303 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:49.052839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92122ca5-33bc-4382-b5a6-ccadd09f7303 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:49.053342 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92122ca5-33bc-4382-b5a6-ccadd09f7303 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:49.056295 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 113/236] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:51:49.060617 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c607bbb-3b68-4034-8eb2-1b9d1a13a1c1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:49.061130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c607bbb-3b68-4034-8eb2-1b9d1a13a1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:49.061616 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c607bbb-3b68-4034-8eb2-1b9d1a13a1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:49.079151 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3c607bbb-3b68-4034-8eb2-1b9d1a13a1c1 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:49.080486 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 124/237] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:49.081402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3c607bbb-3b68-4034-8eb2-1b9d1a13a1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:49.117183 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbbc2a-371d-4b32-9c9b-985138b93ee9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:49.188091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 114/238] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:49.255099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c607bbb-3b68-4034-8eb2-1b9d1a13a1c1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:49.288078 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecbbc2a-371d-4b32-9c9b-985138b93ee9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:49.307175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:49.356250 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd798372-18e7-4bd9-8479-93395597cee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:49.357129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd798372-18e7-4bd9-8479-93395597cee2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:49.357415 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd798372-18e7-4bd9-8479-93395597cee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:49.357767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd798372-18e7-4bd9-8479-93395597cee2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:49.359830 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:49.386331 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd798372-18e7-4bd9-8479-93395597cee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-dd798372-18e7-4bd9-8479-93395597cee2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:49.400665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:49.401565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:49.402352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:49.402352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:49.402352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:49.402352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:49.402352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:49.402352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:49.402352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:49.402352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:49.402352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:49.402352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:49.402352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:51:49.402352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:49.402352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 125/239] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:51:49.411690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd798372-18e7-4bd9-8479-93395597cee2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:49.415086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c607bbb-3b68-4034-8eb2-1b9d1a13a1c1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:49.480920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d1466-e023-4623-9761-f8f993b66c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:49.482083 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d1466-e023-4623-9761-f8f993b66c54 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:49.482577 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d1466-e023-4623-9761-f8f993b66c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:49.483082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d1466-e023-4623-9761-f8f993b66c54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:49.487696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d1466-e023-4623-9761-f8f993b66c54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:49.489440 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d1466-e023-4623-9761-f8f993b66c54 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:49.492019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 115/240] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:49.497801 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d1466-e023-4623-9761-f8f993b66c54 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:49.518218 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd798372-18e7-4bd9-8479-93395597cee2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:49.584659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7724d-c9a1-4933-aa02-af0a7d52680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:49.585752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7724d-c9a1-4933-aa02-af0a7d52680a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:49.586281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7724d-c9a1-4933-aa02-af0a7d52680a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:49.586765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7724d-c9a1-4933-aa02-af0a7d52680a None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:49.587742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7724d-c9a1-4933-aa02-af0a7d52680a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:49.588242 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7724d-c9a1-4933-aa02-af0a7d52680a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:49.589865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7724d-c9a1-4933-aa02-af0a7d52680a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:49.608435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 126/241] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:49.614382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7724d-c9a1-4933-aa02-af0a7d52680a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:49.655164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d1466-e023-4623-9761-f8f993b66c54 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:49.671201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:49.694853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fab69-70d8-4074-92f6-fd1a749fda23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:49.694853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fab69-70d8-4074-92f6-fd1a749fda23 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:49.694853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fab69-70d8-4074-92f6-fd1a749fda23 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:49.694853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fab69-70d8-4074-92f6-fd1a749fda23 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:49.695264 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fab69-70d8-4074-92f6-fd1a749fda23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:49.695264 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fab69-70d8-4074-92f6-fd1a749fda23 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:49.702401 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:49.718415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 116/242] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:51:49 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 15:51:49.774444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7724d-c9a1-4933-aa02-af0a7d52680a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:49.824750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a32db-8223-4f91-a16b-57234c9f8787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:49.825571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a32db-8223-4f91-a16b-57234c9f8787 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:49.825849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a32db-8223-4f91-a16b-57234c9f8787 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:49.826122 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a32db-8223-4f91-a16b-57234c9f8787 None admin] PATH_INFO: `/v3/users/7723bb1838fa445aa6a4bd00c6bec0ab` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:49.849851 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a32db-8223-4f91-a16b-57234c9f8787 None admin] RBAC: Authorizing `identity:get_user(user_id=7723bb1838fa445aa6a4bd00c6bec0ab)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:49.851469 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a32db-8223-4f91-a16b-57234c9f8787 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:49.853254 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 127/243] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:49 2022] GET /identity/v3/users/7723bb1838fa445aa6a4bd00c6bec0ab => generated 297 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:49.859362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fab69-70d8-4074-92f6-fd1a749fda23 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:49.985118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fab69-70d8-4074-92f6-fd1a749fda23 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:50.029925 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c80c3d-dfb4-4f33-a877-b8273b481f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:50.030535 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c80c3d-dfb4-4f33-a877-b8273b481f3e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:50.030876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c80c3d-dfb4-4f33-a877-b8273b481f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:50.031121 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c80c3d-dfb4-4f33-a877-b8273b481f3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:50.099299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:50.106898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c80c3d-dfb4-4f33-a877-b8273b481f3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:50.108422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c80c3d-dfb4-4f33-a877-b8273b481f3e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:50.211241 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 117/244] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:51:50.216813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a32db-8223-4f91-a16b-57234c9f8787 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:50.270223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3babda5-0894-4186-95e8-0d976fef2214 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:50.270940 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3babda5-0894-4186-95e8-0d976fef2214 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:50.271423 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3babda5-0894-4186-95e8-0d976fef2214 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:50.273009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 118/245] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:51:50.278250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1466fef-b919-44ae-b835-c873f192ad61 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:50.278841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1466fef-b919-44ae-b835-c873f192ad61 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:50.279317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1466fef-b919-44ae-b835-c873f192ad61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:50.301845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f1466fef-b919-44ae-b835-c873f192ad61 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:50.303388 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f1466fef-b919-44ae-b835-c873f192ad61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:50.312705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:50.330686 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a32db-8223-4f91-a16b-57234c9f8787 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:50.366925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cb4d4-23da-4ed7-8c71-740fa3247202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:50.368224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cb4d4-23da-4ed7-8c71-740fa3247202 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:50.368708 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cb4d4-23da-4ed7-8c71-740fa3247202 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:50.369202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445cb4d4-23da-4ed7-8c71-740fa3247202 None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:50.370695 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445cb4d4-23da-4ed7-8c71-740fa3247202 None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:50.372487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445cb4d4-23da-4ed7-8c71-740fa3247202 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:50.374928 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 128/246] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:50 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:50.381139 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cb4d4-23da-4ed7-8c71-740fa3247202 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:50.386627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 119/247] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:50.411965 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1466fef-b919-44ae-b835-c873f192ad61 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:50.462232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:50.556537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445cb4d4-23da-4ed7-8c71-740fa3247202 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:50.611128 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1466fef-b919-44ae-b835-c873f192ad61 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:50.621214 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af6c68-7654-4d65-92af-10c192052a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:50.622258 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af6c68-7654-4d65-92af-10c192052a2b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:50.622751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af6c68-7654-4d65-92af-10c192052a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:50.623056 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af6c68-7654-4d65-92af-10c192052a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:50.623911 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af6c68-7654-4d65-92af-10c192052a2b None admin] RBAC: Adding query filter params (role.id=6256bf6008374f439ed55b6faad17124, scope.project.id=e69f0e40da80459cb7b997f21995950a, user.id=7723bb1838fa445aa6a4bd00c6bec0ab) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:50.624224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af6c68-7654-4d65-92af-10c192052a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:50.625692 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af6c68-7654-4d65-92af-10c192052a2b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:50.640904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 129/248] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:50 2022] GET /identity/v3/role_assignments?user.id=7723bb1838fa445aa6a4bd00c6bec0ab&scope.project.id=e69f0e40da80459cb7b997f21995950a&role.id=6256bf6008374f439ed55b6faad17124 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:50.657242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306af236-c9ab-47bc-9885-d0ddc948b3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:50.658467 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306af236-c9ab-47bc-9885-d0ddc948b3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:50.658987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306af236-c9ab-47bc-9885-d0ddc948b3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:50.659650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306af236-c9ab-47bc-9885-d0ddc948b3f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:50.673337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306af236-c9ab-47bc-9885-d0ddc948b3f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-306af236-c9ab-47bc-9885-d0ddc948b3f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:50.681935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:50.682950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:50.683720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:50.683720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:50.683720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:50.683720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:50.683720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:50.683720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:50.683720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:50.683720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:50.683720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:50.683720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:50.683720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:50.683720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:50.686596 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 120/249] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:50.692458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af6c68-7654-4d65-92af-10c192052a2b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:50.733074 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:50.859078 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af6c68-7654-4d65-92af-10c192052a2b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:50.904533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c243a04-e075-4d42-839b-3f1f4d3638fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:50.905237 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243a04-e075-4d42-839b-3f1f4d3638fe None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:50.905513 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243a04-e075-4d42-839b-3f1f4d3638fe None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:50.905784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c243a04-e075-4d42-839b-3f1f4d3638fe None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:50.906553 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c243a04-e075-4d42-839b-3f1f4d3638fe None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:50.906881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c243a04-e075-4d42-839b-3f1f4d3638fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:50.908442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c243a04-e075-4d42-839b-3f1f4d3638fe None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:50.923132 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 130/250] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:50.926409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306af236-c9ab-47bc-9885-d0ddc948b3f8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:51.055965 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:51.082610 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306af236-c9ab-47bc-9885-d0ddc948b3f8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:51.141064 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57019793-a246-426b-b9a5-dc25333f8f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:51.141886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57019793-a246-426b-b9a5-dc25333f8f59 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:51.142170 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57019793-a246-426b-b9a5-dc25333f8f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:51.142441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57019793-a246-426b-b9a5-dc25333f8f59 None admin] PATH_INFO: `/v3/users/8ec738de3eb44cc3afc6a55e0b684941` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:51.143806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57019793-a246-426b-b9a5-dc25333f8f59 None admin] RBAC: Authorizing `identity:get_user(user_id=8ec738de3eb44cc3afc6a55e0b684941)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:51.145348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57019793-a246-426b-b9a5-dc25333f8f59 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:51.147375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 121/251] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:50 2022] GET /identity/v3/users/8ec738de3eb44cc3afc6a55e0b684941 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:51.156015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c243a04-e075-4d42-839b-3f1f4d3638fe None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:51.290260 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:51.302458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb288b37-a250-42db-af0a-111c47468a00 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:51.302777 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb288b37-a250-42db-af0a-111c47468a00 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:51.303324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb288b37-a250-42db-af0a-111c47468a00 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:51.307043 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 122/252] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:51.311912 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a591dd-384b-42ab-b355-d9d36f969593 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:51.312466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a591dd-384b-42ab-b355-d9d36f969593 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:51.312985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a591dd-384b-42ab-b355-d9d36f969593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:51.321129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c243a04-e075-4d42-839b-3f1f4d3638fe None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:51.347978 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-28a591dd-384b-42ab-b355-d9d36f969593 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:51.349587 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-28a591dd-384b-42ab-b355-d9d36f969593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:51.402459 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac36819-2f0c-4cec-8920-def9cb5ed92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:51.403442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac36819-2f0c-4cec-8920-def9cb5ed92a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:51.403786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac36819-2f0c-4cec-8920-def9cb5ed92a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:51.404081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac36819-2f0c-4cec-8920-def9cb5ed92a None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:51.405515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac36819-2f0c-4cec-8920-def9cb5ed92a None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:51.407035 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac36819-2f0c-4cec-8920-def9cb5ed92a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:51.408826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 131/253] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:51 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:51.410149 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298d2f5-1aaa-4197-9665-78205e948553 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:51.410436 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298d2f5-1aaa-4197-9665-78205e948553 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:51.410717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298d2f5-1aaa-4197-9665-78205e948553 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:51.422965 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 132/254] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:51.422965 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298d2f5-1aaa-4197-9665-78205e948553 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:51.448419 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 123/255] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:51.449755 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db07d6-b830-4d4d-bc6f-38bb71a652cf None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:51.450040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db07d6-b830-4d4d-bc6f-38bb71a652cf None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:51.450311 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db07d6-b830-4d4d-bc6f-38bb71a652cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:51.488098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b3db07d6-b830-4d4d-bc6f-38bb71a652cf None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:51.489672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b3db07d6-b830-4d4d-bc6f-38bb71a652cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:51.589537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298d2f5-1aaa-4197-9665-78205e948553 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:51.627690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7816c-9845-41cf-a900-e7906d947a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:51.628674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7816c-9845-41cf-a900-e7906d947a4f None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:51.628951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7816c-9845-41cf-a900-e7906d947a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:51.629226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7816c-9845-41cf-a900-e7906d947a4f None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a/users/8ec738de3eb44cc3afc6a55e0b684941/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:51.632909 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7816c-9845-41cf-a900-e7906d947a4f None admin] RBAC: Authorizing `identity:create_grant(project_id=e69f0e40da80459cb7b997f21995950a, user_id=8ec738de3eb44cc3afc6a55e0b684941, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:51.634372 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7816c-9845-41cf-a900-e7906d947a4f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:51.643789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 124/256] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:51.644694 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db07d6-b830-4d4d-bc6f-38bb71a652cf None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:51.661192 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 133/257] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:51:51 2022] PUT /identity/v3/projects/e69f0e40da80459cb7b997f21995950a/users/8ec738de3eb44cc3afc6a55e0b684941/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:51:51.670851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:51.692919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7816c-9845-41cf-a900-e7906d947a4f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:51.705429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:51.865654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7816c-9845-41cf-a900-e7906d947a4f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:51.881305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db07d6-b830-4d4d-bc6f-38bb71a652cf None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:51.948821 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af020efd-0609-49e6-adcd-5b8e1f5d6d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:51.950087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af020efd-0609-49e6-adcd-5b8e1f5d6d7c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:51.950565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af020efd-0609-49e6-adcd-5b8e1f5d6d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:51.951062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af020efd-0609-49e6-adcd-5b8e1f5d6d7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:51.963095 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94f7c8-e250-4f11-b50b-70870a4ade31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:51.963916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94f7c8-e250-4f11-b50b-70870a4ade31 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:51.964202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94f7c8-e250-4f11-b50b-70870a4ade31 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:51.964476 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94f7c8-e250-4f11-b50b-70870a4ade31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:51.971511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af020efd-0609-49e6-adcd-5b8e1f5d6d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-af020efd-0609-49e6-adcd-5b8e1f5d6d7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:51.979844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:51.980739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:51.981672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:51.981672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:51.981672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:51.981672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:51.981672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:51.981672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:51.981672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:51.981672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:51.981672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:51.981672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:51.981672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:51:51.981672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:51.981672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 134/258] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:51:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:51:51.989789 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af020efd-0609-49e6-adcd-5b8e1f5d6d7c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:51.994173 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94f7c8-e250-4f11-b50b-70870a4ade31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9c94f7c8-e250-4f11-b50b-70870a4ade31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:52.002448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:52.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:52.004247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:52.004247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:52.004247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:52.004247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:52.004247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:52.004247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:52.004247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:52.004247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:52.004247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:52.004247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:52.004247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:51:52.004247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:52.007835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 125/259] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:51:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:52.017651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94f7c8-e250-4f11-b50b-70870a4ade31 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:52.093855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:52.133695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:52.144212 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af020efd-0609-49e6-adcd-5b8e1f5d6d7c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:52.170155 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94f7c8-e250-4f11-b50b-70870a4ade31 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:52.206471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c2ee4-3d8a-4b7a-b70c-be39ff38cf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:52.207545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c2ee4-3d8a-4b7a-b70c-be39ff38cf4b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:52.214840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c2ee4-3d8a-4b7a-b70c-be39ff38cf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:52.214982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baefc2b-9b14-4c8e-8131-44b9fd80a24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:52.214982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baefc2b-9b14-4c8e-8131-44b9fd80a24c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:52.214982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baefc2b-9b14-4c8e-8131-44b9fd80a24c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:52.214982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baefc2b-9b14-4c8e-8131-44b9fd80a24c None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:52.215264 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baefc2b-9b14-4c8e-8131-44b9fd80a24c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:52.215264 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baefc2b-9b14-4c8e-8131-44b9fd80a24c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:52.216075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c2ee4-3d8a-4b7a-b70c-be39ff38cf4b None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:52.217104 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c2ee4-3d8a-4b7a-b70c-be39ff38cf4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:52.217623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c2ee4-3d8a-4b7a-b70c-be39ff38cf4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:52.219319 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c2ee4-3d8a-4b7a-b70c-be39ff38cf4b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:52.234846 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baefc2b-9b14-4c8e-8131-44b9fd80a24c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:52.237909 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 135/260] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:51:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:52.241874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 126/261] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:52.247060 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baefc2b-9b14-4c8e-8131-44b9fd80a24c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:52.248254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c2ee4-3d8a-4b7a-b70c-be39ff38cf4b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:52.424626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baefc2b-9b14-4c8e-8131-44b9fd80a24c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:52.438841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c2ee4-3d8a-4b7a-b70c-be39ff38cf4b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:52.480012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c927e94-4fcc-453d-9350-7fe25df581ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:52.481149 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c927e94-4fcc-453d-9350-7fe25df581ae None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:52.481570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c927e94-4fcc-453d-9350-7fe25df581ae None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:52.482000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c927e94-4fcc-453d-9350-7fe25df581ae None admin] PATH_INFO: `/v3/users/f23c15c5ec264e40a69e6401643a77e7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:52.483419 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c927e94-4fcc-453d-9350-7fe25df581ae None admin] RBAC: Authorizing `identity:get_user(user_id=f23c15c5ec264e40a69e6401643a77e7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:52.485625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c927e94-4fcc-453d-9350-7fe25df581ae None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:52.487991 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 127/262] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:52 2022] GET /identity/v3/users/f23c15c5ec264e40a69e6401643a77e7 => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:52.495253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c927e94-4fcc-453d-9350-7fe25df581ae None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:52.501439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:52.501960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:52.517083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384e7e7-c9bc-476b-9650-4f38a7c38bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:52.518001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384e7e7-c9bc-476b-9650-4f38a7c38bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:52.518312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384e7e7-c9bc-476b-9650-4f38a7c38bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:52.518649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384e7e7-c9bc-476b-9650-4f38a7c38bf7 None admin] PATH_INFO: `/v3/users/f23c15c5ec264e40a69e6401643a77e7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:52.520007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384e7e7-c9bc-476b-9650-4f38a7c38bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=f23c15c5ec264e40a69e6401643a77e7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:52.521592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384e7e7-c9bc-476b-9650-4f38a7c38bf7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:52.523373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 136/263] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:52 2022] GET /identity/v3/users/f23c15c5ec264e40a69e6401643a77e7 => generated 283 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:52.531801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384e7e7-c9bc-476b-9650-4f38a7c38bf7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:52.729667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384e7e7-c9bc-476b-9650-4f38a7c38bf7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:52.738783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c927e94-4fcc-453d-9350-7fe25df581ae None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:52.822802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24dcef1-de9b-4428-b5dc-23c164648fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:52.823604 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dcef1-de9b-4428-b5dc-23c164648fbc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:52.823989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dcef1-de9b-4428-b5dc-23c164648fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:52.824358 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dcef1-de9b-4428-b5dc-23c164648fbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:52.828910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857b4ae-decd-4cef-ac16-d15278a30c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:52.829582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857b4ae-decd-4cef-ac16-d15278a30c1c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:52.829862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857b4ae-decd-4cef-ac16-d15278a30c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:52.830143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857b4ae-decd-4cef-ac16-d15278a30c1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:52.991838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:52.992167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857b4ae-decd-4cef-ac16-d15278a30c1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:52.993582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857b4ae-decd-4cef-ac16-d15278a30c1c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:52.996927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:52.999886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24dcef1-de9b-4428-b5dc-23c164648fbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:53.003130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24dcef1-de9b-4428-b5dc-23c164648fbc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:53.180183 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 128/264] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:51:53.184959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857b4ae-decd-4cef-ac16-d15278a30c1c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:53.189687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 137/265] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:51:53.199680 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24dcef1-de9b-4428-b5dc-23c164648fbc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:53.324416 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:53.330942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24dcef1-de9b-4428-b5dc-23c164648fbc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:53.388941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857b4ae-decd-4cef-ac16-d15278a30c1c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:53.392543 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:53.408363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba9f4c-6300-4fbd-b187-250097993946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:53.409329 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba9f4c-6300-4fbd-b187-250097993946 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:53.412035 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba9f4c-6300-4fbd-b187-250097993946 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:53.412329 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba9f4c-6300-4fbd-b187-250097993946 None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:53.413921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba9f4c-6300-4fbd-b187-250097993946 None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:53.415698 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba9f4c-6300-4fbd-b187-250097993946 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:53.417435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 138/266] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:53 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:53.427461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105523c3-b12b-40dd-ae79-4f1eb9171d51 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:53.428057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105523c3-b12b-40dd-ae79-4f1eb9171d51 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:53.428057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105523c3-b12b-40dd-ae79-4f1eb9171d51 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:53.429324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 139/267] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:53 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:53.431446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105523c3-b12b-40dd-ae79-4f1eb9171d51 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:53.456859 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897c23a-6768-46ed-980c-c4b7cdad9637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:53.457822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897c23a-6768-46ed-980c-c4b7cdad9637 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:53.458106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897c23a-6768-46ed-980c-c4b7cdad9637 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:53.458457 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897c23a-6768-46ed-980c-c4b7cdad9637 None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:53.460057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897c23a-6768-46ed-980c-c4b7cdad9637 None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:53.461527 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897c23a-6768-46ed-980c-c4b7cdad9637 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:53.466016 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 129/268] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:53 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:53.469000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2372ac9-1f0e-4d65-bda1-321fca6264f8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:53.469282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2372ac9-1f0e-4d65-bda1-321fca6264f8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:53.469556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2372ac9-1f0e-4d65-bda1-321fca6264f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:53.499815 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c2372ac9-1f0e-4d65-bda1-321fca6264f8 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:53.501421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c2372ac9-1f0e-4d65-bda1-321fca6264f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:53.589484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105523c3-b12b-40dd-ae79-4f1eb9171d51 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:53.596928 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 130/269] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:53.598034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2372ac9-1f0e-4d65-bda1-321fca6264f8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:53.644360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabac4e-ba67-40f9-bae5-c45c659f0f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:53.646103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabac4e-ba67-40f9-bae5-c45c659f0f24 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:53.646387 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabac4e-ba67-40f9-bae5-c45c659f0f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:53.646660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabac4e-ba67-40f9-bae5-c45c659f0f24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:53.647889 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabac4e-ba67-40f9-bae5-c45c659f0f24 None admin] RBAC: Adding query filter params (role.id=e9dc595c6b4248d3b5262b70a90e76c5, scope.project.id=e69f0e40da80459cb7b997f21995950a, user.id=f23c15c5ec264e40a69e6401643a77e7) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:53.648462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabac4e-ba67-40f9-bae5-c45c659f0f24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:53.651323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabac4e-ba67-40f9-bae5-c45c659f0f24 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:53.661821 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 140/270] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:53 2022] GET /identity/v3/role_assignments?user.id=f23c15c5ec264e40a69e6401643a77e7&scope.project.id=e69f0e40da80459cb7b997f21995950a&role.id=e9dc595c6b4248d3b5262b70a90e76c5 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:53.663363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf704b5-a82f-44e8-a681-0609ac2551ca None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:53.663647 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf704b5-a82f-44e8-a681-0609ac2551ca None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:53.664344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf704b5-a82f-44e8-a681-0609ac2551ca None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:53.665663 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 141/271] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:53.666502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf704b5-a82f-44e8-a681-0609ac2551ca None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:53.707301 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:53.759686 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:53.763352 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2372ac9-1f0e-4d65-bda1-321fca6264f8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:53.805396 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef459ad6-cd77-413e-b044-d074e374a5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:53.806323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef459ad6-cd77-413e-b044-d074e374a5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:53.806765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef459ad6-cd77-413e-b044-d074e374a5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:53.807157 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef459ad6-cd77-413e-b044-d074e374a5b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:53.808104 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef459ad6-cd77-413e-b044-d074e374a5b5 None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=e69f0e40da80459cb7b997f21995950a, user.id=f23c15c5ec264e40a69e6401643a77e7) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:53.808489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef459ad6-cd77-413e-b044-d074e374a5b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:53.810294 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef459ad6-cd77-413e-b044-d074e374a5b5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:53.817938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 131/272] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:53 2022] GET /identity/v3/role_assignments?user.id=f23c15c5ec264e40a69e6401643a77e7&scope.project.id=e69f0e40da80459cb7b997f21995950a&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:53.819005 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf704b5-a82f-44e8-a681-0609ac2551ca None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:53.819339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5a9a7-51cc-4f02-9bf2-8876cc681bc5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:53.819690 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5a9a7-51cc-4f02-9bf2-8876cc681bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:53.820025 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f5a9a7-51cc-4f02-9bf2-8876cc681bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:53.853336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-11f5a9a7-51cc-4f02-9bf2-8876cc681bc5 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:53.856545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-11f5a9a7-51cc-4f02-9bf2-8876cc681bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:53.884151 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7844c-ec2c-4a1d-970e-79ed899c2bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:53.885001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7844c-ec2c-4a1d-970e-79ed899c2bac None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:53.885285 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7844c-ec2c-4a1d-970e-79ed899c2bac None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:53.885564 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7844c-ec2c-4a1d-970e-79ed899c2bac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:53.902423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7844c-ec2c-4a1d-970e-79ed899c2bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-17b7844c-ec2c-4a1d-970e-79ed899c2bac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:53.911087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:53.912051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:53.912830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:53.912830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:53.912830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:53.912830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:53.912830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:53.912830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:53.912830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:53.912830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:53.912830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:53.912830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:53.912830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:53.912830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:53.912830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 142/273] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:53.913991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0b9e7-f503-4453-a866-dd63f88c3871 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:53.914152 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0b9e7-f503-4453-a866-dd63f88c3871 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:53.918861 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0b9e7-f503-4453-a866-dd63f88c3871 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:53.920656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 143/274] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:53.922826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0b9e7-f503-4453-a866-dd63f88c3871 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:53.945841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 132/275] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:53.947282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336aa34-3420-4076-bae7-205bd792cafb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:53.947565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336aa34-3420-4076-bae7-205bd792cafb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:53.947840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336aa34-3420-4076-bae7-205bd792cafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:53.966992 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6336aa34-3420-4076-bae7-205bd792cafb None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:53.968215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6336aa34-3420-4076-bae7-205bd792cafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:54.032509 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:54.045505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0b9e7-f503-4453-a866-dd63f88c3871 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:54.053993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 133/276] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:54.057551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336aa34-3420-4076-bae7-205bd792cafb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:54.087291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eff441-fd0b-4b8b-a694-60b035de0ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:54.088009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eff441-fd0b-4b8b-a694-60b035de0ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:54.088318 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eff441-fd0b-4b8b-a694-60b035de0ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:54.088613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eff441-fd0b-4b8b-a694-60b035de0ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:54.089436 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eff441-fd0b-4b8b-a694-60b035de0ef6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:54.089767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eff441-fd0b-4b8b-a694-60b035de0ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:54.090879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:54.093475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eff441-fd0b-4b8b-a694-60b035de0ef6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:54.106598 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 144/277] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:54.107503 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eff441-fd0b-4b8b-a694-60b035de0ef6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:54.208332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336aa34-3420-4076-bae7-205bd792cafb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:54.232180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eff441-fd0b-4b8b-a694-60b035de0ef6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:54.244154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da00fad-1745-4cc5-bf7b-6b11ad71ee94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:54.245307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da00fad-1745-4cc5-bf7b-6b11ad71ee94 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:54.245721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da00fad-1745-4cc5-bf7b-6b11ad71ee94 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:54.245980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da00fad-1745-4cc5-bf7b-6b11ad71ee94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:54.247247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da00fad-1745-4cc5-bf7b-6b11ad71ee94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:54.248711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da00fad-1745-4cc5-bf7b-6b11ad71ee94 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:54.250387 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 134/278] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:54.251255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da00fad-1745-4cc5-bf7b-6b11ad71ee94 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:54.271463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3161ef-5d35-48b1-9d9b-d0a215714032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:54.272280 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3161ef-5d35-48b1-9d9b-d0a215714032 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:54.272561 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3161ef-5d35-48b1-9d9b-d0a215714032 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:54.272833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3161ef-5d35-48b1-9d9b-d0a215714032 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:54.284346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3161ef-5d35-48b1-9d9b-d0a215714032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-9f3161ef-5d35-48b1-9d9b-d0a215714032 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:54.292844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:54.294027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:54.295642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:54.295642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:54.295642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:54.295642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:54.295642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:54.295642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:54.295642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:54.295642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:54.295642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:54.295642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:54.295642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:51:54.295642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:54.295642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 145/279] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:54.295642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3161ef-5d35-48b1-9d9b-d0a215714032 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:54.314553 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:54.352747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:54.362381 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da00fad-1745-4cc5-bf7b-6b11ad71ee94 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:54.395795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6279b4-bd48-42a8-9f2f-f8c5b9fc757d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:54.396680 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6279b4-bd48-42a8-9f2f-f8c5b9fc757d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:54.396953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6279b4-bd48-42a8-9f2f-f8c5b9fc757d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:54.397225 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6279b4-bd48-42a8-9f2f-f8c5b9fc757d None admin] PATH_INFO: `/v3/users/ea9b0bf0461f43e8aa9ada070ede239c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:54.400937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3161ef-5d35-48b1-9d9b-d0a215714032 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:54.410414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6279b4-bd48-42a8-9f2f-f8c5b9fc757d None admin] RBAC: Authorizing `identity:get_user(user_id=ea9b0bf0461f43e8aa9ada070ede239c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:54.411938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6279b4-bd48-42a8-9f2f-f8c5b9fc757d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:54.413639 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 135/280] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:54 2022] GET /identity/v3/users/ea9b0bf0461f43e8aa9ada070ede239c => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:54.414517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6279b4-bd48-42a8-9f2f-f8c5b9fc757d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:54.437111 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423d174-c676-492b-a27a-a0024a11af17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:54.437795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423d174-c676-492b-a27a-a0024a11af17 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:54.438080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423d174-c676-492b-a27a-a0024a11af17 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:54.438340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423d174-c676-492b-a27a-a0024a11af17 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:54.439082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423d174-c676-492b-a27a-a0024a11af17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:54.440697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423d174-c676-492b-a27a-a0024a11af17 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:54.461244 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 146/281] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:51:54 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:51:54.462574 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d3c3f-9b74-4030-9bea-776be9205048 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:54.462883 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d3c3f-9b74-4030-9bea-776be9205048 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:54.463394 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d3c3f-9b74-4030-9bea-776be9205048 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:54.464439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 147/282] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:54.465196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d3c3f-9b74-4030-9bea-776be9205048 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:54.544679 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6279b4-bd48-42a8-9f2f-f8c5b9fc757d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:54.553621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:54.588605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add09385-ef85-463b-87be-f225c1e8f9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:54.590650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add09385-ef85-463b-87be-f225c1e8f9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:54.591256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add09385-ef85-463b-87be-f225c1e8f9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:54.591525 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add09385-ef85-463b-87be-f225c1e8f9f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:54.592360 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add09385-ef85-463b-87be-f225c1e8f9f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:54.592678 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add09385-ef85-463b-87be-f225c1e8f9f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:54.594160 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add09385-ef85-463b-87be-f225c1e8f9f8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:54.598101 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d3c3f-9b74-4030-9bea-776be9205048 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:54.604993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 136/283] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:54.606232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95b158-5e7f-4985-b0c1-d90d39e44d9a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:54.606528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95b158-5e7f-4985-b0c1-d90d39e44d9a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:54.606807 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95b158-5e7f-4985-b0c1-d90d39e44d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:54.627023 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3e95b158-5e7f-4985-b0c1-d90d39e44d9a None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:54.628269 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3e95b158-5e7f-4985-b0c1-d90d39e44d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:54.637664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:54.643099 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470d8d7-2e5b-4b95-b5a2-4c4f4bb3eebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:54.643991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470d8d7-2e5b-4b95-b5a2-4c4f4bb3eebc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:54.644098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470d8d7-2e5b-4b95-b5a2-4c4f4bb3eebc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:54.644348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470d8d7-2e5b-4b95-b5a2-4c4f4bb3eebc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:54.645198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470d8d7-2e5b-4b95-b5a2-4c4f4bb3eebc None admin] RBAC: Adding query filter params (role.id=64e044de7dcc4949acf8ce7eaf08fdaa, user.id=ea9b0bf0461f43e8aa9ada070ede239c, scope.system=all) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:54.645509 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470d8d7-2e5b-4b95-b5a2-4c4f4bb3eebc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:54.647655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470d8d7-2e5b-4b95-b5a2-4c4f4bb3eebc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:54.653461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 148/284] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 21 15:51:54 2022] GET /identity/v3/role_assignments?user.id=ea9b0bf0461f43e8aa9ada070ede239c&scope.system=all&role.id=64e044de7dcc4949acf8ce7eaf08fdaa => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:54.660037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470d8d7-2e5b-4b95-b5a2-4c4f4bb3eebc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:54.725284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 137/285] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:54.750129 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95b158-5e7f-4985-b0c1-d90d39e44d9a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:54.804115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470d8d7-2e5b-4b95-b5a2-4c4f4bb3eebc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:54.849553 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:54.852897 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea99978-d3a9-4124-97f5-0b4bcc1c0937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:54.854112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea99978-d3a9-4124-97f5-0b4bcc1c0937 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:54.854605 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea99978-d3a9-4124-97f5-0b4bcc1c0937 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:54.855153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea99978-d3a9-4124-97f5-0b4bcc1c0937 None admin] PATH_INFO: `/v3/users/7723bb1838fa445aa6a4bd00c6bec0ab` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:54.857055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea99978-d3a9-4124-97f5-0b4bcc1c0937 None admin] RBAC: Authorizing `identity:get_user(user_id=7723bb1838fa445aa6a4bd00c6bec0ab)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:54.859060 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea99978-d3a9-4124-97f5-0b4bcc1c0937 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:54.861245 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 149/286] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:54 2022] GET /identity/v3/users/7723bb1838fa445aa6a4bd00c6bec0ab => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:54.868605 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea99978-d3a9-4124-97f5-0b4bcc1c0937 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:54.901075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95b158-5e7f-4985-b0c1-d90d39e44d9a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:54.959313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c3b64-aff9-49df-a170-c3584c46059e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:54.960442 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c3b64-aff9-49df-a170-c3584c46059e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:54.960670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c3b64-aff9-49df-a170-c3584c46059e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:54.960946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c3b64-aff9-49df-a170-c3584c46059e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:54.987715 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c3b64-aff9-49df-a170-c3584c46059e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-df2c3b64-aff9-49df-a170-c3584c46059e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:55.005706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:55.006664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:55.007503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:55.007503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:55.007503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:55.007503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:55.007503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:55.007503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:55.007503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:55.007503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:55.007503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:55.007503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:55.007503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:55.007503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:55.009834 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 138/287] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:55.014151 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c3b64-aff9-49df-a170-c3584c46059e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:55.019024 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:55.040962 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea99978-d3a9-4124-97f5-0b4bcc1c0937 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:55.116246 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c2923-1d7b-4212-aa02-ae496d9621be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:55.117148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c2923-1d7b-4212-aa02-ae496d9621be None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:55.117429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c2923-1d7b-4212-aa02-ae496d9621be None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:55.117705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c2923-1d7b-4212-aa02-ae496d9621be None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:55.119555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c2923-1d7b-4212-aa02-ae496d9621be None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:55.121664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c2923-1d7b-4212-aa02-ae496d9621be None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:55.125367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 150/288] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:54 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:51:55.130303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c2923-1d7b-4212-aa02-ae496d9621be None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:55.228860 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c3b64-aff9-49df-a170-c3584c46059e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:55.248269 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:55.272225 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e939a77-8f71-4512-b730-985390735d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:55.273180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e939a77-8f71-4512-b730-985390735d90 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:55.273462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e939a77-8f71-4512-b730-985390735d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:55.273736 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e939a77-8f71-4512-b730-985390735d90 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:55.274509 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e939a77-8f71-4512-b730-985390735d90 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:55.274614 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c2923-1d7b-4212-aa02-ae496d9621be None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:55.274850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e939a77-8f71-4512-b730-985390735d90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:55.276552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e939a77-8f71-4512-b730-985390735d90 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:55.293238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 139/289] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:55.298679 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e939a77-8f71-4512-b730-985390735d90 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:55.336497 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3ade8-44c1-4886-8694-c7f4bbc04dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:55.337475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3ade8-44c1-4886-8694-c7f4bbc04dae None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:55.337758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3ade8-44c1-4886-8694-c7f4bbc04dae None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:55.338086 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3ade8-44c1-4886-8694-c7f4bbc04dae None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a/users/7723bb1838fa445aa6a4bd00c6bec0ab/roles/6256bf6008374f439ed55b6faad17124` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:55.340249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3ade8-44c1-4886-8694-c7f4bbc04dae None admin] RBAC: Authorizing `identity:create_grant(project_id=e69f0e40da80459cb7b997f21995950a, user_id=7723bb1838fa445aa6a4bd00c6bec0ab, role_id=6256bf6008374f439ed55b6faad17124)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:55.341707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3ade8-44c1-4886-8694-c7f4bbc04dae None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:55.358010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 151/290] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:51:55 2022] PUT /identity/v3/projects/e69f0e40da80459cb7b997f21995950a/users/7723bb1838fa445aa6a4bd00c6bec0ab/roles/6256bf6008374f439ed55b6faad17124 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:51:55.414508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:55.459269 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e939a77-8f71-4512-b730-985390735d90 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:55.498171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990821e-696d-45ef-9959-c1ec6c8f982a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:55.499134 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990821e-696d-45ef-9959-c1ec6c8f982a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:55.499419 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990821e-696d-45ef-9959-c1ec6c8f982a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:55.499693 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990821e-696d-45ef-9959-c1ec6c8f982a None admin] PATH_INFO: `/v3/users/8ec738de3eb44cc3afc6a55e0b684941` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:55.501020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990821e-696d-45ef-9959-c1ec6c8f982a None admin] RBAC: Authorizing `identity:get_user(user_id=8ec738de3eb44cc3afc6a55e0b684941)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:55.502555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990821e-696d-45ef-9959-c1ec6c8f982a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:55.504778 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 140/291] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:55 2022] GET /identity/v3/users/8ec738de3eb44cc3afc6a55e0b684941 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:55.510597 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3ade8-44c1-4886-8694-c7f4bbc04dae None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:55.635715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3ade8-44c1-4886-8694-c7f4bbc04dae None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:55.665959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:55.674154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c77414-a397-4a2b-9eb6-803fd00491e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:55.675259 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c77414-a397-4a2b-9eb6-803fd00491e4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:55.675765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c77414-a397-4a2b-9eb6-803fd00491e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:55.676249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c77414-a397-4a2b-9eb6-803fd00491e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:55.760975 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c77414-a397-4a2b-9eb6-803fd00491e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:55.762836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c77414-a397-4a2b-9eb6-803fd00491e4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:55.892492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 152/292] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:51:55.898508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990821e-696d-45ef-9959-c1ec6c8f982a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:56.006708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990821e-696d-45ef-9959-c1ec6c8f982a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:56.039316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:56.044762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd2b98-ca77-49c0-8073-35b731a2b57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:56.045866 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd2b98-ca77-49c0-8073-35b731a2b57d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:56.046314 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd2b98-ca77-49c0-8073-35b731a2b57d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:56.046753 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd2b98-ca77-49c0-8073-35b731a2b57d None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:56.048258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd2b98-ca77-49c0-8073-35b731a2b57d None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:56.049917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd2b98-ca77-49c0-8073-35b731a2b57d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:56.051743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 141/293] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:55 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:56.058140 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c77414-a397-4a2b-9eb6-803fd00491e4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:56.086851 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:56.168309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c77414-a397-4a2b-9eb6-803fd00491e4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:56.217799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c481449c-8e24-4c2a-a024-cd79dfc6dc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:56.218481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481449c-8e24-4c2a-a024-cd79dfc6dc26 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:56.218765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481449c-8e24-4c2a-a024-cd79dfc6dc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:56.219105 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c481449c-8e24-4c2a-a024-cd79dfc6dc26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:56.219962 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481449c-8e24-4c2a-a024-cd79dfc6dc26 None admin] RBAC: Adding query filter params (role.id=64e044de7dcc4949acf8ce7eaf08fdaa, scope.project.id=e69f0e40da80459cb7b997f21995950a, user.id=8ec738de3eb44cc3afc6a55e0b684941) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:56.220279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481449c-8e24-4c2a-a024-cd79dfc6dc26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:56.221764 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c481449c-8e24-4c2a-a024-cd79dfc6dc26 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:56.228160 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 153/294] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:56 2022] GET /identity/v3/role_assignments?user.id=8ec738de3eb44cc3afc6a55e0b684941&scope.project.id=e69f0e40da80459cb7b997f21995950a&role.id=64e044de7dcc4949acf8ce7eaf08fdaa => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:56.973561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28544880-64b6-4aa2-8c00-ad2dba2e7958 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:56.974311 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28544880-64b6-4aa2-8c00-ad2dba2e7958 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:56.974311 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28544880-64b6-4aa2-8c00-ad2dba2e7958 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:56.975821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 142/295] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:56.981715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337c095-8c45-4cf9-aec2-c54280096c0f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:56.982345 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337c095-8c45-4cf9-aec2-c54280096c0f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:56.982345 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2337c095-8c45-4cf9-aec2-c54280096c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:57.000475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2337c095-8c45-4cf9-aec2-c54280096c0f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:57.001762 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2337c095-8c45-4cf9-aec2-c54280096c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:57.071661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 154/296] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:57.089047 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8530dee-5b12-4567-ad62-4ab27725188c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:57.089364 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8530dee-5b12-4567-ad62-4ab27725188c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:57.089602 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8530dee-5b12-4567-ad62-4ab27725188c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:57.091363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 143/297] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:57.096272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337c095-8c45-4cf9-aec2-c54280096c0f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:57.096584 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71266d9f-fe71-4295-a649-450af638a7ef None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:57.096925 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71266d9f-fe71-4295-a649-450af638a7ef None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:57.097207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71266d9f-fe71-4295-a649-450af638a7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:57.118925 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-71266d9f-fe71-4295-a649-450af638a7ef None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:57.120131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-71266d9f-fe71-4295-a649-450af638a7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:57.125279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:57.205300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 144/298] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:51:57.207542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36538c1-3d69-401e-aa93-422967900694 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:57.208051 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36538c1-3d69-401e-aa93-422967900694 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:57.208746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36538c1-3d69-401e-aa93-422967900694 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:57.210341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 145/299] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:57.216567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b1bb8-0d35-4d90-a894-32d0668dec64 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:57.217292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b1bb8-0d35-4d90-a894-32d0668dec64 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:57.218236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b1bb8-0d35-4d90-a894-32d0668dec64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:57.228129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2337c095-8c45-4cf9-aec2-c54280096c0f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:57.241257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2a0b1bb8-0d35-4d90-a894-32d0668dec64 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:57.242462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2a0b1bb8-0d35-4d90-a894-32d0668dec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:57.264988 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d0bc4-ad06-41ec-9a93-0b46a2ef42c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:57.266015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d0bc4-ad06-41ec-9a93-0b46a2ef42c7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:57.266305 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d0bc4-ad06-41ec-9a93-0b46a2ef42c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:57.266581 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d0bc4-ad06-41ec-9a93-0b46a2ef42c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:57.278652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d0bc4-ad06-41ec-9a93-0b46a2ef42c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-372d0bc4-ad06-41ec-9a93-0b46a2ef42c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:57.287655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:57.288538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:57.289769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:57.289769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:57.289769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:57.289769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:57.289769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:57.289769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:57.289769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:57.289769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:57.289769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:57.289769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:57.289769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:51:57.289769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:57.289769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 155/300] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:57.290771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d0bc4-ad06-41ec-9a93-0b46a2ef42c7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:57.312902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 146/301] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:57.313750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b1bb8-0d35-4d90-a894-32d0668dec64 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:57.383737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:57.388113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:57.409081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d0bc4-ad06-41ec-9a93-0b46a2ef42c7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:57.426172 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b1bb8-0d35-4d90-a894-32d0668dec64 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:57.443713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ba55a-4779-439b-8ae2-79b616b02514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:57.444520 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ba55a-4779-439b-8ae2-79b616b02514 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:57.444796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ba55a-4779-439b-8ae2-79b616b02514 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:57.445066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ba55a-4779-439b-8ae2-79b616b02514 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:57.456440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ba55a-4779-439b-8ae2-79b616b02514 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:57.461438 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadea13-9644-4b6e-b5ae-cfe685fc9ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:57.462130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadea13-9644-4b6e-b5ae-cfe685fc9ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:57.462418 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadea13-9644-4b6e-b5ae-cfe685fc9ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:57.462702 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadea13-9644-4b6e-b5ae-cfe685fc9ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:57.463507 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadea13-9644-4b6e-b5ae-cfe685fc9ca2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:57.463821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadea13-9644-4b6e-b5ae-cfe685fc9ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-9b9ba55a-4779-439b-8ae2-79b616b02514 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:57.464462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:57.465290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:57.466100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:57.466100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:57.466100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:57.466100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:57.466100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:57.466100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:57.466100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:57.466100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:57.466100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:57.466100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:57.466100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:51:57.466100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:51:57.466692 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadea13-9644-4b6e-b5ae-cfe685fc9ca2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:57.466757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 156/302] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:57.466757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ba55a-4779-439b-8ae2-79b616b02514 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:57.480643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 147/303] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:57.481420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadea13-9644-4b6e-b5ae-cfe685fc9ca2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:57.581592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ba55a-4779-439b-8ae2-79b616b02514 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:57.589514 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadea13-9644-4b6e-b5ae-cfe685fc9ca2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:57.618730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e15db6-8c2a-4a41-9758-572a7401f05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:57.619933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:57.620113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15db6-8c2a-4a41-9758-572a7401f05a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:57.620523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15db6-8c2a-4a41-9758-572a7401f05a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:57.620994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e15db6-8c2a-4a41-9758-572a7401f05a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:57.623085 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e15db6-8c2a-4a41-9758-572a7401f05a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:57.624813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e15db6-8c2a-4a41-9758-572a7401f05a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:57.626887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 157/304] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:51:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:57.627704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e15db6-8c2a-4a41-9758-572a7401f05a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:57.640608 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370a169-3a83-4661-b4ae-c35e331ab062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:57.641429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:57.641898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370a169-3a83-4661-b4ae-c35e331ab062 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:57.642157 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370a169-3a83-4661-b4ae-c35e331ab062 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:57.642605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6370a169-3a83-4661-b4ae-c35e331ab062 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:57.643791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370a169-3a83-4661-b4ae-c35e331ab062 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:57.644275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370a169-3a83-4661-b4ae-c35e331ab062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:57.645839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6370a169-3a83-4661-b4ae-c35e331ab062 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:57.661412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 148/305] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:57.661412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370a169-3a83-4661-b4ae-c35e331ab062 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:57.736008 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e15db6-8c2a-4a41-9758-572a7401f05a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:57.769059 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6370a169-3a83-4661-b4ae-c35e331ab062 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:57.771344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37d1e7-73cc-4d58-9270-10b3176dc8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:57.772249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37d1e7-73cc-4d58-9270-10b3176dc8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:57.772535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37d1e7-73cc-4d58-9270-10b3176dc8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:57.772804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37d1e7-73cc-4d58-9270-10b3176dc8a6 None admin] PATH_INFO: `/v3/users/cc8df16e14b34431a9ade234afca2945` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:57.786621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37d1e7-73cc-4d58-9270-10b3176dc8a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cc8df16e14b34431a9ade234afca2945)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:57.788145 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37d1e7-73cc-4d58-9270-10b3176dc8a6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:57.790218 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 158/306] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:57 2022] GET /identity/v3/users/cc8df16e14b34431a9ade234afca2945 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:57.792016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37d1e7-73cc-4d58-9270-10b3176dc8a6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:57.805755 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcad64c-3918-4609-be22-59e9dc5fefe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:57.806442 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcad64c-3918-4609-be22-59e9dc5fefe7 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:57.806723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcad64c-3918-4609-be22-59e9dc5fefe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:57.807032 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcad64c-3918-4609-be22-59e9dc5fefe7 None admin] PATH_INFO: `/v3/groups` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:57.807731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcad64c-3918-4609-be22-59e9dc5fefe7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:57.809184 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcad64c-3918-4609-be22-59e9dc5fefe7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:57.824076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 149/307] 10.222.0.64 () {60 vars in 1134 bytes} [Thu Jul 21 15:51:57 2022] POST /identity/v3/groups => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:51:57.824903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcad64c-3918-4609-be22-59e9dc5fefe7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:57.890030 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:57.892458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:57.939274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37d1e7-73cc-4d58-9270-10b3176dc8a6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:57.962019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcad64c-3918-4609-be22-59e9dc5fefe7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:57.981091 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b477eb-d83f-44f7-b95e-6ed58489f52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:57.982011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b477eb-d83f-44f7-b95e-6ed58489f52d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:57.982573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b477eb-d83f-44f7-b95e-6ed58489f52d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:57.982573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b477eb-d83f-44f7-b95e-6ed58489f52d None admin] PATH_INFO: `/v3/users/ea9b0bf0461f43e8aa9ada070ede239c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:57.983887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b477eb-d83f-44f7-b95e-6ed58489f52d None admin] RBAC: Authorizing `identity:get_user(user_id=ea9b0bf0461f43e8aa9ada070ede239c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:57.985379 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b477eb-d83f-44f7-b95e-6ed58489f52d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:57.987218 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 159/308] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:57 2022] GET /identity/v3/users/ea9b0bf0461f43e8aa9ada070ede239c => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:57.988614 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c3544-bc9e-4974-bd0e-285d56b8369a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:57.988907 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c3544-bc9e-4974-bd0e-285d56b8369a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:57.989186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c3544-bc9e-4974-bd0e-285d56b8369a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:57.991140 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 160/309] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:51:57.993550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c3544-bc9e-4974-bd0e-285d56b8369a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:58.009344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12d4ac-bcab-4ec0-863b-888c20b7690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:58.010165 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12d4ac-bcab-4ec0-863b-888c20b7690d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:58.010567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12d4ac-bcab-4ec0-863b-888c20b7690d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:58.010877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12d4ac-bcab-4ec0-863b-888c20b7690d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:58.011858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12d4ac-bcab-4ec0-863b-888c20b7690d None admin] RBAC: Adding query filter params (role.id=6256bf6008374f439ed55b6faad17124, user.id=cc8df16e14b34431a9ade234afca2945, scope.system=all) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:58.012171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12d4ac-bcab-4ec0-863b-888c20b7690d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:58.013680 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12d4ac-bcab-4ec0-863b-888c20b7690d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:58.019804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 150/310] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 21 15:51:57 2022] GET /identity/v3/role_assignments?user.id=cc8df16e14b34431a9ade234afca2945&scope.system=all&role.id=6256bf6008374f439ed55b6faad17124 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:58.021095 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd08e29-ff32-418f-800c-c95864f50519 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:58.021383 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd08e29-ff32-418f-800c-c95864f50519 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:58.022566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd08e29-ff32-418f-800c-c95864f50519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:58.042099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bbd08e29-ff32-418f-800c-c95864f50519 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:51:58.043389 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bbd08e29-ff32-418f-800c-c95864f50519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:51:58.126386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c3544-bc9e-4974-bd0e-285d56b8369a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:58.143871 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 151/311] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:51:58.169211 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd08e29-ff32-418f-800c-c95864f50519 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:58.172852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9314b2c-d35d-4bef-b2f1-2779db245932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:58.174892 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9314b2c-d35d-4bef-b2f1-2779db245932 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:58.175185 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9314b2c-d35d-4bef-b2f1-2779db245932 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:58.175466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9314b2c-d35d-4bef-b2f1-2779db245932 None admin] PATH_INFO: `/v3/system/users/ea9b0bf0461f43e8aa9ada070ede239c/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:58.177464 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9314b2c-d35d-4bef-b2f1-2779db245932 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ea9b0bf0461f43e8aa9ada070ede239c, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:58.178989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9314b2c-d35d-4bef-b2f1-2779db245932 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:58.184233 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:58.196607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 161/312] 10.222.0.64 () {58 vars in 1334 bytes} [Thu Jul 21 15:51:57 2022] PUT /identity/v3/system/users/ea9b0bf0461f43e8aa9ada070ede239c/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 15:51:58.240548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:58.303877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd08e29-ff32-418f-800c-c95864f50519 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:58.345116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190ea5f-e368-46a4-96ef-b6f09bcaec17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:58.346349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190ea5f-e368-46a4-96ef-b6f09bcaec17 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:58.346939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190ea5f-e368-46a4-96ef-b6f09bcaec17 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:58.347454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8190ea5f-e368-46a4-96ef-b6f09bcaec17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:58.360188 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8190ea5f-e368-46a4-96ef-b6f09bcaec17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8190ea5f-e368-46a4-96ef-b6f09bcaec17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:51:58.369071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:51:58.370020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:51:58.370837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:51:58.370837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:51:58.370837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:51:58.370837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:51:58.370837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:51:58.370837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:51:58.370837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:51:58.370837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:51:58.370837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:51:58.370837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:51:58.370837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:51:58.370837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:51:58.371441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 152/313] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:51:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:51:58.377796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9314b2c-d35d-4bef-b2f1-2779db245932 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:58.491843 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9314b2c-d35d-4bef-b2f1-2779db245932 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:58.529219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0132c1-4c5d-4ac2-8c37-73ddc546fafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:58.530286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0132c1-4c5d-4ac2-8c37-73ddc546fafa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:58.530784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0132c1-4c5d-4ac2-8c37-73ddc546fafa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:58.531314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0132c1-4c5d-4ac2-8c37-73ddc546fafa None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:58.532309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0132c1-4c5d-4ac2-8c37-73ddc546fafa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:58.532841 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0132c1-4c5d-4ac2-8c37-73ddc546fafa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:58.534610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0132c1-4c5d-4ac2-8c37-73ddc546fafa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:58.544720 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 162/314] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:51:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:58.550894 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190ea5f-e368-46a4-96ef-b6f09bcaec17 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:58.653201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:58.657344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8190ea5f-e368-46a4-96ef-b6f09bcaec17 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:58.692816 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5502aa9-1755-42e2-92d8-4130a65ddfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:58.693711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5502aa9-1755-42e2-92d8-4130a65ddfb7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:58.693987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5502aa9-1755-42e2-92d8-4130a65ddfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:58.694259 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5502aa9-1755-42e2-92d8-4130a65ddfb7 None admin] PATH_INFO: `/v3/users/7723bb1838fa445aa6a4bd00c6bec0ab` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:58.695481 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5502aa9-1755-42e2-92d8-4130a65ddfb7 None admin] RBAC: Authorizing `identity:get_user(user_id=7723bb1838fa445aa6a4bd00c6bec0ab)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:58.696953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5502aa9-1755-42e2-92d8-4130a65ddfb7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:58.699028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 153/315] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:51:58 2022] GET /identity/v3/users/7723bb1838fa445aa6a4bd00c6bec0ab => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:58.704538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0132c1-4c5d-4ac2-8c37-73ddc546fafa None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:58.771529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:58.813265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0132c1-4c5d-4ac2-8c37-73ddc546fafa None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:58.847978 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a827251-6d0a-43aa-8361-928f97fbd9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:58.849042 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a827251-6d0a-43aa-8361-928f97fbd9aa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:58.849574 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a827251-6d0a-43aa-8361-928f97fbd9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:58.850049 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a827251-6d0a-43aa-8361-928f97fbd9aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:58.925619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a827251-6d0a-43aa-8361-928f97fbd9aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:58.927522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a827251-6d0a-43aa-8361-928f97fbd9aa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:58.993148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:51:59.033989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 163/316] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:51:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:51:59.039734 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5502aa9-1755-42e2-92d8-4130a65ddfb7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:59.146746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5502aa9-1755-42e2-92d8-4130a65ddfb7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:59.181787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa001f34-52b8-46cf-ace8-fdb05b10017e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:59.182729 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa001f34-52b8-46cf-ace8-fdb05b10017e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:59.183045 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa001f34-52b8-46cf-ace8-fdb05b10017e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:59.183324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa001f34-52b8-46cf-ace8-fdb05b10017e None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:59.184542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa001f34-52b8-46cf-ace8-fdb05b10017e None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:59.186022 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa001f34-52b8-46cf-ace8-fdb05b10017e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:59.188101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 154/317] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:51:59 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:51:59.196773 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a827251-6d0a-43aa-8361-928f97fbd9aa None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:51:59.309753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a827251-6d0a-43aa-8361-928f97fbd9aa None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:51:59.344062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7056935-75b1-4f52-ab37-b71d34fe4a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:51:59.344736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7056935-75b1-4f52-ab37-b71d34fe4a24 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:51:59.345019 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7056935-75b1-4f52-ab37-b71d34fe4a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:51:59.345296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7056935-75b1-4f52-ab37-b71d34fe4a24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:51:59.346158 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7056935-75b1-4f52-ab37-b71d34fe4a24 None admin] RBAC: Adding query filter params (role.id=6256bf6008374f439ed55b6faad17124, scope.project.id=e69f0e40da80459cb7b997f21995950a, user.id=7723bb1838fa445aa6a4bd00c6bec0ab) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:51:59.346474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7056935-75b1-4f52-ab37-b71d34fe4a24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:51:59.348045 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7056935-75b1-4f52-ab37-b71d34fe4a24 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:51:59.355439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 164/318] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:51:59 2022] GET /identity/v3/role_assignments?user.id=7723bb1838fa445aa6a4bd00c6bec0ab&scope.project.id=e69f0e40da80459cb7b997f21995950a&role.id=6256bf6008374f439ed55b6faad17124 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:00.027853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4815912-fd24-4b3e-819d-bbdeb6354116 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:00.028106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4815912-fd24-4b3e-819d-bbdeb6354116 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:00.028583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4815912-fd24-4b3e-819d-bbdeb6354116 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:00.029963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 155/319] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:00.035777 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717ee78-f377-40cc-ad15-ffa73174293a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:00.036280 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717ee78-f377-40cc-ad15-ffa73174293a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:00.036427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717ee78-f377-40cc-ad15-ffa73174293a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:00.054705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5717ee78-f377-40cc-ad15-ffa73174293a None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:00.055977 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5717ee78-f377-40cc-ad15-ffa73174293a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:00.079345 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:00.131561 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 165/320] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:00.153773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4815912-fd24-4b3e-819d-bbdeb6354116 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:00.199225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3dca-2d80-4a06-b91a-ef4c2f97bcce None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:00.199521 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3dca-2d80-4a06-b91a-ef4c2f97bcce None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:00.200044 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeb3dca-2d80-4a06-b91a-ef4c2f97bcce None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:00.201473 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 166/321] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:00.203601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:00.207115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfd3e6-784c-4e21-9553-9e22174d663b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:00.207430 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfd3e6-784c-4e21-9553-9e22174d663b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:00.207807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cfd3e6-784c-4e21-9553-9e22174d663b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:00.224384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a1cfd3e6-784c-4e21-9553-9e22174d663b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:00.225573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a1cfd3e6-784c-4e21-9553-9e22174d663b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:00.290276 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4815912-fd24-4b3e-819d-bbdeb6354116 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:00.304550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 167/322] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:00.306312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faac6b9-7003-4899-9e57-e71fb0954711 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:00.306600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faac6b9-7003-4899-9e57-e71fb0954711 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:00.306923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faac6b9-7003-4899-9e57-e71fb0954711 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:00.308180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 168/323] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:00.313588 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05063b-b6ab-4989-b6b6-11e5d18b6f52 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:00.313898 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05063b-b6ab-4989-b6b6-11e5d18b6f52 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:00.314158 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05063b-b6ab-4989-b6b6-11e5d18b6f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:00.326428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe02b05-1602-4551-b744-1a1bbd001d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:00.327287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe02b05-1602-4551-b744-1a1bbd001d1e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:00.327570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe02b05-1602-4551-b744-1a1bbd001d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:00.327847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe02b05-1602-4551-b744-1a1bbd001d1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:00.329030 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe02b05-1602-4551-b744-1a1bbd001d1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:00.330492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe02b05-1602-4551-b744-1a1bbd001d1e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:00.330784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8f05063b-b6ab-4989-b6b6-11e5d18b6f52 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:00.332070 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8f05063b-b6ab-4989-b6b6-11e5d18b6f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:00.332210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 156/324] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:00.332966 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe02b05-1602-4551-b744-1a1bbd001d1e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:00.404796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 169/325] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:52:00.405481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05063b-b6ab-4989-b6b6-11e5d18b6f52 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:00.429228 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:00.434877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe02b05-1602-4551-b744-1a1bbd001d1e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:00.436541 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:00.468420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05994d-5e97-40c1-886a-1d671e51ca0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:00.469229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05994d-5e97-40c1-886a-1d671e51ca0a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:00.469506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05994d-5e97-40c1-886a-1d671e51ca0a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:00.469787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05994d-5e97-40c1-886a-1d671e51ca0a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:00.479775 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05994d-5e97-40c1-886a-1d671e51ca0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4f05994d-5e97-40c1-886a-1d671e51ca0a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:00.487532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:00.488611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:00.489428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:00.489428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:00.489428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:00.489428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:00.489428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:00.489428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:00.489428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:00.489428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:00.489428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:00.489428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:00.489428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:52:00.489428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:00.489428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 157/326] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:00.490076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05994d-5e97-40c1-886a-1d671e51ca0a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:00.516664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f05063b-b6ab-4989-b6b6-11e5d18b6f52 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:00.551680 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9190a-cae0-4913-ba5d-91f7657c8701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:00.552276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9190a-cae0-4913-ba5d-91f7657c8701 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:00.552561 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9190a-cae0-4913-ba5d-91f7657c8701 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:00.552838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9190a-cae0-4913-ba5d-91f7657c8701 None admin] PATH_INFO: `/v3/groups` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:00.553532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9190a-cae0-4913-ba5d-91f7657c8701 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:00.555038 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9190a-cae0-4913-ba5d-91f7657c8701 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:00.570738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 170/327] 10.222.0.64 () {60 vars in 1134 bytes} [Thu Jul 21 15:52:00 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:52:00.571589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9190a-cae0-4913-ba5d-91f7657c8701 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:00.591740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05994d-5e97-40c1-886a-1d671e51ca0a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:00.632930 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cd389-67f9-4b73-9a14-449483b66121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:00.633751 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cd389-67f9-4b73-9a14-449483b66121 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:00.634030 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cd389-67f9-4b73-9a14-449483b66121 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:00.634324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cd389-67f9-4b73-9a14-449483b66121 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:00.647161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cd389-67f9-4b73-9a14-449483b66121 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a84cd389-67f9-4b73-9a14-449483b66121 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:00.655350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:00.656528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:00.657375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:00.657375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:00.657375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:00.657375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:00.657375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:00.657375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:00.657375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:00.657375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:00.657375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:00.657375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:00.657375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:52:00.657375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:00.657375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 158/328] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:00.663094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cd389-67f9-4b73-9a14-449483b66121 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:00.678308 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:00.695397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:00.710706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9190a-cae0-4913-ba5d-91f7657c8701 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:00.750647 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18f4a8-8a1b-4150-b8a8-1c9074a0e80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:00.751963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18f4a8-8a1b-4150-b8a8-1c9074a0e80b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:00.751963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18f4a8-8a1b-4150-b8a8-1c9074a0e80b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:00.751963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18f4a8-8a1b-4150-b8a8-1c9074a0e80b None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:00.752637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18f4a8-8a1b-4150-b8a8-1c9074a0e80b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:00.753445 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18f4a8-8a1b-4150-b8a8-1c9074a0e80b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:00.754377 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18f4a8-8a1b-4150-b8a8-1c9074a0e80b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:00.764188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 171/329] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:52:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:00.770167 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18f4a8-8a1b-4150-b8a8-1c9074a0e80b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:00.787793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cd389-67f9-4b73-9a14-449483b66121 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:00.831339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e59e9-d062-4cf9-be8d-ca1335d4d124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:00.831935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e59e9-d062-4cf9-be8d-ca1335d4d124 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:00.832261 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e59e9-d062-4cf9-be8d-ca1335d4d124 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:00.832537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e59e9-d062-4cf9-be8d-ca1335d4d124 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:00.833366 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e59e9-d062-4cf9-be8d-ca1335d4d124 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:00.833676 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e59e9-d062-4cf9-be8d-ca1335d4d124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:00.835155 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155e59e9-d062-4cf9-be8d-ca1335d4d124 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:00.844491 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 159/330] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:52:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:00.852126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e59e9-d062-4cf9-be8d-ca1335d4d124 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:00.888824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18f4a8-8a1b-4150-b8a8-1c9074a0e80b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:00.928265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b01c4-7f00-4cd4-b143-b599ba7e8229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:00.929164 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b01c4-7f00-4cd4-b143-b599ba7e8229 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:00.929443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b01c4-7f00-4cd4-b143-b599ba7e8229 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:00.929715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b01c4-7f00-4cd4-b143-b599ba7e8229 None admin] PATH_INFO: `/v3/users/cc8df16e14b34431a9ade234afca2945` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:00.930967 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b01c4-7f00-4cd4-b143-b599ba7e8229 None admin] RBAC: Authorizing `identity:get_user(user_id=cc8df16e14b34431a9ade234afca2945)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:00.932422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b01c4-7f00-4cd4-b143-b599ba7e8229 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:00.934064 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 172/331] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:52:00 2022] GET /identity/v3/users/cc8df16e14b34431a9ade234afca2945 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:00.942679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b01c4-7f00-4cd4-b143-b599ba7e8229 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:00.953521 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:00.956402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:00.979348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e59e9-d062-4cf9-be8d-ca1335d4d124 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:01.025219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc37ef-68e0-4c9a-bb6a-0a0007a9544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:01.027067 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc37ef-68e0-4c9a-bb6a-0a0007a9544a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:01.027570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc37ef-68e0-4c9a-bb6a-0a0007a9544a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:01.027948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc37ef-68e0-4c9a-bb6a-0a0007a9544a None admin] PATH_INFO: `/v3/users/ea9b0bf0461f43e8aa9ada070ede239c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:01.029342 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc37ef-68e0-4c9a-bb6a-0a0007a9544a None admin] RBAC: Authorizing `identity:get_user(user_id=ea9b0bf0461f43e8aa9ada070ede239c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:01.034389 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc37ef-68e0-4c9a-bb6a-0a0007a9544a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:01.034389 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 160/332] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:52:00 2022] GET /identity/v3/users/ea9b0bf0461f43e8aa9ada070ede239c => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:01.038603 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc37ef-68e0-4c9a-bb6a-0a0007a9544a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:01.084742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b01c4-7f00-4cd4-b143-b599ba7e8229 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:01.127138 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97685f67-547c-4e3a-923a-45ceb6b5f258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:01.129389 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97685f67-547c-4e3a-923a-45ceb6b5f258 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:01.129389 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97685f67-547c-4e3a-923a-45ceb6b5f258 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:01.129389 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97685f67-547c-4e3a-923a-45ceb6b5f258 None admin] PATH_INFO: `/v3/system/users/cc8df16e14b34431a9ade234afca2945/roles/6256bf6008374f439ed55b6faad17124` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:01.131885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97685f67-547c-4e3a-923a-45ceb6b5f258 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cc8df16e14b34431a9ade234afca2945, role_id=6256bf6008374f439ed55b6faad17124)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:01.133309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97685f67-547c-4e3a-923a-45ceb6b5f258 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:01.150846 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 173/333] 10.222.0.64 () {58 vars in 1334 bytes} [Thu Jul 21 15:52:00 2022] PUT /identity/v3/system/users/cc8df16e14b34431a9ade234afca2945/roles/6256bf6008374f439ed55b6faad17124 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:52:01.175340 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc37ef-68e0-4c9a-bb6a-0a0007a9544a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:01.224575 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc6725-47e9-47d0-995e-78a853142cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:01.225642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc6725-47e9-47d0-995e-78a853142cfc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:01.226144 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc6725-47e9-47d0-995e-78a853142cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:01.226621 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc6725-47e9-47d0-995e-78a853142cfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:01.227803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc6725-47e9-47d0-995e-78a853142cfc None admin] RBAC: Adding query filter params (role.id=64e044de7dcc4949acf8ce7eaf08fdaa, user.id=ea9b0bf0461f43e8aa9ada070ede239c, scope.system=all) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:01.228384 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc6725-47e9-47d0-995e-78a853142cfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:01.230184 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc6725-47e9-47d0-995e-78a853142cfc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:01.245988 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 161/334] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 21 15:52:01 2022] GET /identity/v3/role_assignments?user.id=ea9b0bf0461f43e8aa9ada070ede239c&scope.system=all&role.id=64e044de7dcc4949acf8ce7eaf08fdaa => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:02.871705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa4b3a-341f-4104-9c70-153be66c23bb None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:02.872222 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa4b3a-341f-4104-9c70-153be66c23bb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:02.872296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa4b3a-341f-4104-9c70-153be66c23bb None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:02.873642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 174/335] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:02.884955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41ebe8-3ba0-4572-b2a9-ea4fc48fe359 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:02.885434 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41ebe8-3ba0-4572-b2a9-ea4fc48fe359 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:02.885505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41ebe8-3ba0-4572-b2a9-ea4fc48fe359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:02.907797 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-aa41ebe8-3ba0-4572-b2a9-ea4fc48fe359 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:02.909027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aa41ebe8-3ba0-4572-b2a9-ea4fc48fe359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:02.912115 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:02.989399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 162/336] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:03.040322 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa4b3a-341f-4104-9c70-153be66c23bb None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:03.139275 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:03.177693 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa4b3a-341f-4104-9c70-153be66c23bb None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:03.221031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f018c-b25c-40a6-80ff-31cb69f1a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:03.221902 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f018c-b25c-40a6-80ff-31cb69f1a761 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:03.222188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f018c-b25c-40a6-80ff-31cb69f1a761 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:03.222465 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f018c-b25c-40a6-80ff-31cb69f1a761 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:03.243798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f018c-b25c-40a6-80ff-31cb69f1a761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2d1f018c-b25c-40a6-80ff-31cb69f1a761 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:03.251644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:03.252499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:03.253335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:03.253335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:03.253335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:03.253335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:03.253335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:03.253335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:03.253335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:03.253335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:03.253335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:03.253335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:03.253335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:52:03.253335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:03.253335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 175/337] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:03.259933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41ebe8-3ba0-4572-b2a9-ea4fc48fe359 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:03.281659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523bbb4-905c-43a6-8b68-dc066d47f6fd None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:03.281994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523bbb4-905c-43a6-8b68-dc066d47f6fd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:03.282207 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523bbb4-905c-43a6-8b68-dc066d47f6fd None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:03.283770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 176/338] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:03.300754 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cd365-99c8-4947-bb49-b6ded9b947d5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:03.301050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cd365-99c8-4947-bb49-b6ded9b947d5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:03.301291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cd365-99c8-4947-bb49-b6ded9b947d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:03.339907 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ed8cd365-99c8-4947-bb49-b6ded9b947d5 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:03.341145 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ed8cd365-99c8-4947-bb49-b6ded9b947d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:03.393667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41ebe8-3ba0-4572-b2a9-ea4fc48fe359 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:03.453003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6322f8-8ed5-4abf-ab87-162ef0504c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:03.453697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6322f8-8ed5-4abf-ab87-162ef0504c48 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:03.453978 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6322f8-8ed5-4abf-ab87-162ef0504c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:03.454251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6322f8-8ed5-4abf-ab87-162ef0504c48 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:03.455441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6322f8-8ed5-4abf-ab87-162ef0504c48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:03.455759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6322f8-8ed5-4abf-ab87-162ef0504c48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:03.457388 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6322f8-8ed5-4abf-ab87-162ef0504c48 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:03.479641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 163/339] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:52:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:03.491986 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6322f8-8ed5-4abf-ab87-162ef0504c48 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:03.498950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:03.531755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 177/340] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:52:03.563818 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cd365-99c8-4947-bb49-b6ded9b947d5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:03.654869 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:03.656617 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6322f8-8ed5-4abf-ab87-162ef0504c48 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:03.734708 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cd365-99c8-4947-bb49-b6ded9b947d5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:03.747608 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8500e16-d06c-48f3-a453-50b964c2eaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:03.748296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8500e16-d06c-48f3-a453-50b964c2eaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:03.748585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8500e16-d06c-48f3-a453-50b964c2eaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:03.748869 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8500e16-d06c-48f3-a453-50b964c2eaf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:03.860146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d36ee7-61f5-4a2d-b60b-8abec4655a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:03.860996 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d36ee7-61f5-4a2d-b60b-8abec4655a00 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:03.861282 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d36ee7-61f5-4a2d-b60b-8abec4655a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:03.861549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d36ee7-61f5-4a2d-b60b-8abec4655a00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:03.865047 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8500e16-d06c-48f3-a453-50b964c2eaf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:03.867874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8500e16-d06c-48f3-a453-50b964c2eaf7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:03.871563 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:03.919661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d36ee7-61f5-4a2d-b60b-8abec4655a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-21d36ee7-61f5-4a2d-b60b-8abec4655a00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:03.927910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:03.928811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:03.929615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:03.929615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:03.929615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:03.929615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:03.929615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:03.929615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:03.929615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:03.929615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:03.929615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:03.929615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:03.929615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:52:03.929615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:03.929615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 178/341] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:52:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:03.930796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab77d42-752f-4ce4-b638-fd96f359373b None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:03.934340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab77d42-752f-4ce4-b638-fd96f359373b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:03.934644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab77d42-752f-4ce4-b638-fd96f359373b None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:03.936732 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 179/342] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:03.937321 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab77d42-752f-4ce4-b638-fd96f359373b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:03.988527 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 164/343] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:03.990927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616203d-1e04-4533-bb8f-7bbcf934feeb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:03.991442 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616203d-1e04-4533-bb8f-7bbcf934feeb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:03.991926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616203d-1e04-4533-bb8f-7bbcf934feeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:04.008980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f616203d-1e04-4533-bb8f-7bbcf934feeb None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:04.010487 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f616203d-1e04-4533-bb8f-7bbcf934feeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:04.079806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 165/344] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:04.080990 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616203d-1e04-4533-bb8f-7bbcf934feeb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:04.117539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:04.170074 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab77d42-752f-4ce4-b638-fd96f359373b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:04.192011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:04.200662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616203d-1e04-4533-bb8f-7bbcf934feeb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:04.211072 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30f1c5-f9b0-4111-a0a6-9b131d86c342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:04.212161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30f1c5-f9b0-4111-a0a6-9b131d86c342 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:04.212642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30f1c5-f9b0-4111-a0a6-9b131d86c342 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:04.213188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30f1c5-f9b0-4111-a0a6-9b131d86c342 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:04.214147 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30f1c5-f9b0-4111-a0a6-9b131d86c342 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:04.214673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30f1c5-f9b0-4111-a0a6-9b131d86c342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:04.216598 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30f1c5-f9b0-4111-a0a6-9b131d86c342 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:04.231428 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 180/345] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:04.233285 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e611593-4e95-4a6a-ac64-6de8d542842a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:04.238348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e611593-4e95-4a6a-ac64-6de8d542842a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:04.238612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6fbdd-9056-43d4-a20f-bed87d3d6843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:04.239221 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e611593-4e95-4a6a-ac64-6de8d542842a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:04.239531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6fbdd-9056-43d4-a20f-bed87d3d6843 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:04.239807 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6fbdd-9056-43d4-a20f-bed87d3d6843 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:04.240073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6fbdd-9056-43d4-a20f-bed87d3d6843 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:04.241702 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6fbdd-9056-43d4-a20f-bed87d3d6843 None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:04.242353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 181/346] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:04.243346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e611593-4e95-4a6a-ac64-6de8d542842a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:04.243450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6fbdd-9056-43d4-a20f-bed87d3d6843 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:04.245476 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 166/347] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:52:04 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:04.246485 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6fbdd-9056-43d4-a20f-bed87d3d6843 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:04.347959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:04.350752 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6fbdd-9056-43d4-a20f-bed87d3d6843 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:04.361972 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e611593-4e95-4a6a-ac64-6de8d542842a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:04.389531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845cdfd-3741-4319-84d6-8ea163bad4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:04.390191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845cdfd-3741-4319-84d6-8ea163bad4fa None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:04.390467 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845cdfd-3741-4319-84d6-8ea163bad4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:04.390746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845cdfd-3741-4319-84d6-8ea163bad4fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:04.414738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22475291-96b0-4e2e-841a-43983a2bbde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:04.416031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22475291-96b0-4e2e-841a-43983a2bbde0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:04.416335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22475291-96b0-4e2e-841a-43983a2bbde0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:04.416611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22475291-96b0-4e2e-841a-43983a2bbde0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:04.432557 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22475291-96b0-4e2e-841a-43983a2bbde0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-22475291-96b0-4e2e-841a-43983a2bbde0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:04.446180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:04.447219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:04.448155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:04.448155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:04.448155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:04.448155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:04.448155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:04.448155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:04.448155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:04.448155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:04.448155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:04.448155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:04.448155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:52:04.448155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:04.448155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 182/348] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:04.448822 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554bdcf-f00f-45c1-81fd-9cf7fe0a53a8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:04.449389 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554bdcf-f00f-45c1-81fd-9cf7fe0a53a8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:04.449389 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554bdcf-f00f-45c1-81fd-9cf7fe0a53a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:04.470887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a554bdcf-f00f-45c1-81fd-9cf7fe0a53a8 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:04.472368 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a554bdcf-f00f-45c1-81fd-9cf7fe0a53a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:04.477898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845cdfd-3741-4319-84d6-8ea163bad4fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:04.479495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845cdfd-3741-4319-84d6-8ea163bad4fa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:04.512156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:04.554727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 183/349] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:04.555915 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554bdcf-f00f-45c1-81fd-9cf7fe0a53a8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:04.620923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:04.627164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 167/350] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:04.628861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845cdfd-3741-4319-84d6-8ea163bad4fa None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:04.696746 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554bdcf-f00f-45c1-81fd-9cf7fe0a53a8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:04.737002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534292a-a686-4359-b16f-e5be55395570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:04.738022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534292a-a686-4359-b16f-e5be55395570 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:04.738312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534292a-a686-4359-b16f-e5be55395570 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:04.738588 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534292a-a686-4359-b16f-e5be55395570 None admin] PATH_INFO: `/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:04.747765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534292a-a686-4359-b16f-e5be55395570 None admin] RBAC: Authorizing `identity:get_group(group_id=f1ddfcb6b7544fad8d81b7875e8d89f7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:04.749265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534292a-a686-4359-b16f-e5be55395570 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:04.751204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 184/351] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 15:52:04 2022] GET /identity/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:04.751811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534292a-a686-4359-b16f-e5be55395570 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:04.769470 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845cdfd-3741-4319-84d6-8ea163bad4fa None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:04.792222 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:04.816202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af74bb-712c-44fd-a85c-faf623a95d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:04.817806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af74bb-712c-44fd-a85c-faf623a95d86 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:04.818281 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af74bb-712c-44fd-a85c-faf623a95d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:04.818933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af74bb-712c-44fd-a85c-faf623a95d86 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:04.820493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af74bb-712c-44fd-a85c-faf623a95d86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:04.821019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af74bb-712c-44fd-a85c-faf623a95d86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:04.823307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af74bb-712c-44fd-a85c-faf623a95d86 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:04.834594 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 168/352] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:52:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:04.835779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af74bb-712c-44fd-a85c-faf623a95d86 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:04.865917 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534292a-a686-4359-b16f-e5be55395570 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:04.901246 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77e625-8cd0-439e-b35c-898e5ee6cee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:04.902164 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77e625-8cd0-439e-b35c-898e5ee6cee8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:04.902343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77e625-8cd0-439e-b35c-898e5ee6cee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:04.902626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f77e625-8cd0-439e-b35c-898e5ee6cee8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:04.914288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f77e625-8cd0-439e-b35c-898e5ee6cee8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:04.917347 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2f77e625-8cd0-439e-b35c-898e5ee6cee8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:04.925422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:04.926717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:04.927671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:04.927671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:04.927671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:04.927671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:04.927671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:04.927671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:04.927671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:04.927671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:04.927671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:04.927671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:04.927671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 15:52:04.927671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:04.927671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 185/353] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:04.927671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77e625-8cd0-439e-b35c-898e5ee6cee8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:04.974945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af74bb-712c-44fd-a85c-faf623a95d86 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:05.017237 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e225af8-ef75-4008-913c-b8d39748a145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:05.018123 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e225af8-ef75-4008-913c-b8d39748a145 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:05.018406 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e225af8-ef75-4008-913c-b8d39748a145 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:05.018717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e225af8-ef75-4008-913c-b8d39748a145 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:05.020726 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e225af8-ef75-4008-913c-b8d39748a145 None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:05.022197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e225af8-ef75-4008-913c-b8d39748a145 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:05.024285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 169/354] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:52:04 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:05.025074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e225af8-ef75-4008-913c-b8d39748a145 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:05.055612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:05.063957 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f77e625-8cd0-439e-b35c-898e5ee6cee8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:05.111639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a19150-3506-4ab3-9a2f-da78ae6f57f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:05.112659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a19150-3506-4ab3-9a2f-da78ae6f57f4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:05.113113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a19150-3506-4ab3-9a2f-da78ae6f57f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:05.113557 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a19150-3506-4ab3-9a2f-da78ae6f57f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:05.114571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a19150-3506-4ab3-9a2f-da78ae6f57f4 None admin] RBAC: Adding query filter params (group.id=f1ddfcb6b7544fad8d81b7875e8d89f7, role.id=64e044de7dcc4949acf8ce7eaf08fdaa, scope.project.id=10efcfb517724a609d32a0457044f00c) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:05.116081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a19150-3506-4ab3-9a2f-da78ae6f57f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:05.117669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a19150-3506-4ab3-9a2f-da78ae6f57f4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:05.124059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 186/355] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 15:52:04 2022] GET /identity/v3/role_assignments?group.id=f1ddfcb6b7544fad8d81b7875e8d89f7&scope.project.id=10efcfb517724a609d32a0457044f00c&role.id=64e044de7dcc4949acf8ce7eaf08fdaa => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:05.125715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10113a33-1566-4e75-be2e-96e7d5eea9f2 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:05.126015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10113a33-1566-4e75-be2e-96e7d5eea9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:05.126296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10113a33-1566-4e75-be2e-96e7d5eea9f2 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:05.127825 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 187/356] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:05.132912 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10113a33-1566-4e75-be2e-96e7d5eea9f2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:05.186641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e225af8-ef75-4008-913c-b8d39748a145 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:05.235393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:05.244344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d3c15-d436-4b42-86e9-01f7be49fc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:05.245029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d3c15-d436-4b42-86e9-01f7be49fc43 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:05.245316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d3c15-d436-4b42-86e9-01f7be49fc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:05.245596 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d3c15-d436-4b42-86e9-01f7be49fc43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:05.282118 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10113a33-1566-4e75-be2e-96e7d5eea9f2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:05.332893 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e5948-42e7-47e0-88b1-c96351fe31b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:05.333582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e5948-42e7-47e0-88b1-c96351fe31b7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:05.333865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e5948-42e7-47e0-88b1-c96351fe31b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:05.334145 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46e5948-42e7-47e0-88b1-c96351fe31b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:05.337500 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e5948-42e7-47e0-88b1-c96351fe31b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:05.337500 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e5948-42e7-47e0-88b1-c96351fe31b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:05.337500 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46e5948-42e7-47e0-88b1-c96351fe31b7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:05.344902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d3c15-d436-4b42-86e9-01f7be49fc43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:05.346456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9d3c15-d436-4b42-86e9-01f7be49fc43 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:05.346589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 188/357] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:52:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:05.347633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e5948-42e7-47e0-88b1-c96351fe31b7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:05.376036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:05.465563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46e5948-42e7-47e0-88b1-c96351fe31b7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:05.484708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 170/358] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:05.486043 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24586f0-d918-4061-a30d-98dd1d9f87e2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:05.486340 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24586f0-d918-4061-a30d-98dd1d9f87e2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:05.486710 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24586f0-d918-4061-a30d-98dd1d9f87e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:05.504130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a24586f0-d918-4061-a30d-98dd1d9f87e2 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:05.505183 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118125a8-3d5b-46a0-b98f-4876375b10f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:05.505441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a24586f0-d918-4061-a30d-98dd1d9f87e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:05.506486 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118125a8-3d5b-46a0-b98f-4876375b10f4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:05.506979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118125a8-3d5b-46a0-b98f-4876375b10f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:05.507734 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118125a8-3d5b-46a0-b98f-4876375b10f4 None admin] PATH_INFO: `/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:05.510189 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118125a8-3d5b-46a0-b98f-4876375b10f4 None admin] RBAC: Authorizing `identity:get_group(group_id=f1ddfcb6b7544fad8d81b7875e8d89f7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:05.511871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118125a8-3d5b-46a0-b98f-4876375b10f4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:05.514349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 189/359] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 15:52:05 2022] GET /identity/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:05.515352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118125a8-3d5b-46a0-b98f-4876375b10f4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:05.541875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:05.600859 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 171/360] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:05.602031 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41c882-682a-44e8-96b4-18bb26493acd None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:05.602321 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41c882-682a-44e8-96b4-18bb26493acd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:05.602597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41c882-682a-44e8-96b4-18bb26493acd None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:05.604362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 172/361] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:05.605091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41c882-682a-44e8-96b4-18bb26493acd None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:05.631660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:05.644288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118125a8-3d5b-46a0-b98f-4876375b10f4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:05.692477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39af315-a10b-4348-9225-fa21637c885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:05.693438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39af315-a10b-4348-9225-fa21637c885d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:05.693723 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39af315-a10b-4348-9225-fa21637c885d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:05.693998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39af315-a10b-4348-9225-fa21637c885d None admin] PATH_INFO: `/v3/users/cc8df16e14b34431a9ade234afca2945` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:05.695320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39af315-a10b-4348-9225-fa21637c885d None admin] RBAC: Authorizing `identity:get_user(user_id=cc8df16e14b34431a9ade234afca2945)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:05.696959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39af315-a10b-4348-9225-fa21637c885d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:05.698805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 190/362] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:52:05 2022] GET /identity/v3/users/cc8df16e14b34431a9ade234afca2945 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:05.699537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39af315-a10b-4348-9225-fa21637c885d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:05.729850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41c882-682a-44e8-96b4-18bb26493acd None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:05.770014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd64b92-511d-4cdf-8548-8ca5296eb396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:05.770924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd64b92-511d-4cdf-8548-8ca5296eb396 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:05.771211 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd64b92-511d-4cdf-8548-8ca5296eb396 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:05.771487 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd64b92-511d-4cdf-8548-8ca5296eb396 None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:05.772679 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd64b92-511d-4cdf-8548-8ca5296eb396 None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:05.774281 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd64b92-511d-4cdf-8548-8ca5296eb396 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:05.776530 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 173/363] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:52:05 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:05.778044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f4758-c5e6-4619-9326-47707ef3707b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:05.778423 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f4758-c5e6-4619-9326-47707ef3707b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:05.778696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f4758-c5e6-4619-9326-47707ef3707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:05.796085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c80f4758-c5e6-4619-9326-47707ef3707b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:05.797376 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c80f4758-c5e6-4619-9326-47707ef3707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:05.808832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39af315-a10b-4348-9225-fa21637c885d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:05.831740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:05.850954 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a6e22-62b1-431f-8038-02f00aac428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:05.851630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a6e22-62b1-431f-8038-02f00aac428c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:05.851913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a6e22-62b1-431f-8038-02f00aac428c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:05.852185 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a6e22-62b1-431f-8038-02f00aac428c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:05.853055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a6e22-62b1-431f-8038-02f00aac428c None admin] RBAC: Adding query filter params (group.id=f1ddfcb6b7544fad8d81b7875e8d89f7, role.id=e9dc595c6b4248d3b5262b70a90e76c5, scope.project.id=10efcfb517724a609d32a0457044f00c) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:05.853389 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a6e22-62b1-431f-8038-02f00aac428c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:05.856853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a6e22-62b1-431f-8038-02f00aac428c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:05.863689 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 191/364] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 15:52:05 2022] GET /identity/v3/role_assignments?group.id=f1ddfcb6b7544fad8d81b7875e8d89f7&scope.project.id=10efcfb517724a609d32a0457044f00c&role.id=e9dc595c6b4248d3b5262b70a90e76c5 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:05.864555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a6e22-62b1-431f-8038-02f00aac428c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:05.903868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:05.911499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 174/365] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:05.913399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f4758-c5e6-4619-9326-47707ef3707b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:06.002598 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a6e22-62b1-431f-8038-02f00aac428c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:06.051594 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f4758-c5e6-4619-9326-47707ef3707b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:06.054779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20626e0-1dc8-47c5-bc1a-d3d38f7ecae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:06.056015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20626e0-1dc8-47c5-bc1a-d3d38f7ecae1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:06.056629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20626e0-1dc8-47c5-bc1a-d3d38f7ecae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:06.057123 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20626e0-1dc8-47c5-bc1a-d3d38f7ecae1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:06.070480 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20626e0-1dc8-47c5-bc1a-d3d38f7ecae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-b20626e0-1dc8-47c5-bc1a-d3d38f7ecae1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:06.079566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:06.080484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:06.081382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:06.081382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:06.081382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:06.081382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:06.081382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:06.081382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:06.081382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:06.081382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:06.081382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:06.081382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:06.081382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:52:06.081382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:06.084265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 192/366] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:52:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:06.085279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20626e0-1dc8-47c5-bc1a-d3d38f7ecae1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:06.096978 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a23ea5-6b6d-4ec5-9743-79d40dbc5ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:06.097664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a23ea5-6b6d-4ec5-9743-79d40dbc5ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:06.097947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a23ea5-6b6d-4ec5-9743-79d40dbc5ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:06.098223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a23ea5-6b6d-4ec5-9743-79d40dbc5ee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:06.099116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a23ea5-6b6d-4ec5-9743-79d40dbc5ee5 None admin] RBAC: Adding query filter params (role.id=6256bf6008374f439ed55b6faad17124, user.id=cc8df16e14b34431a9ade234afca2945, scope.system=all) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:06.099536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a23ea5-6b6d-4ec5-9743-79d40dbc5ee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:06.101064 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a23ea5-6b6d-4ec5-9743-79d40dbc5ee5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:06.117561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 175/367] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Jul 21 15:52:05 2022] GET /identity/v3/role_assignments?user.id=cc8df16e14b34431a9ade234afca2945&scope.system=all&role.id=6256bf6008374f439ed55b6faad17124 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:06.118885 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a23ea5-6b6d-4ec5-9743-79d40dbc5ee5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:06.176985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:06.211026 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:06.235540 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20626e0-1dc8-47c5-bc1a-d3d38f7ecae1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:06.308182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8d6b5-952f-4c17-92a3-b38786a62b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:06.309020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8d6b5-952f-4c17-92a3-b38786a62b57 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:06.309297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8d6b5-952f-4c17-92a3-b38786a62b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:06.309572 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8d6b5-952f-4c17-92a3-b38786a62b57 None admin] PATH_INFO: `/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:06.311115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8d6b5-952f-4c17-92a3-b38786a62b57 None admin] RBAC: Authorizing `identity:get_group(group_id=f1ddfcb6b7544fad8d81b7875e8d89f7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:06.312634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8d6b5-952f-4c17-92a3-b38786a62b57 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:06.314666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 193/368] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 15:52:06 2022] GET /identity/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:06.315231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8d6b5-952f-4c17-92a3-b38786a62b57 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:06.379356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a23ea5-6b6d-4ec5-9743-79d40dbc5ee5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:06.426599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f8cc1-69de-4b45-82b3-91b22c5e3f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:06.427615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f8cc1-69de-4b45-82b3-91b22c5e3f89 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:06.427903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f8cc1-69de-4b45-82b3-91b22c5e3f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:06.428183 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6f8cc1-69de-4b45-82b3-91b22c5e3f89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:06.442904 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6f8cc1-69de-4b45-82b3-91b22c5e3f89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ac6f8cc1-69de-4b45-82b3-91b22c5e3f89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:06.452964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:06.453893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:06.454684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:06.454684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:06.454684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:06.454684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:06.454684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:06.454684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:06.454684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:06.454684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:06.454684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:06.454684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:06.454684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:06.454684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:06.455873 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 176/369] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:52:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:06.456317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f8cc1-69de-4b45-82b3-91b22c5e3f89 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:06.514697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8d6b5-952f-4c17-92a3-b38786a62b57 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:06.557291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1062aa-79b2-4f49-857a-ce8d6dcae734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:06.557985 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1062aa-79b2-4f49-857a-ce8d6dcae734 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:06.558321 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1062aa-79b2-4f49-857a-ce8d6dcae734 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:06.558549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1062aa-79b2-4f49-857a-ce8d6dcae734 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:06.559359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1062aa-79b2-4f49-857a-ce8d6dcae734 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:06.559673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1062aa-79b2-4f49-857a-ce8d6dcae734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:06.561072 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1062aa-79b2-4f49-857a-ce8d6dcae734 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:06.568224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:06.576472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 194/370] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:06.577407 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1062aa-79b2-4f49-857a-ce8d6dcae734 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:06.590772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6f8cc1-69de-4b45-82b3-91b22c5e3f89 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:06.593096 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:06.627076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7aea42-362c-44bf-9b98-f8d7ef280b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:06.627740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aea42-362c-44bf-9b98-f8d7ef280b0b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:06.628052 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aea42-362c-44bf-9b98-f8d7ef280b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:06.628417 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7aea42-362c-44bf-9b98-f8d7ef280b0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:06.629260 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7aea42-362c-44bf-9b98-f8d7ef280b0b None admin] RBAC: Adding query filter params (group.id=f1ddfcb6b7544fad8d81b7875e8d89f7, role.id=64e044de7dcc4949acf8ce7eaf08fdaa, scope.project.id=e69f0e40da80459cb7b997f21995950a) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:06.629567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7aea42-362c-44bf-9b98-f8d7ef280b0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:06.631046 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7aea42-362c-44bf-9b98-f8d7ef280b0b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:06.637126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 177/371] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 15:52:06 2022] GET /identity/v3/role_assignments?group.id=f1ddfcb6b7544fad8d81b7875e8d89f7&scope.project.id=e69f0e40da80459cb7b997f21995950a&role.id=64e044de7dcc4949acf8ce7eaf08fdaa => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:06.637697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7aea42-362c-44bf-9b98-f8d7ef280b0b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:06.690156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1062aa-79b2-4f49-857a-ce8d6dcae734 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:06.727499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecab89-4364-4d40-8ecc-62f8ac8fb75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:06.728198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecab89-4364-4d40-8ecc-62f8ac8fb75f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:06.728488 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecab89-4364-4d40-8ecc-62f8ac8fb75f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:06.728827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecab89-4364-4d40-8ecc-62f8ac8fb75f None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:06.729637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecab89-4364-4d40-8ecc-62f8ac8fb75f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:06.729964 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecab89-4364-4d40-8ecc-62f8ac8fb75f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:06.732489 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecab89-4364-4d40-8ecc-62f8ac8fb75f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:06.742762 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 195/372] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:06.748307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecab89-4364-4d40-8ecc-62f8ac8fb75f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:06.751208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7aea42-362c-44bf-9b98-f8d7ef280b0b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:06.797664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff977e-f436-4444-8eb0-33ccec4ee06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:06.798446 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff977e-f436-4444-8eb0-33ccec4ee06a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:06.798792 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff977e-f436-4444-8eb0-33ccec4ee06a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:06.799102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff977e-f436-4444-8eb0-33ccec4ee06a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:06.812982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:06.875280 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:06.884960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff977e-f436-4444-8eb0-33ccec4ee06a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:06.886461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff977e-f436-4444-8eb0-33ccec4ee06a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:06.901991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecab89-4364-4d40-8ecc-62f8ac8fb75f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:06.944575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37570410-5ec1-4a84-af3b-269c0bdead29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:06.945373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37570410-5ec1-4a84-af3b-269c0bdead29 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:06.945664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37570410-5ec1-4a84-af3b-269c0bdead29 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:06.945966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37570410-5ec1-4a84-af3b-269c0bdead29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:07.000114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 178/373] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:07.020736 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff977e-f436-4444-8eb0-33ccec4ee06a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:07.028225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37570410-5ec1-4a84-af3b-269c0bdead29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:07.029781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37570410-5ec1-4a84-af3b-269c0bdead29 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:07.085508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:07.111295 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:07.139425 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 196/374] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:07.145567 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37570410-5ec1-4a84-af3b-269c0bdead29 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:07.187293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff977e-f436-4444-8eb0-33ccec4ee06a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:07.261135 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37570410-5ec1-4a84-af3b-269c0bdead29 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:07.269634 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cb992-02f0-4bd9-a1df-aea60af48c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:07.270542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cb992-02f0-4bd9-a1df-aea60af48c2f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:07.270833 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cb992-02f0-4bd9-a1df-aea60af48c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:07.271303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783cb992-02f0-4bd9-a1df-aea60af48c2f None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:07.272820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783cb992-02f0-4bd9-a1df-aea60af48c2f None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:07.274301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783cb992-02f0-4bd9-a1df-aea60af48c2f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:07.276517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 179/375] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:52:07 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:07.299802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cb992-02f0-4bd9-a1df-aea60af48c2f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:07.301422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec9bc4-f889-4bae-94fc-3027038fb1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:07.302311 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec9bc4-f889-4bae-94fc-3027038fb1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:07.302914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec9bc4-f889-4bae-94fc-3027038fb1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:07.303202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec9bc4-f889-4bae-94fc-3027038fb1d4 None admin] PATH_INFO: `/v3/projects/ab5b6764e1c145b69436e883cfb29e46` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:07.308565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec9bc4-f889-4bae-94fc-3027038fb1d4 None admin] RBAC: Authorizing `identity:get_project(project_id=ab5b6764e1c145b69436e883cfb29e46)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:07.310046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec9bc4-f889-4bae-94fc-3027038fb1d4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:07.313171 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 197/376] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:52:07 2022] GET /identity/v3/projects/ab5b6764e1c145b69436e883cfb29e46 => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:07.325943 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec9bc4-f889-4bae-94fc-3027038fb1d4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:07.389224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:07.480858 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec9bc4-f889-4bae-94fc-3027038fb1d4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:07.519440 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783cb992-02f0-4bd9-a1df-aea60af48c2f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:07.530328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:07.533529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce1a37-7a63-4544-922e-501a3724cd28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:07.534998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce1a37-7a63-4544-922e-501a3724cd28 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:07.535481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce1a37-7a63-4544-922e-501a3724cd28 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:07.535947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce1a37-7a63-4544-922e-501a3724cd28 None admin] PATH_INFO: `/v3/groups/fb8cbfec22dc4f4d92cf4638bd594e2e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:07.541477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce1a37-7a63-4544-922e-501a3724cd28 None admin] RBAC: Authorizing `identity:get_group(group_id=fb8cbfec22dc4f4d92cf4638bd594e2e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:07.543227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce1a37-7a63-4544-922e-501a3724cd28 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:07.545462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 198/377] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 15:52:07 2022] GET /identity/v3/groups/fb8cbfec22dc4f4d92cf4638bd594e2e => generated 229 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:07.547036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d7729-6aa7-4ca3-8e63-2c43930e7424 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:07.547523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d7729-6aa7-4ca3-8e63-2c43930e7424 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:07.548025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d7729-6aa7-4ca3-8e63-2c43930e7424 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:07.549499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 199/378] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:07.554512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d7729-6aa7-4ca3-8e63-2c43930e7424 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:07.564740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bf610e-fbc9-4f06-96f5-c5562305d9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:07.565585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf610e-fbc9-4f06-96f5-c5562305d9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:07.565863 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf610e-fbc9-4f06-96f5-c5562305d9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:07.566137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bf610e-fbc9-4f06-96f5-c5562305d9e7 None admin] PATH_INFO: `/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:07.567441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf610e-fbc9-4f06-96f5-c5562305d9e7 None admin] RBAC: Authorizing `identity:get_group(group_id=f1ddfcb6b7544fad8d81b7875e8d89f7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:07.569057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bf610e-fbc9-4f06-96f5-c5562305d9e7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:07.571169 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 180/379] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 15:52:07 2022] GET /identity/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7 => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:07.572415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a3fdc-664d-460b-b84f-ce615867c61b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:07.572695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a3fdc-664d-460b-b84f-ce615867c61b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:07.572967 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a3fdc-664d-460b-b84f-ce615867c61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:07.591916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2d3a3fdc-664d-460b-b84f-ce615867c61b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:07.593250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2d3a3fdc-664d-460b-b84f-ce615867c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:07.682846 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 181/380] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:07.682846 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a3fdc-664d-460b-b84f-ce615867c61b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:07.693961 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d7729-6aa7-4ca3-8e63-2c43930e7424 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:07.706848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:07.741717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042a800-e51a-4ca0-9186-6d69a7744b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:07.742765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042a800-e51a-4ca0-9186-6d69a7744b48 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:07.743268 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042a800-e51a-4ca0-9186-6d69a7744b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:07.743731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042a800-e51a-4ca0-9186-6d69a7744b48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:07.744758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042a800-e51a-4ca0-9186-6d69a7744b48 None admin] RBAC: Adding query filter params (group.id=fb8cbfec22dc4f4d92cf4638bd594e2e, role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=ab5b6764e1c145b69436e883cfb29e46) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:07.745261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042a800-e51a-4ca0-9186-6d69a7744b48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:07.747451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6042a800-e51a-4ca0-9186-6d69a7744b48 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:07.753688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 200/381] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 15:52:07 2022] GET /identity/v3/role_assignments?group.id=fb8cbfec22dc4f4d92cf4638bd594e2e&scope.project.id=ab5b6764e1c145b69436e883cfb29e46&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:07.754783 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042a800-e51a-4ca0-9186-6d69a7744b48 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:07.790900 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a3fdc-664d-460b-b84f-ce615867c61b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:07.799185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:07.832078 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8c528-5eec-4d24-9819-bfef8802f80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:07.832769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8c528-5eec-4d24-9819-bfef8802f80b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:07.833044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8c528-5eec-4d24-9819-bfef8802f80b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:07.833316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8c528-5eec-4d24-9819-bfef8802f80b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:07.834297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8c528-5eec-4d24-9819-bfef8802f80b None admin] RBAC: Adding query filter params (group.id=f1ddfcb6b7544fad8d81b7875e8d89f7, role.id=e9dc595c6b4248d3b5262b70a90e76c5, scope.project.id=e69f0e40da80459cb7b997f21995950a) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:07.834610 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8c528-5eec-4d24-9819-bfef8802f80b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:07.836170 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8c528-5eec-4d24-9819-bfef8802f80b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:07.846019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 182/382] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 15:52:07 2022] GET /identity/v3/role_assignments?group.id=f1ddfcb6b7544fad8d81b7875e8d89f7&scope.project.id=e69f0e40da80459cb7b997f21995950a&role.id=e9dc595c6b4248d3b5262b70a90e76c5 => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:07.916689 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042a800-e51a-4ca0-9186-6d69a7744b48 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:07.961907 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dd33e-763d-4a0b-9814-139c6355ff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:07.962677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dd33e-763d-4a0b-9814-139c6355ff2e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:07.962989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dd33e-763d-4a0b-9814-139c6355ff2e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:07.963266 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dd33e-763d-4a0b-9814-139c6355ff2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:07.976734 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83dd33e-763d-4a0b-9814-139c6355ff2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e83dd33e-763d-4a0b-9814-139c6355ff2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:07.984991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:07.985953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:07.987348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:07.987348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:07.987348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:07.987348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:07.987348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:07.987348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:07.987348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:07.987348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:07.987348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:07.987348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:07.987348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:52:07.987348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:07.987348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 201/383] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:07.993279 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8c528-5eec-4d24-9819-bfef8802f80b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:08.114446 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8c528-5eec-4d24-9819-bfef8802f80b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:08.159664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e989c-14f7-4516-b293-29d5f86eb63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:08.160703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e989c-14f7-4516-b293-29d5f86eb63d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:08.161199 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e989c-14f7-4516-b293-29d5f86eb63d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:08.161662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e989c-14f7-4516-b293-29d5f86eb63d None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:08.162607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e989c-14f7-4516-b293-29d5f86eb63d None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:08.163183 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e989c-14f7-4516-b293-29d5f86eb63d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:08.164829 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e989c-14f7-4516-b293-29d5f86eb63d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:08.195353 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 183/384] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:52:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:08.197840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dd33e-763d-4a0b-9814-139c6355ff2e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:08.262601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:08.357234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83dd33e-763d-4a0b-9814-139c6355ff2e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:08.396129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90130be-e610-4bec-87f9-c1e1b558011f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:08.397019 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90130be-e610-4bec-87f9-c1e1b558011f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:08.397298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90130be-e610-4bec-87f9-c1e1b558011f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:08.397573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90130be-e610-4bec-87f9-c1e1b558011f None admin] PATH_INFO: `/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:08.403567 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90130be-e610-4bec-87f9-c1e1b558011f None admin] RBAC: Authorizing `identity:get_group(group_id=f1ddfcb6b7544fad8d81b7875e8d89f7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:08.405076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90130be-e610-4bec-87f9-c1e1b558011f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:08.407209 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 202/385] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 15:52:08 2022] GET /identity/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:08.412910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e989c-14f7-4516-b293-29d5f86eb63d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:08.466011 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:08.551523 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e989c-14f7-4516-b293-29d5f86eb63d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:08.589995 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8888b93-11f2-4d90-8357-0de6e7d32c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:08.590913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8888b93-11f2-4d90-8357-0de6e7d32c58 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:08.591198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8888b93-11f2-4d90-8357-0de6e7d32c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:08.591473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8888b93-11f2-4d90-8357-0de6e7d32c58 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:08.592877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8888b93-11f2-4d90-8357-0de6e7d32c58 None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:08.594231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8888b93-11f2-4d90-8357-0de6e7d32c58 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:08.596330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 184/386] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:52:08 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:08.602082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90130be-e610-4bec-87f9-c1e1b558011f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:08.758103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:08.761685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90130be-e610-4bec-87f9-c1e1b558011f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:08.805308 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430978c-9a2a-4241-bc36-f24d1d75c87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:08.806135 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430978c-9a2a-4241-bc36-f24d1d75c87f None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:08.806422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430978c-9a2a-4241-bc36-f24d1d75c87f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:08.806695 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430978c-9a2a-4241-bc36-f24d1d75c87f None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c/groups/f1ddfcb6b7544fad8d81b7875e8d89f7/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:08.812314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430978c-9a2a-4241-bc36-f24d1d75c87f None admin] RBAC: Authorizing `identity:create_grant(project_id=10efcfb517724a609d32a0457044f00c, group_id=f1ddfcb6b7544fad8d81b7875e8d89f7, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:08.813805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430978c-9a2a-4241-bc36-f24d1d75c87f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:08.842898 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 203/387] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 21 15:52:08 2022] PUT /identity/v3/projects/10efcfb517724a609d32a0457044f00c/groups/f1ddfcb6b7544fad8d81b7875e8d89f7/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:52:08.922582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ac70e-bfbc-45cc-aad6-96b1492ef4ab None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:08.922956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ac70e-bfbc-45cc-aad6-96b1492ef4ab None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:08.923237 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ac70e-bfbc-45cc-aad6-96b1492ef4ab None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:08.924947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 185/388] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:08.931349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d04dd-ec87-44d7-9d74-d46c18e22d4d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:08.931664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d04dd-ec87-44d7-9d74-d46c18e22d4d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:08.931915 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d04dd-ec87-44d7-9d74-d46c18e22d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:08.956947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-450d04dd-ec87-44d7-9d74-d46c18e22d4d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:08.958191 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-450d04dd-ec87-44d7-9d74-d46c18e22d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:09.049950 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 204/389] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:09.092619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ac70e-bfbc-45cc-aad6-96b1492ef4ab None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:09.215943 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:09.219727 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ac70e-bfbc-45cc-aad6-96b1492ef4ab None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:09.226835 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f3f03-f4aa-448d-8b08-ca2daa93164a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:09.227325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f3f03-f4aa-448d-8b08-ca2daa93164a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:09.227427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f3f03-f4aa-448d-8b08-ca2daa93164a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:09.229053 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 205/390] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:52:09.234505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832adff4-2939-4499-9141-b68e818dfd19 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:09.235069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832adff4-2939-4499-9141-b68e818dfd19 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:09.235542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832adff4-2939-4499-9141-b68e818dfd19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:09.256264 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-832adff4-2939-4499-9141-b68e818dfd19 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:09.257778 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-832adff4-2939-4499-9141-b68e818dfd19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:09.281126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68505f-cf75-4fb4-b9d6-7ad8a2a62e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:09.281973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68505f-cf75-4fb4-b9d6-7ad8a2a62e2d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:09.282255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68505f-cf75-4fb4-b9d6-7ad8a2a62e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:09.282532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68505f-cf75-4fb4-b9d6-7ad8a2a62e2d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:09.299280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68505f-cf75-4fb4-b9d6-7ad8a2a62e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7f68505f-cf75-4fb4-b9d6-7ad8a2a62e2d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:09.310878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:09.311867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:09.312916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:09.312916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:09.312916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:09.312916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:09.312916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:09.312916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:09.312916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:09.312916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:09.312916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:09.312916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:09.312916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:52:09.312916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:09.312916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 186/391] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:52:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:09.318708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68505f-cf75-4fb4-b9d6-7ad8a2a62e2d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:09.359346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 206/392] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:09.383171 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832adff4-2939-4499-9141-b68e818dfd19 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:09.407478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:09.447505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68505f-cf75-4fb4-b9d6-7ad8a2a62e2d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:09.483666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a94139-3c2e-4af7-9367-889edb32f6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:09.484413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a94139-3c2e-4af7-9367-889edb32f6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:09.484696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a94139-3c2e-4af7-9367-889edb32f6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:09.484970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a94139-3c2e-4af7-9367-889edb32f6c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:09.485791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a94139-3c2e-4af7-9367-889edb32f6c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:09.486255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a94139-3c2e-4af7-9367-889edb32f6c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:09.487601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a94139-3c2e-4af7-9367-889edb32f6c3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:09.502322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 187/393] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:09.503628 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832adff4-2939-4499-9141-b68e818dfd19 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:09.507647 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a94139-3c2e-4af7-9367-889edb32f6c3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:09.543217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:09.544698 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c94f8a-8cc4-4a68-b3d3-a5015659a503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:09.545974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c94f8a-8cc4-4a68-b3d3-a5015659a503 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:09.546492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c94f8a-8cc4-4a68-b3d3-a5015659a503 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:09.548072 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c94f8a-8cc4-4a68-b3d3-a5015659a503 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:09.561921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c94f8a-8cc4-4a68-b3d3-a5015659a503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e6c94f8a-8cc4-4a68-b3d3-a5015659a503 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:09.570594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:09.571575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:09.572451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:09.572451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:09.572451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:09.572451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:09.572451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:09.572451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:09.572451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:09.572451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:09.572451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:09.572451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:09.572451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:52:09.572451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:09.579064 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 207/394] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:09.581733 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c94f8a-8cc4-4a68-b3d3-a5015659a503 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:09.649698 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a94139-3c2e-4af7-9367-889edb32f6c3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:09.679318 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:09.687639 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1392c5-815e-42f7-a814-fa71e2b43b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:09.688533 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1392c5-815e-42f7-a814-fa71e2b43b35 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:09.688815 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1392c5-815e-42f7-a814-fa71e2b43b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:09.689090 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1392c5-815e-42f7-a814-fa71e2b43b35 None admin] PATH_INFO: `/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:09.690430 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1392c5-815e-42f7-a814-fa71e2b43b35 None admin] RBAC: Authorizing `identity:get_group(group_id=f1ddfcb6b7544fad8d81b7875e8d89f7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:09.693115 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1392c5-815e-42f7-a814-fa71e2b43b35 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:09.695197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 188/395] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 15:52:09 2022] GET /identity/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:09.702756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1392c5-815e-42f7-a814-fa71e2b43b35 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:09.712874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c94f8a-8cc4-4a68-b3d3-a5015659a503 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:09.754505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5496e-b976-4c28-b6df-3a20f819a223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:09.755321 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5496e-b976-4c28-b6df-3a20f819a223 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:09.755844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5496e-b976-4c28-b6df-3a20f819a223 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:09.756302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5496e-b976-4c28-b6df-3a20f819a223 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:09.757599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5496e-b976-4c28-b6df-3a20f819a223 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:09.758119 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5496e-b976-4c28-b6df-3a20f819a223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:09.761018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf5496e-b976-4c28-b6df-3a20f819a223 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:09.774958 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 208/396] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:52:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:09.776344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5496e-b976-4c28-b6df-3a20f819a223 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:09.903613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:09.924393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1392c5-815e-42f7-a814-fa71e2b43b35 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:09.936050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5496e-b976-4c28-b6df-3a20f819a223 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:09.991332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddc355-7dd1-4219-bf78-745db62f96ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:09.992632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddc355-7dd1-4219-bf78-745db62f96ad None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:09.993113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddc355-7dd1-4219-bf78-745db62f96ad None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:09.993600 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddc355-7dd1-4219-bf78-745db62f96ad None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:09.995225 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddc355-7dd1-4219-bf78-745db62f96ad None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:09.997752 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cddc355-7dd1-4219-bf78-745db62f96ad None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:10.000178 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 189/397] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:52:09 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:10.003606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55744da-f338-4619-ba4e-719f7d2a1ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:10.004935 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55744da-f338-4619-ba4e-719f7d2a1ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:10.005505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55744da-f338-4619-ba4e-719f7d2a1ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:10.006561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddc355-7dd1-4219-bf78-745db62f96ad None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:10.007086 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55744da-f338-4619-ba4e-719f7d2a1ad4 None admin] PATH_INFO: `/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:10.012224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55744da-f338-4619-ba4e-719f7d2a1ad4 None admin] RBAC: Authorizing `identity:get_group(group_id=f1ddfcb6b7544fad8d81b7875e8d89f7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:10.014023 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55744da-f338-4619-ba4e-719f7d2a1ad4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:10.027225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 209/398] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 15:52:09 2022] GET /identity/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:10.044669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55744da-f338-4619-ba4e-719f7d2a1ad4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:10.062833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:10.164859 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cddc355-7dd1-4219-bf78-745db62f96ad None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:10.213709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55744da-f338-4619-ba4e-719f7d2a1ad4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:10.220485 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560d76a-93bf-43b4-b719-168dace79b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:10.222035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560d76a-93bf-43b4-b719-168dace79b29 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:10.222466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560d76a-93bf-43b4-b719-168dace79b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:10.222950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560d76a-93bf-43b4-b719-168dace79b29 None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c/groups/f1ddfcb6b7544fad8d81b7875e8d89f7/roles/e9dc595c6b4248d3b5262b70a90e76c5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:10.226520 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560d76a-93bf-43b4-b719-168dace79b29 None admin] RBAC: Authorizing `identity:create_grant(project_id=10efcfb517724a609d32a0457044f00c, group_id=f1ddfcb6b7544fad8d81b7875e8d89f7, role_id=e9dc595c6b4248d3b5262b70a90e76c5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:10.228234 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560d76a-93bf-43b4-b719-168dace79b29 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:10.247152 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 190/399] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 21 15:52:10 2022] PUT /identity/v3/projects/10efcfb517724a609d32a0457044f00c/groups/f1ddfcb6b7544fad8d81b7875e8d89f7/roles/e9dc595c6b4248d3b5262b70a90e76c5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:52:10.254222 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3f826a-37f3-4943-8c91-734be626916d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:10.255243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f826a-37f3-4943-8c91-734be626916d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:10.255546 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f826a-37f3-4943-8c91-734be626916d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:10.255850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f826a-37f3-4943-8c91-734be626916d None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:10.257246 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f826a-37f3-4943-8c91-734be626916d None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:10.258841 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3f826a-37f3-4943-8c91-734be626916d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:10.261582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 210/400] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:52:10 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:10.267917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560d76a-93bf-43b4-b719-168dace79b29 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:10.302296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:10.408685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560d76a-93bf-43b4-b719-168dace79b29 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:10.454983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c68ae-4eae-4df0-88c3-ad03c38de2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:10.455832 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c68ae-4eae-4df0-88c3-ad03c38de2fa None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:10.456177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c68ae-4eae-4df0-88c3-ad03c38de2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:10.456461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c68ae-4eae-4df0-88c3-ad03c38de2fa None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a/groups/f1ddfcb6b7544fad8d81b7875e8d89f7/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:10.461353 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c68ae-4eae-4df0-88c3-ad03c38de2fa None admin] RBAC: Authorizing `identity:create_grant(project_id=e69f0e40da80459cb7b997f21995950a, group_id=f1ddfcb6b7544fad8d81b7875e8d89f7, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:10.462895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c68ae-4eae-4df0-88c3-ad03c38de2fa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:10.494230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 191/401] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 21 15:52:10 2022] PUT /identity/v3/projects/e69f0e40da80459cb7b997f21995950a/groups/f1ddfcb6b7544fad8d81b7875e8d89f7/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:52:10.629784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c772e8-5ba5-4bb7-8e4b-8210c8013075 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:10.630187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c772e8-5ba5-4bb7-8e4b-8210c8013075 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:10.630368 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c772e8-5ba5-4bb7-8e4b-8210c8013075 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:10.632136 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 211/402] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:10.637988 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de339e9d-19ef-4854-95cc-b4020b147a02 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:10.638362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de339e9d-19ef-4854-95cc-b4020b147a02 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:10.638547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de339e9d-19ef-4854-95cc-b4020b147a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:10.659884 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-de339e9d-19ef-4854-95cc-b4020b147a02 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:10.661195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-de339e9d-19ef-4854-95cc-b4020b147a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:10.738504 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 192/403] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:52:10.761155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c772e8-5ba5-4bb7-8e4b-8210c8013075 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:10.877700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:10.896287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b23db7-da35-4e44-a013-34de7d853220 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:10.896713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b23db7-da35-4e44-a013-34de7d853220 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:10.897089 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b23db7-da35-4e44-a013-34de7d853220 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:10.898856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 193/404] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:10.907361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6bd04-a87c-4688-9301-4e149135c281 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:10.907750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6bd04-a87c-4688-9301-4e149135c281 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:10.908126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6bd04-a87c-4688-9301-4e149135c281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:10.908548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c772e8-5ba5-4bb7-8e4b-8210c8013075 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:10.939487 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cff6bd04-a87c-4688-9301-4e149135c281 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:10.943947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cff6bd04-a87c-4688-9301-4e149135c281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:10.963241 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:10.969106 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e166e9-a32c-4c52-aa03-16bd63bd79df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:10.970035 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e166e9-a32c-4c52-aa03-16bd63bd79df None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:10.970370 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e166e9-a32c-4c52-aa03-16bd63bd79df None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:10.970800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e166e9-a32c-4c52-aa03-16bd63bd79df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:10.985129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e166e9-a32c-4c52-aa03-16bd63bd79df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e8e166e9-a32c-4c52-aa03-16bd63bd79df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:11.000771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:11.001726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:11.002548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:11.002548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:11.002548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:11.002548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:11.002548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:11.002548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:11.002548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:11.002548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:11.002548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:11.002548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:11.002548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:11.002548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:11.002548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 212/405] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:52:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:11.010378 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e166e9-a32c-4c52-aa03-16bd63bd79df None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:11.074216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 194/406] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:52:11.105925 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6bd04-a87c-4688-9301-4e149135c281 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:11.166198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e166e9-a32c-4c52-aa03-16bd63bd79df None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:11.206355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e074407-8a67-48a6-bf6e-b06bc56c3e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:11.208772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e074407-8a67-48a6-bf6e-b06bc56c3e8c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:11.209896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e074407-8a67-48a6-bf6e-b06bc56c3e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:11.210484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e074407-8a67-48a6-bf6e-b06bc56c3e8c None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:11.212949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e074407-8a67-48a6-bf6e-b06bc56c3e8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:11.214251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e074407-8a67-48a6-bf6e-b06bc56c3e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:11.216627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e074407-8a67-48a6-bf6e-b06bc56c3e8c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:11.224859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:11.238209 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 213/407] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:11.245513 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e074407-8a67-48a6-bf6e-b06bc56c3e8c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:11.318322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6bd04-a87c-4688-9301-4e149135c281 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:11.392644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd6983-5410-4436-b35d-f22b90035eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:11.393685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd6983-5410-4436-b35d-f22b90035eae None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:11.394093 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd6983-5410-4436-b35d-f22b90035eae None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:11.394462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd6983-5410-4436-b35d-f22b90035eae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:11.403258 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e074407-8a67-48a6-bf6e-b06bc56c3e8c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:11.405310 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd6983-5410-4436-b35d-f22b90035eae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9cfd6983-5410-4436-b35d-f22b90035eae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:11.413935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:11.415009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:11.415779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:11.415779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:11.415779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:11.415779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:11.415779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:11.415779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:11.415779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:11.415779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:11.415779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:11.415779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:11.415779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:52:11.415779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:11.416416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 195/408] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:52:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:11.419208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:11.424603 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd6983-5410-4436-b35d-f22b90035eae None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:11.450025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359bfce-1781-403f-aea0-a7cf5da3ab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:11.450971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359bfce-1781-403f-aea0-a7cf5da3ab7b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:11.451254 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359bfce-1781-403f-aea0-a7cf5da3ab7b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:11.451528 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359bfce-1781-403f-aea0-a7cf5da3ab7b None admin] PATH_INFO: `/v3/groups/fb8cbfec22dc4f4d92cf4638bd594e2e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:11.455053 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359bfce-1781-403f-aea0-a7cf5da3ab7b None admin] RBAC: Authorizing `identity:get_group(group_id=fb8cbfec22dc4f4d92cf4638bd594e2e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:11.458040 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d359bfce-1781-403f-aea0-a7cf5da3ab7b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:11.459847 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 214/409] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 15:52:11 2022] GET /identity/v3/groups/fb8cbfec22dc4f4d92cf4638bd594e2e => generated 229 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:11.466676 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359bfce-1781-403f-aea0-a7cf5da3ab7b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:11.599334 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:11.642206 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd6983-5410-4436-b35d-f22b90035eae None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:11.658505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359bfce-1781-403f-aea0-a7cf5da3ab7b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:11.687065 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd33b0c-45ff-4eb7-820b-166ca75b099d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:11.687768 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd33b0c-45ff-4eb7-820b-166ca75b099d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:11.688377 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd33b0c-45ff-4eb7-820b-166ca75b099d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:11.688655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd33b0c-45ff-4eb7-820b-166ca75b099d None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:11.689761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd33b0c-45ff-4eb7-820b-166ca75b099d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:11.690076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd33b0c-45ff-4eb7-820b-166ca75b099d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:11.692571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd33b0c-45ff-4eb7-820b-166ca75b099d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:11.703786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd1caf-dece-45ac-a788-c71f1fad57f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:11.704356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 196/410] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:11.704876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd1caf-dece-45ac-a788-c71f1fad57f7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:11.705282 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd1caf-dece-45ac-a788-c71f1fad57f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:11.705622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd1caf-dece-45ac-a788-c71f1fad57f7 None admin] PATH_INFO: `/v3/projects/ab5b6764e1c145b69436e883cfb29e46` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:11.705789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403e850-62f1-42d2-a3fc-38152270ba56 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:11.706112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403e850-62f1-42d2-a3fc-38152270ba56 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:11.706393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403e850-62f1-42d2-a3fc-38152270ba56 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:11.707131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd1caf-dece-45ac-a788-c71f1fad57f7 None admin] RBAC: Authorizing `identity:get_project(project_id=ab5b6764e1c145b69436e883cfb29e46)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:11.707868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 197/411] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:11.709383 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403e850-62f1-42d2-a3fc-38152270ba56 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:11.713147 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd1caf-dece-45ac-a788-c71f1fad57f7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:11.715059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 215/412] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:52:11 2022] GET /identity/v3/projects/ab5b6764e1c145b69436e883cfb29e46 => generated 344 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:11.716075 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa1647-dd5f-4b4c-9616-209ceb4e4236 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:11.716357 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa1647-dd5f-4b4c-9616-209ceb4e4236 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:11.716638 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa1647-dd5f-4b4c-9616-209ceb4e4236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:11.738617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a1fa1647-dd5f-4b4c-9616-209ceb4e4236 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:11.739843 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a1fa1647-dd5f-4b4c-9616-209ceb4e4236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:11.791150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:11.809003 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 216/413] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:11.809881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa1647-dd5f-4b4c-9616-209ceb4e4236 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:11.845977 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403e850-62f1-42d2-a3fc-38152270ba56 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:11.876347 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:11.897757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a89f7d-5675-4bf8-8058-848d670d92db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:11.899386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a89f7d-5675-4bf8-8058-848d670d92db None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:11.899929 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a89f7d-5675-4bf8-8058-848d670d92db None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:11.900361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a89f7d-5675-4bf8-8058-848d670d92db None admin] PATH_INFO: `/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:11.902169 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a89f7d-5675-4bf8-8058-848d670d92db None admin] RBAC: Authorizing `identity:get_group(group_id=f1ddfcb6b7544fad8d81b7875e8d89f7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:11.904591 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a89f7d-5675-4bf8-8058-848d670d92db None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:11.907347 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 198/414] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 15:52:11 2022] GET /identity/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:11.908713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a89f7d-5675-4bf8-8058-848d670d92db None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:11.925198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa1647-dd5f-4b4c-9616-209ceb4e4236 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:11.964331 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129cd68-b38b-4470-991e-2c97387c5b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:11.965265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129cd68-b38b-4470-991e-2c97387c5b09 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:11.965567 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129cd68-b38b-4470-991e-2c97387c5b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:11.965848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129cd68-b38b-4470-991e-2c97387c5b09 None admin] PATH_INFO: `/v3/projects/ab5b6764e1c145b69436e883cfb29e46/groups/fb8cbfec22dc4f4d92cf4638bd594e2e/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:11.968367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129cd68-b38b-4470-991e-2c97387c5b09 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab5b6764e1c145b69436e883cfb29e46, group_id=fb8cbfec22dc4f4d92cf4638bd594e2e, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:11.969941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129cd68-b38b-4470-991e-2c97387c5b09 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:11.986503 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 217/415] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 21 15:52:11 2022] PUT /identity/v3/projects/ab5b6764e1c145b69436e883cfb29e46/groups/fb8cbfec22dc4f4d92cf4638bd594e2e/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:52:11.987722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129cd68-b38b-4470-991e-2c97387c5b09 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:12.028742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a89f7d-5675-4bf8-8058-848d670d92db None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:12.058007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:12.085123 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056329e-656e-4cc1-82cd-4570dfb662e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:12.085964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056329e-656e-4cc1-82cd-4570dfb662e1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:12.086250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056329e-656e-4cc1-82cd-4570dfb662e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:12.086537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056329e-656e-4cc1-82cd-4570dfb662e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:12.108576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056329e-656e-4cc1-82cd-4570dfb662e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:12.112941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129cd68-b38b-4470-991e-2c97387c5b09 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0056329e-656e-4cc1-82cd-4570dfb662e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:12.124907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:12.125851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:12.126682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:12.126682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:12.126682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:12.126682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:12.126682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:12.126682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:12.126682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:12.126682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:12.126682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:12.126682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:12.126682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:52:12.126682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:12.126682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 199/416] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:12.132262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056329e-656e-4cc1-82cd-4570dfb662e1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:12.141616 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:12.154136 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013a79e-f42b-454c-9e9f-6dafb0b0a8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:12.155100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013a79e-f42b-454c-9e9f-6dafb0b0a8dc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:12.155474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013a79e-f42b-454c-9e9f-6dafb0b0a8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:12.155753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013a79e-f42b-454c-9e9f-6dafb0b0a8dc None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:12.157423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013a79e-f42b-454c-9e9f-6dafb0b0a8dc None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:12.159063 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013a79e-f42b-454c-9e9f-6dafb0b0a8dc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:12.161339 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 218/417] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:52:11 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:12.169606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013a79e-f42b-454c-9e9f-6dafb0b0a8dc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:12.302480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056329e-656e-4cc1-82cd-4570dfb662e1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:12.303711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013a79e-f42b-454c-9e9f-6dafb0b0a8dc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:12.340978 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996efb0c-3b59-4382-bc5d-c0b21de10d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:12.341794 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996efb0c-3b59-4382-bc5d-c0b21de10d67 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:12.342075 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996efb0c-3b59-4382-bc5d-c0b21de10d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:12.342350 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996efb0c-3b59-4382-bc5d-c0b21de10d67 None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a/groups/f1ddfcb6b7544fad8d81b7875e8d89f7/roles/e9dc595c6b4248d3b5262b70a90e76c5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:12.344556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996efb0c-3b59-4382-bc5d-c0b21de10d67 None admin] RBAC: Authorizing `identity:create_grant(project_id=e69f0e40da80459cb7b997f21995950a, group_id=f1ddfcb6b7544fad8d81b7875e8d89f7, role_id=e9dc595c6b4248d3b5262b70a90e76c5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:12.346063 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996efb0c-3b59-4382-bc5d-c0b21de10d67 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:12.346497 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a30e2e7-c1ef-4f9d-8563-2cb7fa13780a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:12.347918 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30e2e7-c1ef-4f9d-8563-2cb7fa13780a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:12.348557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30e2e7-c1ef-4f9d-8563-2cb7fa13780a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:12.349094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a30e2e7-c1ef-4f9d-8563-2cb7fa13780a None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:12.350667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30e2e7-c1ef-4f9d-8563-2cb7fa13780a None admin] RBAC: Adding query filter params (name=member) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:12.351308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30e2e7-c1ef-4f9d-8563-2cb7fa13780a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:12.353081 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a30e2e7-c1ef-4f9d-8563-2cb7fa13780a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:12.370226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 219/418] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Jul 21 15:52:12 2022] PUT /identity/v3/projects/e69f0e40da80459cb7b997f21995950a/groups/f1ddfcb6b7544fad8d81b7875e8d89f7/roles/e9dc595c6b4248d3b5262b70a90e76c5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:52:12.373747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 200/419] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:52:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:12.382212 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996efb0c-3b59-4382-bc5d-c0b21de10d67 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:12.446829 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:12.519320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996efb0c-3b59-4382-bc5d-c0b21de10d67 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:12.566542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b2b12-610a-419d-b70a-117598a68ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:12.567659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b2b12-610a-419d-b70a-117598a68ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:12.568136 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b2b12-610a-419d-b70a-117598a68ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:12.568597 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b2b12-610a-419d-b70a-117598a68ce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:12.640525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b2b12-610a-419d-b70a-117598a68ce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:12.642426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b2b12-610a-419d-b70a-117598a68ce9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:12.698857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92d934-e13b-45fd-95ad-249dc938ada5 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:12.698857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92d934-e13b-45fd-95ad-249dc938ada5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:12.699148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:12.699224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92d934-e13b-45fd-95ad-249dc938ada5 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:12.700164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 201/420] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:12.706082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c18bd0-9f4f-411b-85d0-8230e1af6e9b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:12.706409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c18bd0-9f4f-411b-85d0-8230e1af6e9b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:12.706687 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c18bd0-9f4f-411b-85d0-8230e1af6e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:12.735045 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-00c18bd0-9f4f-411b-85d0-8230e1af6e9b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:12.736256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-00c18bd0-9f4f-411b-85d0-8230e1af6e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:12.757890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 220/421] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:12.763164 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b2b12-610a-419d-b70a-117598a68ce9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:12.848987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:12.890177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 202/422] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:52:12.913645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c18bd0-9f4f-411b-85d0-8230e1af6e9b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:12.925008 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b2b12-610a-419d-b70a-117598a68ce9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:12.991990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcf325-b7aa-4eb6-9fa9-514150a12b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:12.992880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcf325-b7aa-4eb6-9fa9-514150a12b6f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:12.993166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcf325-b7aa-4eb6-9fa9-514150a12b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:12.993434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bcf325-b7aa-4eb6-9fa9-514150a12b6f None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:12.995872 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcf325-b7aa-4eb6-9fa9-514150a12b6f None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:12.997337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bcf325-b7aa-4eb6-9fa9-514150a12b6f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:12.999085 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 221/423] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:52:12 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:13.005393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcf325-b7aa-4eb6-9fa9-514150a12b6f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:13.050524 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:13.084076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c18bd0-9f4f-411b-85d0-8230e1af6e9b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:13.120311 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182a44c-23e2-4662-ab6f-ccacfd2da5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:13.121135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182a44c-23e2-4662-ab6f-ccacfd2da5a6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:13.121415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182a44c-23e2-4662-ab6f-ccacfd2da5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:13.121685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182a44c-23e2-4662-ab6f-ccacfd2da5a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:13.133032 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182a44c-23e2-4662-ab6f-ccacfd2da5a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c182a44c-23e2-4662-ab6f-ccacfd2da5a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:13.141984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:13.142901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:13.143776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:13.143776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:13.143776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:13.143776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:13.143776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:13.143776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:13.143776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:13.143776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:13.143776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:13.143776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:13.143776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:52:13.143776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:13.143776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 203/424] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:52:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:13.149955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182a44c-23e2-4662-ab6f-ccacfd2da5a6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:13.208363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:13.210338 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bcf325-b7aa-4eb6-9fa9-514150a12b6f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:13.258712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd307dc6-dda7-4ffe-b408-9f27ed4a67e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:13.259647 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd307dc6-dda7-4ffe-b408-9f27ed4a67e4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:13.260176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd307dc6-dda7-4ffe-b408-9f27ed4a67e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:13.260459 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd307dc6-dda7-4ffe-b408-9f27ed4a67e4 None admin] PATH_INFO: `/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:13.262061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd307dc6-dda7-4ffe-b408-9f27ed4a67e4 None admin] RBAC: Authorizing `identity:get_group(group_id=f1ddfcb6b7544fad8d81b7875e8d89f7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:13.264075 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd307dc6-dda7-4ffe-b408-9f27ed4a67e4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:13.266535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 222/425] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 15:52:13 2022] GET /identity/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:13.268643 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1683ceb-7537-41c6-b7ee-af9242cd15b8 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:13.268939 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1683ceb-7537-41c6-b7ee-af9242cd15b8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:13.269222 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1683ceb-7537-41c6-b7ee-af9242cd15b8 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:13.271263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 223/426] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:13.275543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1683ceb-7537-41c6-b7ee-af9242cd15b8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:13.281523 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182a44c-23e2-4662-ab6f-ccacfd2da5a6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:13.318122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42be16b-aac0-4851-a65a-5ea0c9c9048e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:13.318828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42be16b-aac0-4851-a65a-5ea0c9c9048e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:13.319151 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42be16b-aac0-4851-a65a-5ea0c9c9048e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:13.319428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42be16b-aac0-4851-a65a-5ea0c9c9048e None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:13.320458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42be16b-aac0-4851-a65a-5ea0c9c9048e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:13.320802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42be16b-aac0-4851-a65a-5ea0c9c9048e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:13.323146 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42be16b-aac0-4851-a65a-5ea0c9c9048e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:13.338828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 204/427] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:13.341450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563add59-99e6-4599-9bfd-0b4b8e736bd9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:13.341742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563add59-99e6-4599-9bfd-0b4b8e736bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:13.342021 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563add59-99e6-4599-9bfd-0b4b8e736bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:13.359339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-563add59-99e6-4599-9bfd-0b4b8e736bd9 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:13.360615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-563add59-99e6-4599-9bfd-0b4b8e736bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:13.388023 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:13.403720 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1683ceb-7537-41c6-b7ee-af9242cd15b8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:13.437166 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 205/428] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:13.438107 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563add59-99e6-4599-9bfd-0b4b8e736bd9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:13.444173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9a92c-9081-4b35-96d5-2f1fcea27f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:13.445229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9a92c-9081-4b35-96d5-2f1fcea27f13 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:13.445725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9a92c-9081-4b35-96d5-2f1fcea27f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:13.446250 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9a92c-9081-4b35-96d5-2f1fcea27f13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:13.447367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9a92c-9081-4b35-96d5-2f1fcea27f13 None admin] RBAC: Adding query filter params (group.id=f1ddfcb6b7544fad8d81b7875e8d89f7, role.id=64e044de7dcc4949acf8ce7eaf08fdaa, scope.project.id=10efcfb517724a609d32a0457044f00c) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:13.448333 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9a92c-9081-4b35-96d5-2f1fcea27f13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:13.450066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb9a92c-9081-4b35-96d5-2f1fcea27f13 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:13.457333 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 224/429] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 15:52:13 2022] GET /identity/v3/role_assignments?group.id=f1ddfcb6b7544fad8d81b7875e8d89f7&scope.project.id=10efcfb517724a609d32a0457044f00c&role.id=64e044de7dcc4949acf8ce7eaf08fdaa => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:13.470650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9a92c-9081-4b35-96d5-2f1fcea27f13 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:13.515251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:13.605718 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9a92c-9081-4b35-96d5-2f1fcea27f13 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:13.642169 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3eeb28-c2f6-43d7-a026-796c23cb7378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:13.642992 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3eeb28-c2f6-43d7-a026-796c23cb7378 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:13.643277 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3eeb28-c2f6-43d7-a026-796c23cb7378 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:13.643558 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3eeb28-c2f6-43d7-a026-796c23cb7378 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:13.654302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3eeb28-c2f6-43d7-a026-796c23cb7378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-6a3eeb28-c2f6-43d7-a026-796c23cb7378 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:13.663243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:13.664137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:13.665369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:13.665369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:13.665369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:13.665369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:13.665369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:13.665369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:13.665369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:13.665369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:13.665369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:13.665369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:13.665369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 15:52:13.665369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:13.665369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 225/430] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:13.671501 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3eeb28-c2f6-43d7-a026-796c23cb7378 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:13.691753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:13.701108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563add59-99e6-4599-9bfd-0b4b8e736bd9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:13.745679 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bccb1-59ea-4409-a632-90293d929718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:13.746349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bccb1-59ea-4409-a632-90293d929718 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:13.746631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bccb1-59ea-4409-a632-90293d929718 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:13.746946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2bccb1-59ea-4409-a632-90293d929718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:13.820582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3eeb28-c2f6-43d7-a026-796c23cb7378 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:13.851491 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bccb1-59ea-4409-a632-90293d929718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:13.852984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2bccb1-59ea-4409-a632-90293d929718 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:13.870932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a11eb-92cd-47c5-b007-b99fc97c2bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:13.871772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a11eb-92cd-47c5-b007-b99fc97c2bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:13.872176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a11eb-92cd-47c5-b007-b99fc97c2bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:13.872456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a11eb-92cd-47c5-b007-b99fc97c2bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:13.873474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a11eb-92cd-47c5-b007-b99fc97c2bc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:13.873786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a11eb-92cd-47c5-b007-b99fc97c2bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:13.875601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a11eb-92cd-47c5-b007-b99fc97c2bc7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:13.888731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 226/431] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:52:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:13.891931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:13.897922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a11eb-92cd-47c5-b007-b99fc97c2bc7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:13.980175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 206/432] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:13.985813 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bccb1-59ea-4409-a632-90293d929718 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:13.996860 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:14.032522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a11eb-92cd-47c5-b007-b99fc97c2bc7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:14.075886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8c110-7a75-4648-9ff5-94383f978590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:14.077825 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8c110-7a75-4648-9ff5-94383f978590 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:14.078320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8c110-7a75-4648-9ff5-94383f978590 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:14.078797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8c110-7a75-4648-9ff5-94383f978590 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:14.118267 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2bccb1-59ea-4409-a632-90293d929718 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:14.157287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:14.164731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e4d39-31e2-4bf8-a547-c00b5b3f8f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:14.165891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e4d39-31e2-4bf8-a547-c00b5b3f8f7f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:14.166180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e4d39-31e2-4bf8-a547-c00b5b3f8f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:14.166455 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e4d39-31e2-4bf8-a547-c00b5b3f8f7f None admin] PATH_INFO: `/v3/projects/10efcfb517724a609d32a0457044f00c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:14.167197 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8c110-7a75-4648-9ff5-94383f978590 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:14.167696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e4d39-31e2-4bf8-a547-c00b5b3f8f7f None admin] RBAC: Authorizing `identity:get_project(project_id=10efcfb517724a609d32a0457044f00c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:14.169100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8c110-7a75-4648-9ff5-94383f978590 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:14.169220 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e4d39-31e2-4bf8-a547-c00b5b3f8f7f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:14.175448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 207/433] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:52:13 2022] GET /identity/v3/projects/10efcfb517724a609d32a0457044f00c => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:14.177193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e4d39-31e2-4bf8-a547-c00b5b3f8f7f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:14.268923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:14.303137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 227/434] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:14.314136 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8c110-7a75-4648-9ff5-94383f978590 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:14.317322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e4d39-31e2-4bf8-a547-c00b5b3f8f7f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:14.364556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7efb26-cd3b-4424-b788-f93afd408ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:14.366578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7efb26-cd3b-4424-b788-f93afd408ebd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:14.367091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7efb26-cd3b-4424-b788-f93afd408ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:14.367570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7efb26-cd3b-4424-b788-f93afd408ebd None admin] PATH_INFO: `/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:14.369022 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7efb26-cd3b-4424-b788-f93afd408ebd None admin] RBAC: Authorizing `identity:get_group(group_id=f1ddfcb6b7544fad8d81b7875e8d89f7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:14.371352 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7efb26-cd3b-4424-b788-f93afd408ebd None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:14.374462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 208/435] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 15:52:14 2022] GET /identity/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:14.381450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7efb26-cd3b-4424-b788-f93afd408ebd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:14.453154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8c110-7a75-4648-9ff5-94383f978590 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:14.473041 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:14.499791 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45457b96-bbff-418e-99af-9b4640ca20a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:14.500679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45457b96-bbff-418e-99af-9b4640ca20a0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:14.500964 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45457b96-bbff-418e-99af-9b4640ca20a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:14.501241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45457b96-bbff-418e-99af-9b4640ca20a0 None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:14.503232 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45457b96-bbff-418e-99af-9b4640ca20a0 None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:14.504700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45457b96-bbff-418e-99af-9b4640ca20a0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:14.506634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 228/436] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:52:14 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:14.514923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45457b96-bbff-418e-99af-9b4640ca20a0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:14.529778 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7efb26-cd3b-4424-b788-f93afd408ebd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:14.566006 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13465601-f3ea-47ac-bb3b-e53b7601ef82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:14.566720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465601-f3ea-47ac-bb3b-e53b7601ef82 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:14.567032 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465601-f3ea-47ac-bb3b-e53b7601ef82 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:14.567317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13465601-f3ea-47ac-bb3b-e53b7601ef82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:14.568168 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13465601-f3ea-47ac-bb3b-e53b7601ef82 None admin] RBAC: Adding query filter params (group.id=f1ddfcb6b7544fad8d81b7875e8d89f7, role.id=e9dc595c6b4248d3b5262b70a90e76c5, scope.project.id=10efcfb517724a609d32a0457044f00c) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:14.568486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13465601-f3ea-47ac-bb3b-e53b7601ef82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:14.570024 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13465601-f3ea-47ac-bb3b-e53b7601ef82 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:14.576647 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 209/437] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 15:52:14 2022] GET /identity/v3/role_assignments?group.id=f1ddfcb6b7544fad8d81b7875e8d89f7&scope.project.id=10efcfb517724a609d32a0457044f00c&role.id=e9dc595c6b4248d3b5262b70a90e76c5 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:14.591787 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:14.668150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45457b96-bbff-418e-99af-9b4640ca20a0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:14.706290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561004fc-62f6-4eaa-98f8-d1460d1abfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:14.707211 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561004fc-62f6-4eaa-98f8-d1460d1abfdc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:14.707492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561004fc-62f6-4eaa-98f8-d1460d1abfdc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:14.707763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561004fc-62f6-4eaa-98f8-d1460d1abfdc None admin] PATH_INFO: `/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:14.709015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561004fc-62f6-4eaa-98f8-d1460d1abfdc None admin] RBAC: Authorizing `identity:get_group(group_id=f1ddfcb6b7544fad8d81b7875e8d89f7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:14.710488 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561004fc-62f6-4eaa-98f8-d1460d1abfdc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:14.712688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 229/438] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 15:52:14 2022] GET /identity/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:14.720039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13465601-f3ea-47ac-bb3b-e53b7601ef82 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:14.725140 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e9388-b6b7-425c-b75a-70ec9775d720 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:14.725457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e9388-b6b7-425c-b75a-70ec9775d720 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:14.725709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e9388-b6b7-425c-b75a-70ec9775d720 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:14.728647 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 230/439] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:52:14.735082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f81cf-e2dc-452c-9959-ac7ea584672b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:14.735384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f81cf-e2dc-452c-9959-ac7ea584672b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:14.735659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f81cf-e2dc-452c-9959-ac7ea584672b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:14.757081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-894f81cf-e2dc-452c-9959-ac7ea584672b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:14.758321 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-894f81cf-e2dc-452c-9959-ac7ea584672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:14.853000 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 231/440] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:52:14.862389 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13465601-f3ea-47ac-bb3b-e53b7601ef82 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:14.872150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356a3cd-37c3-4559-a6f7-0f4ddcb14d09 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:14.872497 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356a3cd-37c3-4559-a6f7-0f4ddcb14d09 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:14.872704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356a3cd-37c3-4559-a6f7-0f4ddcb14d09 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:14.874277 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 232/441] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:52:14.878527 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356a3cd-37c3-4559-a6f7-0f4ddcb14d09 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:14.900486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:14.908130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956d6d8-54a6-47ce-a2bd-74c87223f9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:14.908800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956d6d8-54a6-47ce-a2bd-74c87223f9ee None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:14.909081 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956d6d8-54a6-47ce-a2bd-74c87223f9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:14.909497 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956d6d8-54a6-47ce-a2bd-74c87223f9ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:14.910418 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956d6d8-54a6-47ce-a2bd-74c87223f9ee None admin] RBAC: Adding query filter params (group.id=f1ddfcb6b7544fad8d81b7875e8d89f7, role.id=64e044de7dcc4949acf8ce7eaf08fdaa, scope.project.id=e69f0e40da80459cb7b997f21995950a) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:14.910737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956d6d8-54a6-47ce-a2bd-74c87223f9ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:14.912354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956d6d8-54a6-47ce-a2bd-74c87223f9ee None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:14.919060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 210/442] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 15:52:14 2022] GET /identity/v3/role_assignments?group.id=f1ddfcb6b7544fad8d81b7875e8d89f7&scope.project.id=e69f0e40da80459cb7b997f21995950a&role.id=64e044de7dcc4949acf8ce7eaf08fdaa => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:14.920344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86053ac3-3d10-4dc3-801f-b102298d6597 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:14.920629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86053ac3-3d10-4dc3-801f-b102298d6597 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:14.920904 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86053ac3-3d10-4dc3-801f-b102298d6597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:14.930153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:14.939896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-86053ac3-3d10-4dc3-801f-b102298d6597 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:14.941447 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-86053ac3-3d10-4dc3-801f-b102298d6597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:15.021851 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356a3cd-37c3-4559-a6f7-0f4ddcb14d09 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:15.028692 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 211/443] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:15.052580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86053ac3-3d10-4dc3-801f-b102298d6597 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:15.067076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124c42f-2434-4e8d-9107-4d59705b7ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:15.067915 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124c42f-2434-4e8d-9107-4d59705b7ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:15.068195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124c42f-2434-4e8d-9107-4d59705b7ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:15.068471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124c42f-2434-4e8d-9107-4d59705b7ad3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:15.080510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4124c42f-2434-4e8d-9107-4d59705b7ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-4124c42f-2434-4e8d-9107-4d59705b7ad3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:15.088736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:15.089691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:15.090512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:15.090512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:15.090512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:15.090512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:15.090512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:15.090512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:15.090512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:15.090512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:15.090512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:15.090512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:15.090512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:15.090512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:15.090512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 233/444] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:52:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:15.098320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124c42f-2434-4e8d-9107-4d59705b7ad3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:15.184463 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86053ac3-3d10-4dc3-801f-b102298d6597 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:15.214718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:15.224643 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:15.226427 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495d693-b2ab-4606-8847-79505c4aefba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:15.227468 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495d693-b2ab-4606-8847-79505c4aefba None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:15.229350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495d693-b2ab-4606-8847-79505c4aefba None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:15.229350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495d693-b2ab-4606-8847-79505c4aefba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:15.230167 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124c42f-2434-4e8d-9107-4d59705b7ad3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:15.243424 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495d693-b2ab-4606-8847-79505c4aefba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8495d693-b2ab-4606-8847-79505c4aefba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:15.252452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:15.253415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:15.254212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:15.254212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:15.254212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:15.254212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:15.254212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:15.254212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:15.254212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:15.254212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:15.254212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:15.254212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:15.254212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:52:15.254212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:15.254212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 212/445] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:52:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:15.261922 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495d693-b2ab-4606-8847-79505c4aefba None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:15.274303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b88bf-bca6-470e-a43f-c317045fef90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:15.275022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b88bf-bca6-470e-a43f-c317045fef90 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:15.275494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b88bf-bca6-470e-a43f-c317045fef90 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:15.275613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b88bf-bca6-470e-a43f-c317045fef90 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:15.276313 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b88bf-bca6-470e-a43f-c317045fef90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:15.276632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b88bf-bca6-470e-a43f-c317045fef90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:15.278341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b88bf-bca6-470e-a43f-c317045fef90 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:15.288114 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 234/446] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:15.293575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b88bf-bca6-470e-a43f-c317045fef90 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:15.369225 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495d693-b2ab-4606-8847-79505c4aefba None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:15.395498 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b88bf-bca6-470e-a43f-c317045fef90 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:15.404651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926daa8-6b08-4b48-b005-cccd9f44b9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:15.405370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926daa8-6b08-4b48-b005-cccd9f44b9ce None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:15.405629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926daa8-6b08-4b48-b005-cccd9f44b9ce None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:15.405932 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926daa8-6b08-4b48-b005-cccd9f44b9ce None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:15.406666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926daa8-6b08-4b48-b005-cccd9f44b9ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:15.407041 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926daa8-6b08-4b48-b005-cccd9f44b9ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:15.408463 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926daa8-6b08-4b48-b005-cccd9f44b9ce None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:15.417312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 213/447] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:15.423161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926daa8-6b08-4b48-b005-cccd9f44b9ce None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:15.432707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d8922-8749-47f2-8657-f42a24b50532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:15.433051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d8922-8749-47f2-8657-f42a24b50532 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:15.433336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d8922-8749-47f2-8657-f42a24b50532 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:15.433609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d8922-8749-47f2-8657-f42a24b50532 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:15.468925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:15.474431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:15.516836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d8922-8749-47f2-8657-f42a24b50532 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:15.518320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d8922-8749-47f2-8657-f42a24b50532 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:15.534499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926daa8-6b08-4b48-b005-cccd9f44b9ce None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:15.570329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9807e-6a8d-408c-97dd-f1f484f4d0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:15.571032 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9807e-6a8d-408c-97dd-f1f484f4d0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:15.571324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9807e-6a8d-408c-97dd-f1f484f4d0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:15.571606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9807e-6a8d-408c-97dd-f1f484f4d0d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:15.630625 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 235/448] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 15:52:15.636403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d8922-8749-47f2-8657-f42a24b50532 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:15.646837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9807e-6a8d-408c-97dd-f1f484f4d0d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:15.648323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e9807e-6a8d-408c-97dd-f1f484f4d0d7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:15.698355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:15.701885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:15.747008 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d8922-8749-47f2-8657-f42a24b50532 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:15.759654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 214/449] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:15.760811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9807e-6a8d-408c-97dd-f1f484f4d0d7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:15.783873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae898512-f510-46a5-a16a-08842b7b0a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:15.784771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae898512-f510-46a5-a16a-08842b7b0a5c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:15.785052 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae898512-f510-46a5-a16a-08842b7b0a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:15.785329 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae898512-f510-46a5-a16a-08842b7b0a5c None admin] PATH_INFO: `/v3/projects/ab5b6764e1c145b69436e883cfb29e46` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:15.786503 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae898512-f510-46a5-a16a-08842b7b0a5c None admin] RBAC: Authorizing `identity:get_project(project_id=ab5b6764e1c145b69436e883cfb29e46)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:15.788103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae898512-f510-46a5-a16a-08842b7b0a5c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:15.789797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 236/450] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:52:15 2022] GET /identity/v3/projects/ab5b6764e1c145b69436e883cfb29e46 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:15.795605 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae898512-f510-46a5-a16a-08842b7b0a5c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:15.860642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9807e-6a8d-408c-97dd-f1f484f4d0d7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:15.896355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859619aa-9bde-44f5-a16b-706aad3a8511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:15.897230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859619aa-9bde-44f5-a16b-706aad3a8511 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:15.897502 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859619aa-9bde-44f5-a16b-706aad3a8511 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:15.897772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859619aa-9bde-44f5-a16b-706aad3a8511 None admin] PATH_INFO: `/v3/projects/e69f0e40da80459cb7b997f21995950a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:15.899006 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859619aa-9bde-44f5-a16b-706aad3a8511 None admin] RBAC: Authorizing `identity:get_project(project_id=e69f0e40da80459cb7b997f21995950a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:15.900476 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859619aa-9bde-44f5-a16b-706aad3a8511 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:15.902163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae898512-f510-46a5-a16a-08842b7b0a5c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:15.902300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 215/451] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:52:15 2022] GET /identity/v3/projects/e69f0e40da80459cb7b997f21995950a => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:15.907800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859619aa-9bde-44f5-a16b-706aad3a8511 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:15.925493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:15.935251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:15.942137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a72c14-da95-4b68-82b2-fc91466b9ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:15.943059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a72c14-da95-4b68-82b2-fc91466b9ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:15.943343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a72c14-da95-4b68-82b2-fc91466b9ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:15.943606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a72c14-da95-4b68-82b2-fc91466b9ed1 None admin] PATH_INFO: `/v3/groups/fb8cbfec22dc4f4d92cf4638bd594e2e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:15.944840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a72c14-da95-4b68-82b2-fc91466b9ed1 None admin] RBAC: Authorizing `identity:get_group(group_id=fb8cbfec22dc4f4d92cf4638bd594e2e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:15.946304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a72c14-da95-4b68-82b2-fc91466b9ed1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:15.947976 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 237/452] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 15:52:15 2022] GET /identity/v3/groups/fb8cbfec22dc4f4d92cf4638bd594e2e => generated 229 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:15.953865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a72c14-da95-4b68-82b2-fc91466b9ed1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:16.010899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859619aa-9bde-44f5-a16b-706aad3a8511 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:16.044571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4817b5a-348e-4c0d-b5cf-00de36872ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:16.045474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4817b5a-348e-4c0d-b5cf-00de36872ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:16.045757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4817b5a-348e-4c0d-b5cf-00de36872ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:16.046029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4817b5a-348e-4c0d-b5cf-00de36872ce1 None admin] PATH_INFO: `/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:16.047246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4817b5a-348e-4c0d-b5cf-00de36872ce1 None admin] RBAC: Authorizing `identity:get_group(group_id=f1ddfcb6b7544fad8d81b7875e8d89f7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:16.048713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4817b5a-348e-4c0d-b5cf-00de36872ce1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:16.050411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 216/453] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Jul 21 15:52:15 2022] GET /identity/v3/groups/f1ddfcb6b7544fad8d81b7875e8d89f7 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:16.053684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a72c14-da95-4b68-82b2-fc91466b9ed1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:16.056283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4817b5a-348e-4c0d-b5cf-00de36872ce1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:16.087710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a5221-275c-41ba-9fe4-5ae0a892102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:16.088371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a5221-275c-41ba-9fe4-5ae0a892102a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:16.088651 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a5221-275c-41ba-9fe4-5ae0a892102a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:16.088927 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a5221-275c-41ba-9fe4-5ae0a892102a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:16.089767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a5221-275c-41ba-9fe4-5ae0a892102a None admin] RBAC: Adding query filter params (group.id=fb8cbfec22dc4f4d92cf4638bd594e2e, role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=ab5b6764e1c145b69436e883cfb29e46) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:16.090082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a5221-275c-41ba-9fe4-5ae0a892102a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:16.091555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a5221-275c-41ba-9fe4-5ae0a892102a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:16.097599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 238/454] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 15:52:15 2022] GET /identity/v3/role_assignments?group.id=fb8cbfec22dc4f4d92cf4638bd594e2e&scope.project.id=ab5b6764e1c145b69436e883cfb29e46&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:16.143902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:16.163786 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4817b5a-348e-4c0d-b5cf-00de36872ce1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:16.203578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904653e-8ec8-43c6-9f31-e6b628dad11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:16.204264 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904653e-8ec8-43c6-9f31-e6b628dad11d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:16.204547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904653e-8ec8-43c6-9f31-e6b628dad11d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:16.204820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904653e-8ec8-43c6-9f31-e6b628dad11d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:16.205680 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904653e-8ec8-43c6-9f31-e6b628dad11d None admin] RBAC: Adding query filter params (group.id=f1ddfcb6b7544fad8d81b7875e8d89f7, role.id=e9dc595c6b4248d3b5262b70a90e76c5, scope.project.id=e69f0e40da80459cb7b997f21995950a) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:16.206003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904653e-8ec8-43c6-9f31-e6b628dad11d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:16.207543 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904653e-8ec8-43c6-9f31-e6b628dad11d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:16.214596 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 217/455] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Jul 21 15:52:16 2022] GET /identity/v3/role_assignments?group.id=f1ddfcb6b7544fad8d81b7875e8d89f7&scope.project.id=e69f0e40da80459cb7b997f21995950a&role.id=e9dc595c6b4248d3b5262b70a90e76c5 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:18.793301 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae6172-d984-4bbf-9e90-2bdf76f9a2ed None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:18.793833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae6172-d984-4bbf-9e90-2bdf76f9a2ed None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:18.793833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae6172-d984-4bbf-9e90-2bdf76f9a2ed None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:18.795668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 239/456] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:18.801780 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a3266-093b-43f9-8b08-6c7c182342e3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:18.802250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a3266-093b-43f9-8b08-6c7c182342e3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:18.802442 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a3266-093b-43f9-8b08-6c7c182342e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:18.827840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d26a3266-093b-43f9-8b08-6c7c182342e3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:18.829030 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d26a3266-093b-43f9-8b08-6c7c182342e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:18.929202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 218/457] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:18.961044 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae6172-d984-4bbf-9e90-2bdf76f9a2ed None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:19.050719 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:19.062255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae5370-20c6-465f-ac9d-e6c6fc9382d2 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:19.062544 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae5370-20c6-465f-ac9d-e6c6fc9382d2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:19.062799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae5370-20c6-465f-ac9d-e6c6fc9382d2 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:19.064337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 219/458] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:52:19.076632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c13e5-c9b1-4a65-9930-f5d8e6f4e13f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:19.076912 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c13e5-c9b1-4a65-9930-f5d8e6f4e13f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:19.077179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c13e5-c9b1-4a65-9930-f5d8e6f4e13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:19.100433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6a1c13e5-c9b1-4a65-9930-f5d8e6f4e13f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:19.101630 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6a1c13e5-c9b1-4a65-9930-f5d8e6f4e13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:19.127858 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae6172-d984-4bbf-9e90-2bdf76f9a2ed None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:19.207468 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf97ed-d233-458e-8d7a-2708dbaa0d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:19.208633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf97ed-d233-458e-8d7a-2708dbaa0d12 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:19.209143 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf97ed-d233-458e-8d7a-2708dbaa0d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:19.209613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf97ed-d233-458e-8d7a-2708dbaa0d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:19.226385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf97ed-d233-458e-8d7a-2708dbaa0d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:19.228983 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf97ed-d233-458e-8d7a-2708dbaa0d12 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:19.243604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 220/459] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:19.255507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-34bf97ed-d233-458e-8d7a-2708dbaa0d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:19.255507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:19.255507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:19.255507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:19.255507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:19.255507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:19.255507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:19.255507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:19.255507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:19.255507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:19.255507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:19.255507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:19.255507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:19.255507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:19.255507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:19.256376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:19.257232 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:19.257232 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:19.257232 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:19.257232 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:19.259450 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 240/460] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:19.265028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c13e5-c9b1-4a65-9930-f5d8e6f4e13f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:19.281909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:19.296295 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf97ed-d233-458e-8d7a-2708dbaa0d12 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:19.422456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c13e5-c9b1-4a65-9930-f5d8e6f4e13f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:19.429495 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf97ed-d233-458e-8d7a-2708dbaa0d12 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:19.444722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:19.459690 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b8d95-d993-490c-9239-9a8d20ccafc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:19.460614 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b8d95-d993-490c-9239-9a8d20ccafc5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:19.461051 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b8d95-d993-490c-9239-9a8d20ccafc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:19.461324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b8d95-d993-490c-9239-9a8d20ccafc5 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:19.462060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b8d95-d993-490c-9239-9a8d20ccafc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:19.462408 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b8d95-d993-490c-9239-9a8d20ccafc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:19.463913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b8d95-d993-490c-9239-9a8d20ccafc5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:19.465268 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82786f-e96b-4a97-918b-4cbe1eee4c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:19.466076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82786f-e96b-4a97-918b-4cbe1eee4c44 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:19.466360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82786f-e96b-4a97-918b-4cbe1eee4c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:19.466639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82786f-e96b-4a97-918b-4cbe1eee4c44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:19.477472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82786f-e96b-4a97-918b-4cbe1eee4c44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:19.478973 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a82786f-e96b-4a97-918b-4cbe1eee4c44 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:19.482233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 221/461] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:19.483774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff875-5b92-4197-a2fd-ba0e5b205774 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:19.484228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff875-5b92-4197-a2fd-ba0e5b205774 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:19.484661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ff875-5b92-4197-a2fd-ba0e5b205774 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:19.486047 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 222/462] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:19.487335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa83c4-6df8-43d7-9761-524f0124f75d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:19.487853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa83c4-6df8-43d7-9761-524f0124f75d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:19.488128 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa83c4-6df8-43d7-9761-524f0124f75d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:19.489492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 223/463] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:19.491396 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa83c4-6df8-43d7-9761-524f0124f75d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:19.501804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-6a82786f-e96b-4a97-918b-4cbe1eee4c44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:19.501804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:19.501804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:19.501804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:19.501804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:19.501804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:19.501804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:19.501804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:19.501804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:19.501804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:19.501804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:19.501804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:19.501804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:19.501804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:19.501804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:19.502704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:19.503630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:19.503630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:19.503630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:19.503630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:19.503630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 241/464] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:19.504320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381187ee-27ad-44fa-b117-579633625523 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:19.504636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381187ee-27ad-44fa-b117-579633625523 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:19.504945 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381187ee-27ad-44fa-b117-579633625523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:19.527354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-381187ee-27ad-44fa-b117-579633625523 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:19.528545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-381187ee-27ad-44fa-b117-579633625523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:19.565031 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:19.599890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 242/465] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:19.601818 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1da63-21da-401a-86e6-c5a4315a9318 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:19.602298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1da63-21da-401a-86e6-c5a4315a9318 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:19.602752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1da63-21da-401a-86e6-c5a4315a9318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:19.611598 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa83c4-6df8-43d7-9761-524f0124f75d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:19.627665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-27e1da63-21da-401a-86e6-c5a4315a9318 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:19.628917 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-27e1da63-21da-401a-86e6-c5a4315a9318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:19.648949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5ed9b-8d63-42d4-a4e1-9971edbf29f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:19.649636 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ed9b-8d63-42d4-a4e1-9971edbf29f5 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:19.649917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ed9b-8d63-42d4-a4e1-9971edbf29f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:19.650194 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5ed9b-8d63-42d4-a4e1-9971edbf29f5 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:19.650939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5ed9b-8d63-42d4-a4e1-9971edbf29f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:19.652449 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5ed9b-8d63-42d4-a4e1-9971edbf29f5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:19.674605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 224/466] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:52:19 2022] POST /identity/v3/users => generated 246 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 15:52:19.675893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5ed9b-8d63-42d4-a4e1-9971edbf29f5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:19.719221 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 243/467] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:19.723900 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1da63-21da-401a-86e6-c5a4315a9318 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:19.776105 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:19.830369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5ed9b-8d63-42d4-a4e1-9971edbf29f5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:19.862312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:19.872413 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1da63-21da-401a-86e6-c5a4315a9318 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:19.878849 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053140d-4758-4d5e-9677-c2f74e796bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:19.879630 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053140d-4758-4d5e-9677-c2f74e796bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:19.879940 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053140d-4758-4d5e-9677-c2f74e796bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:19.880285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053140d-4758-4d5e-9677-c2f74e796bf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:19.881037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053140d-4758-4d5e-9677-c2f74e796bf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:19.881346 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053140d-4758-4d5e-9677-c2f74e796bf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:19.882809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053140d-4758-4d5e-9677-c2f74e796bf7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:19.904582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 225/468] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:19.906421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053140d-4758-4d5e-9677-c2f74e796bf7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:19.919292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b82328-e1b4-4482-863d-ab4a1da100e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:19.920116 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b82328-e1b4-4482-863d-ab4a1da100e4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:19.920404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b82328-e1b4-4482-863d-ab4a1da100e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:19.920683 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b82328-e1b4-4482-863d-ab4a1da100e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:19.934351 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b82328-e1b4-4482-863d-ab4a1da100e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:19.936514 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b82328-e1b4-4482-863d-ab4a1da100e4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:19.957798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-29b82328-e1b4-4482-863d-ab4a1da100e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:19.957798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:19.957798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:19.957798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:19.957798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:19.957798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:19.957798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:19.957798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:19.957798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:19.957798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:19.957798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:19.957798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:19.957798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:19.957798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:19.957798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:19.958716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:19.960444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:19.960444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:19.960444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:19.960444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:19.960444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 244/469] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:19.960444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b82328-e1b4-4482-863d-ab4a1da100e4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:20.040108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053140d-4758-4d5e-9677-c2f74e796bf7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:20.045959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:20.075674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b82328-e1b4-4482-863d-ab4a1da100e4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:20.082687 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2021c-b72f-41a4-804d-dc3ab38ca794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:20.083626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2021c-b72f-41a4-804d-dc3ab38ca794 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:20.083976 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2021c-b72f-41a4-804d-dc3ab38ca794 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:20.084325 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b2021c-b72f-41a4-804d-dc3ab38ca794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:20.095440 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2021c-b72f-41a4-804d-dc3ab38ca794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:20.097108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b2021c-b72f-41a4-804d-dc3ab38ca794 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:20.117343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c65715-9d10-45d2-8fb9-8c5c354e403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:20.118035 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c65715-9d10-45d2-8fb9-8c5c354e403b None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:20.118318 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c65715-9d10-45d2-8fb9-8c5c354e403b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:20.118428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-95b2021c-b72f-41a4-804d-dc3ab38ca794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:20.118428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:20.118428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:20.118428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:20.118428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:20.118428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:20.118428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:20.118428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:20.118428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:20.118428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:20.118428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:20.118428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:20.118428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:20.118428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:20.118428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:20.119249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:20.120112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:20.120112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:20.120112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:20.120112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:20.120330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c65715-9d10-45d2-8fb9-8c5c354e403b None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:20.120330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c65715-9d10-45d2-8fb9-8c5c354e403b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:20.120977 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c65715-9d10-45d2-8fb9-8c5c354e403b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:20.122903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 226/470] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:20.123781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2021c-b72f-41a4-804d-dc3ab38ca794 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:20.154445 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 245/471] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:52:19 2022] POST /identity/v3/users => generated 248 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:52:20.155730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c65715-9d10-45d2-8fb9-8c5c354e403b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:20.170807 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:20.328512 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b2021c-b72f-41a4-804d-dc3ab38ca794 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:20.362555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c65715-9d10-45d2-8fb9-8c5c354e403b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:20.381690 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343ebe-b8aa-4fda-8071-518b1366cf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:20.382500 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343ebe-b8aa-4fda-8071-518b1366cf12 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:20.382789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343ebe-b8aa-4fda-8071-518b1366cf12 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:20.383100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343ebe-b8aa-4fda-8071-518b1366cf12 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:20.383954 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3343ebe-b8aa-4fda-8071-518b1366cf12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:20.384269 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3343ebe-b8aa-4fda-8071-518b1366cf12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:20.385698 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3343ebe-b8aa-4fda-8071-518b1366cf12 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:20.399836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 227/472] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:20.405859 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343ebe-b8aa-4fda-8071-518b1366cf12 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:20.417029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c7c37-6faa-4d57-86bf-97157e7faa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:20.418279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c7c37-6faa-4d57-86bf-97157e7faa91 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:20.418570 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c7c37-6faa-4d57-86bf-97157e7faa91 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:20.418868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c7c37-6faa-4d57-86bf-97157e7faa91 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:20.419992 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c7c37-6faa-4d57-86bf-97157e7faa91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:20.420309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c7c37-6faa-4d57-86bf-97157e7faa91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:20.422311 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c7c37-6faa-4d57-86bf-97157e7faa91 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:20.425169 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:20.446354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 246/473] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:20.452129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c7c37-6faa-4d57-86bf-97157e7faa91 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:20.544182 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:20.553452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343ebe-b8aa-4fda-8071-518b1366cf12 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:20.586581 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c7c37-6faa-4d57-86bf-97157e7faa91 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:20.599615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a0e5d-812d-46a6-9a18-9fa862a4bafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:20.600568 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a0e5d-812d-46a6-9a18-9fa862a4bafa None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:20.600856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a0e5d-812d-46a6-9a18-9fa862a4bafa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:20.606886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a0e5d-812d-46a6-9a18-9fa862a4bafa None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:20.607780 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a0e5d-812d-46a6-9a18-9fa862a4bafa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:20.609449 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a0e5d-812d-46a6-9a18-9fa862a4bafa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:20.629583 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e6bb3-2935-410e-853f-394f1010adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:20.630289 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e6bb3-2935-410e-853f-394f1010adf2 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:20.630579 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e6bb3-2935-410e-853f-394f1010adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:20.630881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e6bb3-2935-410e-853f-394f1010adf2 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:20.631675 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e6bb3-2935-410e-853f-394f1010adf2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:20.633236 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e6bb3-2935-410e-853f-394f1010adf2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:20.652123 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 228/474] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:52:20 2022] POST /identity/v3/users => generated 248 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:52:20.664673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 247/475] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:52:20 2022] POST /identity/v3/users => generated 249 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:52:20.718629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ab4da-4604-4dad-8183-71a41a81d6f0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:20.718862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ab4da-4604-4dad-8183-71a41a81d6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:20.719135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ab4da-4604-4dad-8183-71a41a81d6f0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:20.721003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 229/476] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:20.727070 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a6017-dc2e-4952-9192-480ae034a25e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:20.727402 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a6017-dc2e-4952-9192-480ae034a25e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:20.727643 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a6017-dc2e-4952-9192-480ae034a25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:20.756920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-365a6017-dc2e-4952-9192-480ae034a25e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:20.757372 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-365a6017-dc2e-4952-9192-480ae034a25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:20.822205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:20.849137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 248/477] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:20.874538 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ab4da-4604-4dad-8183-71a41a81d6f0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:21.000532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ab4da-4604-4dad-8183-71a41a81d6f0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:21.039646 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f4aaa-3dd6-4ab2-a2f5-6ab25ba0cf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:21.040330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f4aaa-3dd6-4ab2-a2f5-6ab25ba0cf0c None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:21.040609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f4aaa-3dd6-4ab2-a2f5-6ab25ba0cf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:21.040878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f4aaa-3dd6-4ab2-a2f5-6ab25ba0cf0c None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:21.041627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f4aaa-3dd6-4ab2-a2f5-6ab25ba0cf0c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:21.043038 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f4aaa-3dd6-4ab2-a2f5-6ab25ba0cf0c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:21.050841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.sql.core [None req-622f4aaa-3dd6-4ab2-a2f5-6ab25ba0cf0c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 15:52:21.050841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 15:52:21.050841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [parameters: {'id': '3a6ff5dd574f46dfa0b1066c73116626', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 15:52:21.050841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80253) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 15:52:21.068215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-622f4aaa-3dd6-4ab2-a2f5-6ab25ba0cf0c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 15:52:21.068215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:21.068215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 15:52:21.068215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 15:52:21.068215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 15:52:21.068215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 15:52:21.068215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 15:52:21.068215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 15:52:21.068215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 15:52:21.068215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application conn.query(q) Jul 21 15:52:21.068215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 15:52:21.068215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 15:52:21.068215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 15:52:21.068215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result.read() Jul 21 15:52:21.068215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 15:52:21.069228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application next(self.gen) Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application yield resource Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application next(self.gen) Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise self.value Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application session.commit() Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 15:52:21.070399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.session.flush() Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application compat.raise_( Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 15:52:21.071566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 15:52:21.072462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application conn.query(q) Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application result.read() Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 15:52:21.073298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [parameters: {'id': '3a6ff5dd574f46dfa0b1066c73116626', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:21.074098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 15:52:21.076851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:21.077992 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 230/478] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 21 15:52:20 2022] POST /identity/v3/roles => generated 144 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:21.078134 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a6017-dc2e-4952-9192-480ae034a25e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:21.221027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a6017-dc2e-4952-9192-480ae034a25e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:21.273823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d34da4-2971-4419-bbe7-470f17655907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:21.274915 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d34da4-2971-4419-bbe7-470f17655907 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:21.275343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d34da4-2971-4419-bbe7-470f17655907 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:21.275787 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d34da4-2971-4419-bbe7-470f17655907 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:21.289391 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d34da4-2971-4419-bbe7-470f17655907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-f0d34da4-2971-4419-bbe7-470f17655907 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:21.297830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:21.298949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:21.300029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:21.300029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:21.300029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:21.300029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:21.300029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:21.300029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:21.300029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:21.300029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:21.300029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:21.300029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:21.300029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 15:52:21.300029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:21.307176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 249/479] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:52:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:21.308446 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f4aaa-3dd6-4ab2-a2f5-6ab25ba0cf0c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:21.347091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:21.455236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f4aaa-3dd6-4ab2-a2f5-6ab25ba0cf0c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:21.491202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5af45a-a262-46ab-adca-245489533baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:21.492241 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5af45a-a262-46ab-adca-245489533baf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:21.492750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5af45a-a262-46ab-adca-245489533baf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:21.493245 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5af45a-a262-46ab-adca-245489533baf None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:21.494199 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5af45a-a262-46ab-adca-245489533baf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:21.494701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5af45a-a262-46ab-adca-245489533baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:21.496314 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5af45a-a262-46ab-adca-245489533baf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:21.505330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 231/480] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:22.073067 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2757d4-3d22-4cdd-8b7f-23f0371f21d1 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:22.073723 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2757d4-3d22-4cdd-8b7f-23f0371f21d1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:22.074212 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2757d4-3d22-4cdd-8b7f-23f0371f21d1 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:22.076072 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 250/481] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:22.081817 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08a5c0-76a3-4fed-aae6-a591d49c1f00 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:22.082733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08a5c0-76a3-4fed-aae6-a591d49c1f00 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:22.083253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08a5c0-76a3-4fed-aae6-a591d49c1f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:22.107858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bf08a5c0-76a3-4fed-aae6-a591d49c1f00 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:22.109426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bf08a5c0-76a3-4fed-aae6-a591d49c1f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:22.217151 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 232/482] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:22.255610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2757d4-3d22-4cdd-8b7f-23f0371f21d1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:22.305903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:22.382906 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2757d4-3d22-4cdd-8b7f-23f0371f21d1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:22.436970 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ad377-48aa-41d0-9f72-1302e0222e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:22.438202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ad377-48aa-41d0-9f72-1302e0222e31 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:22.438687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ad377-48aa-41d0-9f72-1302e0222e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:22.439183 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ad377-48aa-41d0-9f72-1302e0222e31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:22.453980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229ad377-48aa-41d0-9f72-1302e0222e31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-229ad377-48aa-41d0-9f72-1302e0222e31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:22.462010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:22.462926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:22.463816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:22.463816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:22.463816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:22.463816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:22.463816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:22.463816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:22.463816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:22.463816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:22.463816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:22.463816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:22.463816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:22.463816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:22.463816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 251/483] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:22.469746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08a5c0-76a3-4fed-aae6-a591d49c1f00 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:22.480875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:22.611384 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08a5c0-76a3-4fed-aae6-a591d49c1f00 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:22.661490 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2d4f4-cf78-440f-93fe-2749e881964f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:22.662196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2d4f4-cf78-440f-93fe-2749e881964f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:22.662480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2d4f4-cf78-440f-93fe-2749e881964f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:22.662757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2d4f4-cf78-440f-93fe-2749e881964f None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:22.663558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2d4f4-cf78-440f-93fe-2749e881964f None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:22.663868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2d4f4-cf78-440f-93fe-2749e881964f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:22.665287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2d4f4-cf78-440f-93fe-2749e881964f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:22.678953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 233/484] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:22.684459 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ad377-48aa-41d0-9f72-1302e0222e31 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:22.808827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:22.812434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ad377-48aa-41d0-9f72-1302e0222e31 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:22.861232 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417c2b1-161b-4e3a-ad1e-283ede0619c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:22.862164 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417c2b1-161b-4e3a-ad1e-283ede0619c3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:22.862493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417c2b1-161b-4e3a-ad1e-283ede0619c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:22.862825 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417c2b1-161b-4e3a-ad1e-283ede0619c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:22.879243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417c2b1-161b-4e3a-ad1e-283ede0619c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:22.880744 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417c2b1-161b-4e3a-ad1e-283ede0619c3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:22.903027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-4417c2b1-161b-4e3a-ad1e-283ede0619c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:22.903027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:22.903027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:22.903027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:22.903027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:22.903027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:22.903027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:22.903027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:22.903027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:22.903027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:22.903027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:22.903027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:22.903027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:22.903027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:22.903027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:22.903936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:22.904781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:22.904781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:22.904781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:22.904781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:22.904781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 252/485] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:22.909997 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2d4f4-cf78-440f-93fe-2749e881964f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:23.028079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:23.054093 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4ff77-d536-4d51-8528-3b9faee022fd None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:23.054424 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4ff77-d536-4d51-8528-3b9faee022fd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:23.054658 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4ff77-d536-4d51-8528-3b9faee022fd None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:23.056499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 253/486] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:23.061784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e442b-cc5a-4490-83f9-153c18b910d3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:23.062077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e442b-cc5a-4490-83f9-153c18b910d3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:23.062359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e442b-cc5a-4490-83f9-153c18b910d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:23.073003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2d4f4-cf78-440f-93fe-2749e881964f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:23.079611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b40e442b-cc5a-4490-83f9-153c18b910d3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:23.080887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b40e442b-cc5a-4490-83f9-153c18b910d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:23.126090 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788501fb-aa25-48e3-999f-5e9785270c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:23.126775 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788501fb-aa25-48e3-999f-5e9785270c1f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:23.127088 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788501fb-aa25-48e3-999f-5e9785270c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:23.127365 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788501fb-aa25-48e3-999f-5e9785270c1f None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:23.128232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788501fb-aa25-48e3-999f-5e9785270c1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:23.128540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788501fb-aa25-48e3-999f-5e9785270c1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:23.129935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788501fb-aa25-48e3-999f-5e9785270c1f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:23.145233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 234/487] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:23.154943 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788501fb-aa25-48e3-999f-5e9785270c1f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:23.227941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 254/488] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:23.229346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5b1f1-2946-43a1-b5ef-876075aace1b None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:23.229639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5b1f1-2946-43a1-b5ef-876075aace1b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:23.229924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5b1f1-2946-43a1-b5ef-876075aace1b None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:23.235436 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 255/489] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:23.252563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39093dc-0695-44ce-bd05-e7f1747c884d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:23.252920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39093dc-0695-44ce-bd05-e7f1747c884d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:23.253157 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39093dc-0695-44ce-bd05-e7f1747c884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:23.271446 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788501fb-aa25-48e3-999f-5e9785270c1f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:23.278293 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a39093dc-0695-44ce-bd05-e7f1747c884d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:23.279461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a39093dc-0695-44ce-bd05-e7f1747c884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:23.302039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:23.309827 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e240e4-76e0-4de0-9dfa-ebaf3c4c4dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:23.310636 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e240e4-76e0-4de0-9dfa-ebaf3c4c4dba None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:23.310940 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e240e4-76e0-4de0-9dfa-ebaf3c4c4dba None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:23.311214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e240e4-76e0-4de0-9dfa-ebaf3c4c4dba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:23.322981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e240e4-76e0-4de0-9dfa-ebaf3c4c4dba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:23.322981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e240e4-76e0-4de0-9dfa-ebaf3c4c4dba None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-97e240e4-76e0-4de0-9dfa-ebaf3c4c4dba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:23.339593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:23.340772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:23.341841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:23.341841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:23.341841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:23.341841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:23.341841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:23.341841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:23.341841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:23.341841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:23.341841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:52:23.341841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:23.343354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 235/490] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 15:52:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:23.344514 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e240e4-76e0-4de0-9dfa-ebaf3c4c4dba None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:23.361482 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 256/491] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:52:23.363194 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39093dc-0695-44ce-bd05-e7f1747c884d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:23.387670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:23.481205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e240e4-76e0-4de0-9dfa-ebaf3c4c4dba None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:23.497378 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39093dc-0695-44ce-bd05-e7f1747c884d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:23.517938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341e4c8-fb04-4abd-b577-f5327b395062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:23.519165 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341e4c8-fb04-4abd-b577-f5327b395062 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:23.519691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341e4c8-fb04-4abd-b577-f5327b395062 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:23.520156 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6341e4c8-fb04-4abd-b577-f5327b395062 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:23.535513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6341e4c8-fb04-4abd-b577-f5327b395062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:23.539690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291933bb-b111-4cbf-bd31-8ab0c2a0dcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:23.540396 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291933bb-b111-4cbf-bd31-8ab0c2a0dcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:23.540672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291933bb-b111-4cbf-bd31-8ab0c2a0dcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:23.540951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291933bb-b111-4cbf-bd31-8ab0c2a0dcd2 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:23.541806 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291933bb-b111-4cbf-bd31-8ab0c2a0dcd2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:23.542121 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291933bb-b111-4cbf-bd31-8ab0c2a0dcd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:23.543590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291933bb-b111-4cbf-bd31-8ab0c2a0dcd2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-6341e4c8-fb04-4abd-b577-f5327b395062 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:23.545985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:23.547135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:23.547983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:23.547983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:23.547983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:23.547983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:23.547983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:23.547983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:23.547983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:23.547983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:23.547983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:23.547983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:23.547983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:23.547983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:23.550659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 236/492] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:23.551903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341e4c8-fb04-4abd-b577-f5327b395062 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:23.587372 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 257/493] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 15:52:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:23.588618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291933bb-b111-4cbf-bd31-8ab0c2a0dcd2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:23.617138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:23.665622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:23.673437 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6341e4c8-fb04-4abd-b577-f5327b395062 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:23.698831 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291933bb-b111-4cbf-bd31-8ab0c2a0dcd2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:23.711118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03b5ce-651b-4635-b7b4-6bc029d6acbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:23.711931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03b5ce-651b-4635-b7b4-6bc029d6acbd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:23.712214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03b5ce-651b-4635-b7b4-6bc029d6acbd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:23.712491 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03b5ce-651b-4635-b7b4-6bc029d6acbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:23.724043 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03b5ce-651b-4635-b7b4-6bc029d6acbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0e03b5ce-651b-4635-b7b4-6bc029d6acbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:23.732413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:23.733308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:23.734124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:23.734124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:23.734124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:23.734124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:23.734124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:23.734124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:23.734124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:23.734124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:23.734124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:23.734124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:23.734124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:23.734124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:23.734124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 237/494] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:23.734772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03b5ce-651b-4635-b7b4-6bc029d6acbd None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:23.735958 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b839a-3341-456d-be75-fa6f49f9b540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:23.736637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b839a-3341-456d-be75-fa6f49f9b540 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:23.736944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b839a-3341-456d-be75-fa6f49f9b540 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:23.737216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b839a-3341-456d-be75-fa6f49f9b540 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:23.738013 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b839a-3341-456d-be75-fa6f49f9b540 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:23.738322 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b839a-3341-456d-be75-fa6f49f9b540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:23.739752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b839a-3341-456d-be75-fa6f49f9b540 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:23.751194 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 258/495] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:23.753945 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893cc22-50d9-45e6-983b-ea2f81c92760 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:23.754242 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893cc22-50d9-45e6-983b-ea2f81c92760 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:23.754527 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893cc22-50d9-45e6-983b-ea2f81c92760 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:23.756572 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 259/496] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:23.758849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893cc22-50d9-45e6-983b-ea2f81c92760 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:23.845420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03b5ce-651b-4635-b7b4-6bc029d6acbd None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:23.857255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:23.865054 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893cc22-50d9-45e6-983b-ea2f81c92760 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:23.883806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077ab9a-f209-4904-a549-c805fe749546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:23.884473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077ab9a-f209-4904-a549-c805fe749546 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:23.884758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077ab9a-f209-4904-a549-c805fe749546 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:23.885147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077ab9a-f209-4904-a549-c805fe749546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:23.894119 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:23.900066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfd4f7-d098-4bf5-83a0-5c1150ece85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:23.900747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfd4f7-d098-4bf5-83a0-5c1150ece85d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:23.901033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfd4f7-d098-4bf5-83a0-5c1150ece85d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:23.901309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdfd4f7-d098-4bf5-83a0-5c1150ece85d None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:23.902066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfd4f7-d098-4bf5-83a0-5c1150ece85d None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:23.902373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfd4f7-d098-4bf5-83a0-5c1150ece85d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:23.903787 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdfd4f7-d098-4bf5-83a0-5c1150ece85d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:23.912283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 260/497] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:23.912283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfd4f7-d098-4bf5-83a0-5c1150ece85d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:23.962223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077ab9a-f209-4904-a549-c805fe749546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:23.963937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077ab9a-f209-4904-a549-c805fe749546 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:24.019704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdfd4f7-d098-4bf5-83a0-5c1150ece85d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:24.053482 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adfa3f-44b7-4e4a-a0d2-41502b949d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:24.054287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adfa3f-44b7-4e4a-a0d2-41502b949d39 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:24.054568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adfa3f-44b7-4e4a-a0d2-41502b949d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:24.054871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35adfa3f-44b7-4e4a-a0d2-41502b949d39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:24.065729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adfa3f-44b7-4e4a-a0d2-41502b949d39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:24.067217 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35adfa3f-44b7-4e4a-a0d2-41502b949d39 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:24.079381 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 238/498] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:24.079381 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac591b-5239-415c-b24a-e7e9f912d315 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:24.079381 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac591b-5239-415c-b24a-e7e9f912d315 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:24.079381 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac591b-5239-415c-b24a-e7e9f912d315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:24.085173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-35adfa3f-44b7-4e4a-a0d2-41502b949d39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:24.085173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:24.085173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:24.085173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:24.085173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:24.085173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:24.085173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:24.085173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:24.085173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:24.085173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:24.085173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:24.085173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:24.085173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:24.085173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:24.085173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:24.086016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:24.087296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:24.087296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:24.087296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:24.087296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:24.087296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 261/499] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:24.087668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adfa3f-44b7-4e4a-a0d2-41502b949d39 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:24.099129 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7fac591b-5239-415c-b24a-e7e9f912d315 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:24.100279 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7fac591b-5239-415c-b24a-e7e9f912d315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:24.104127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:24.139196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:24.182847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 239/500] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:24.182847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac591b-5239-415c-b24a-e7e9f912d315 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:24.216400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35adfa3f-44b7-4e4a-a0d2-41502b949d39 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:24.250944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975216d-5305-40f1-a8e8-7a7198326688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:24.251742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975216d-5305-40f1-a8e8-7a7198326688 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:24.252021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975216d-5305-40f1-a8e8-7a7198326688 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:24.252292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975216d-5305-40f1-a8e8-7a7198326688 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:24.262764 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975216d-5305-40f1-a8e8-7a7198326688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:24.264288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975216d-5305-40f1-a8e8-7a7198326688 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:24.281256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-f975216d-5305-40f1-a8e8-7a7198326688 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:24.281256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:24.281256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:24.281256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:24.281256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:24.281256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:24.281256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:24.281256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:24.281256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:24.281256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:24.281256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:24.281256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:24.281256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:24.281256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:24.281256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:24.282672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:24.283547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:24.283547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:24.283547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:24.283547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:24.283547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 262/501] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:24.283547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975216d-5305-40f1-a8e8-7a7198326688 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:24.287216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac591b-5239-415c-b24a-e7e9f912d315 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:24.320838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5494350-5b77-4603-aed1-fd4d20e0b6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:24.321637 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5494350-5b77-4603-aed1-fd4d20e0b6ed None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:24.321917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5494350-5b77-4603-aed1-fd4d20e0b6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:24.322189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5494350-5b77-4603-aed1-fd4d20e0b6ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:24.330635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:24.334282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5494350-5b77-4603-aed1-fd4d20e0b6ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:24.335834 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5494350-5b77-4603-aed1-fd4d20e0b6ed None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:24.353252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f5494350-5b77-4603-aed1-fd4d20e0b6ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:24.353252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:24.353252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:24.353252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:24.353252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:24.353252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:24.353252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:24.353252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:24.353252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:24.353252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:24.353252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:24.353252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:24.353252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:24.353252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:24.353252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:24.354275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:24.355243 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:24.355243 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:24.355243 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:24.355243 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:24.355243 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 240/502] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:24.355500 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5494350-5b77-4603-aed1-fd4d20e0b6ed None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:24.383556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:24.387970 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975216d-5305-40f1-a8e8-7a7198326688 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:24.422180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff3644-8a3d-46f7-aaa2-b7845f480448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:24.422974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff3644-8a3d-46f7-aaa2-b7845f480448 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:24.423262 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff3644-8a3d-46f7-aaa2-b7845f480448 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:24.423536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff3644-8a3d-46f7-aaa2-b7845f480448 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:24.424272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff3644-8a3d-46f7-aaa2-b7845f480448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:24.424582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff3644-8a3d-46f7-aaa2-b7845f480448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:24.426022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff3644-8a3d-46f7-aaa2-b7845f480448 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:24.438692 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 263/503] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:24.439875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff9fc-fa5a-4eaf-9e68-67d2a3c16cac None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:24.440171 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff9fc-fa5a-4eaf-9e68-67d2a3c16cac None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:24.440518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ff9fc-fa5a-4eaf-9e68-67d2a3c16cac None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:24.441745 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 264/504] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:24.442440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ff9fc-fa5a-4eaf-9e68-67d2a3c16cac None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:24.461915 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5494350-5b77-4603-aed1-fd4d20e0b6ed None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:24.497682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49e685-2490-44fa-bb60-55014e97a419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:24.498488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49e685-2490-44fa-bb60-55014e97a419 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:24.498770 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49e685-2490-44fa-bb60-55014e97a419 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:24.499074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49e685-2490-44fa-bb60-55014e97a419 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:24.509263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49e685-2490-44fa-bb60-55014e97a419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0a49e685-2490-44fa-bb60-55014e97a419 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:24.517063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:24.517959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:24.518973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:24.518973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:24.518973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:24.518973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:24.518973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:24.518973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:24.518973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:24.518973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:24.518973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:24.518973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:24.518973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:24.518973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:24.518973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 241/505] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:24.519845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49e685-2490-44fa-bb60-55014e97a419 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:24.548098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ff9fc-fa5a-4eaf-9e68-67d2a3c16cac None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:24.571374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:24.582193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472809f3-6c85-4565-995b-f6f1a8eb32bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:24.582881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472809f3-6c85-4565-995b-f6f1a8eb32bf None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:24.583173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472809f3-6c85-4565-995b-f6f1a8eb32bf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:24.583454 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472809f3-6c85-4565-995b-f6f1a8eb32bf None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:24.584187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472809f3-6c85-4565-995b-f6f1a8eb32bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:24.584498 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472809f3-6c85-4565-995b-f6f1a8eb32bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:24.585942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472809f3-6c85-4565-995b-f6f1a8eb32bf None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:24.597654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 265/506] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:24.598703 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472809f3-6c85-4565-995b-f6f1a8eb32bf None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:24.619675 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:24.620359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49e685-2490-44fa-bb60-55014e97a419 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:24.654471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2ffb6-1a23-4b03-9892-787ec2e0e9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:24.655181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2ffb6-1a23-4b03-9892-787ec2e0e9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:24.655464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2ffb6-1a23-4b03-9892-787ec2e0e9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:24.655734 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2ffb6-1a23-4b03-9892-787ec2e0e9c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:24.656469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2ffb6-1a23-4b03-9892-787ec2e0e9c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:24.656781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2ffb6-1a23-4b03-9892-787ec2e0e9c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:24.658186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2ffb6-1a23-4b03-9892-787ec2e0e9c0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:24.670045 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 242/507] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:24.671087 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa643b06-e94d-4033-959e-4e6140cea3bf None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:24.671374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa643b06-e94d-4033-959e-4e6140cea3bf None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:24.671677 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa643b06-e94d-4033-959e-4e6140cea3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:24.687498 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-aa643b06-e94d-4033-959e-4e6140cea3bf None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:24.688703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aa643b06-e94d-4033-959e-4e6140cea3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:24.702239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472809f3-6c85-4565-995b-f6f1a8eb32bf None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:24.736794 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85456283-0a56-42dd-97fa-09abea7ef0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:24.737701 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85456283-0a56-42dd-97fa-09abea7ef0da None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:24.737972 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85456283-0a56-42dd-97fa-09abea7ef0da None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:24.738269 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85456283-0a56-42dd-97fa-09abea7ef0da None admin] PATH_INFO: `/v3/users/glance` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:24.746781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85456283-0a56-42dd-97fa-09abea7ef0da None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:24.748447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85456283-0a56-42dd-97fa-09abea7ef0da None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:24.759082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 243/508] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:24.759937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa643b06-e94d-4033-959e-4e6140cea3bf None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-85456283-0a56-42dd-97fa-09abea7ef0da None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:24.764607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:24.765677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:24.766765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:24.766765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:24.766765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:24.766765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:24.766765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:24.766765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:24.766765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:24.766765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:24.766765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 15:52:24.766765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:24.773162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 266/509] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:24.773162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85456283-0a56-42dd-97fa-09abea7ef0da None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:24.807558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:24.857120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:24.862684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa643b06-e94d-4033-959e-4e6140cea3bf None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:24.882152 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85456283-0a56-42dd-97fa-09abea7ef0da None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:24.896961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c724cbd-b8a0-42e6-a714-a20abb91e873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:24.897631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c724cbd-b8a0-42e6-a714-a20abb91e873 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:24.897906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c724cbd-b8a0-42e6-a714-a20abb91e873 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:24.898173 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c724cbd-b8a0-42e6-a714-a20abb91e873 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:24.898957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c724cbd-b8a0-42e6-a714-a20abb91e873 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:24.899254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c724cbd-b8a0-42e6-a714-a20abb91e873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:24.900627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c724cbd-b8a0-42e6-a714-a20abb91e873 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:24.908682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 244/510] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:24.909323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c724cbd-b8a0-42e6-a714-a20abb91e873 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:24.918893 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31bb95-9f5a-42a7-808f-c9434dfa3432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:24.919795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31bb95-9f5a-42a7-808f-c9434dfa3432 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:24.920073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31bb95-9f5a-42a7-808f-c9434dfa3432 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:24.920346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31bb95-9f5a-42a7-808f-c9434dfa3432 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:24.928235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31bb95-9f5a-42a7-808f-c9434dfa3432 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:24.929703 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31bb95-9f5a-42a7-808f-c9434dfa3432 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ec31bb95-9f5a-42a7-808f-c9434dfa3432 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:24.943854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:24.944740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:24.945629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:24.945629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:24.945629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:24.945629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:24.945629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:24.945629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:24.945629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:24.945629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:24.945629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 15:52:24.945629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:24.945629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 267/511] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:24.946805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31bb95-9f5a-42a7-808f-c9434dfa3432 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:25.009766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c724cbd-b8a0-42e6-a714-a20abb91e873 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:25.012061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:25.043641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef374088-98d7-42fb-bb93-a489ddc833a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:25.044443 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef374088-98d7-42fb-bb93-a489ddc833a0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:25.044721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef374088-98d7-42fb-bb93-a489ddc833a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:25.044990 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef374088-98d7-42fb-bb93-a489ddc833a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:25.046995 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31bb95-9f5a-42a7-808f-c9434dfa3432 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:25.051840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef374088-98d7-42fb-bb93-a489ddc833a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:25.053309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef374088-98d7-42fb-bb93-a489ddc833a0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:25.068301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ef374088-98d7-42fb-bb93-a489ddc833a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:25.068301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:25.068301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:25.068301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:25.068301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:25.068301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:25.068301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:25.068301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:25.068301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:25.068301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:25.068301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:25.068301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:25.068301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:25.068301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:25.068301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:25.069244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:25.070131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:25.070131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:25.070131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:25.070131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:25.070131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:25.070131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:25.070131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:25.070131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:25.070131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 245/512] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:25.070616 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef374088-98d7-42fb-bb93-a489ddc833a0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:25.087449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990384a-50cb-4c2a-9969-9b1a48b1d65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:25.088147 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990384a-50cb-4c2a-9969-9b1a48b1d65a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:25.088432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990384a-50cb-4c2a-9969-9b1a48b1d65a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:25.088692 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990384a-50cb-4c2a-9969-9b1a48b1d65a None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:25.089569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990384a-50cb-4c2a-9969-9b1a48b1d65a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:25.089886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990384a-50cb-4c2a-9969-9b1a48b1d65a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:25.092228 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990384a-50cb-4c2a-9969-9b1a48b1d65a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:25.105820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:25.117813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 268/513] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 21 15:52:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:25.118684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990384a-50cb-4c2a-9969-9b1a48b1d65a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:25.170133 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef374088-98d7-42fb-bb93-a489ddc833a0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:25.207542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f75ab-1ef6-4574-9f2f-ccc9c5f831df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:25.208431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f75ab-1ef6-4574-9f2f-ccc9c5f831df None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:25.208771 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f75ab-1ef6-4574-9f2f-ccc9c5f831df None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:25.209105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f75ab-1ef6-4574-9f2f-ccc9c5f831df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:25.219589 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f75ab-1ef6-4574-9f2f-ccc9c5f831df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:25.221058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f75ab-1ef6-4574-9f2f-ccc9c5f831df None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:25.233286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990384a-50cb-4c2a-9969-9b1a48b1d65a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:25.238864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-fd7f75ab-1ef6-4574-9f2f-ccc9c5f831df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:25.238864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:25.238864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:25.238864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:25.238864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:25.238864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:25.238864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:25.238864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:25.238864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:25.238864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:25.238864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:25.238864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:25.238864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:25.238864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:25.238864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:25.239793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:25.241000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:25.241000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:25.241000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:25.241000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:25.241000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 246/514] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:25.241758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f75ab-1ef6-4574-9f2f-ccc9c5f831df None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:25.260609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:25.274867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7259525-d7cf-436a-b9b4-708f45187828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:25.275682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7259525-d7cf-436a-b9b4-708f45187828 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:25.275964 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7259525-d7cf-436a-b9b4-708f45187828 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:25.276239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7259525-d7cf-436a-b9b4-708f45187828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:25.286743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7259525-d7cf-436a-b9b4-708f45187828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:25.288253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7259525-d7cf-436a-b9b4-708f45187828 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:25.306011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a7259525-d7cf-436a-b9b4-708f45187828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:25.306011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:25.306011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:25.306011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:25.306011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:25.306011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:25.306011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:25.306011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:25.306011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:25.306011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:25.306011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:25.306011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:25.306011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:25.306011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:25.306011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:25.306960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:25.307805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:25.307805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:25.307805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:25.307805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:25.307805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 269/515] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:25.308068 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7259525-d7cf-436a-b9b4-708f45187828 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:25.344611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f75ab-1ef6-4574-9f2f-ccc9c5f831df None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:25.361141 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:25.379716 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ced117-1452-4078-8daf-5733bc0389cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:25.380412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ced117-1452-4078-8daf-5733bc0389cc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:25.380714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ced117-1452-4078-8daf-5733bc0389cc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:25.380975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ced117-1452-4078-8daf-5733bc0389cc None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:25.381823 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ced117-1452-4078-8daf-5733bc0389cc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:25.382147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ced117-1452-4078-8daf-5733bc0389cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:25.383654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ced117-1452-4078-8daf-5733bc0389cc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:25.411686 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7259525-d7cf-436a-b9b4-708f45187828 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:25.421474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 247/516] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 21 15:52:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:25.422262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ced117-1452-4078-8daf-5733bc0389cc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:25.446509 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757a4f4-7199-451d-aae1-68c0fa6a715b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:25.447225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757a4f4-7199-451d-aae1-68c0fa6a715b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:25.447518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757a4f4-7199-451d-aae1-68c0fa6a715b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:25.447795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757a4f4-7199-451d-aae1-68c0fa6a715b None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:25.448571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757a4f4-7199-451d-aae1-68c0fa6a715b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:25.448887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757a4f4-7199-451d-aae1-68c0fa6a715b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:25.450360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757a4f4-7199-451d-aae1-68c0fa6a715b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:25.468516 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 270/517] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:25.469371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757a4f4-7199-451d-aae1-68c0fa6a715b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:25.508569 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:25.535299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ced117-1452-4078-8daf-5733bc0389cc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:25.571432 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bae531-cf33-41ae-aea9-da4333584d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:25.572081 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bae531-cf33-41ae-aea9-da4333584d53 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:25.572363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bae531-cf33-41ae-aea9-da4333584d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:25.572641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bae531-cf33-41ae-aea9-da4333584d53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:25.573601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757a4f4-7199-451d-aae1-68c0fa6a715b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:25.582581 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:25.607148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfa648-40e2-4c93-96f2-47793023b9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:25.607821 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfa648-40e2-4c93-96f2-47793023b9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:25.608103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfa648-40e2-4c93-96f2-47793023b9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:25.608380 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfa648-40e2-4c93-96f2-47793023b9b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:25.609110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfa648-40e2-4c93-96f2-47793023b9b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:25.609420 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfa648-40e2-4c93-96f2-47793023b9b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:25.610841 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bfa648-40e2-4c93-96f2-47793023b9b1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:25.622947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 271/518] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:25.623778 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfa648-40e2-4c93-96f2-47793023b9b1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:25.644490 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bae531-cf33-41ae-aea9-da4333584d53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:25.645993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bae531-cf33-41ae-aea9-da4333584d53 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:25.719345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:25.723488 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bfa648-40e2-4c93-96f2-47793023b9b1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:25.744613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 248/519] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:25.745480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bae531-cf33-41ae-aea9-da4333584d53 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:25.759785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06d977-ff46-427f-9615-d369aef0b7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:25.760443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06d977-ff46-427f-9615-d369aef0b7fd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:25.760725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06d977-ff46-427f-9615-d369aef0b7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:25.761025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06d977-ff46-427f-9615-d369aef0b7fd None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:25.761731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06d977-ff46-427f-9615-d369aef0b7fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:25.762045 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06d977-ff46-427f-9615-d369aef0b7fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:25.763553 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06d977-ff46-427f-9615-d369aef0b7fd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:25.775044 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 272/520] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:25.775843 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06d977-ff46-427f-9615-d369aef0b7fd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:25.804760 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:25.849601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bae531-cf33-41ae-aea9-da4333584d53 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:25.879109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06d977-ff46-427f-9615-d369aef0b7fd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:25.883298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894f933-0de5-48fa-8bd4-728908687a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:25.883952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894f933-0de5-48fa-8bd4-728908687a16 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:25.884228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894f933-0de5-48fa-8bd4-728908687a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:25.884495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4894f933-0de5-48fa-8bd4-728908687a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:25.912904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de4f2d-6013-4584-bd38-81432dbab020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:25.913567 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de4f2d-6013-4584-bd38-81432dbab020 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:25.913845 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de4f2d-6013-4584-bd38-81432dbab020 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:25.914109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de4f2d-6013-4584-bd38-81432dbab020 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:25.914961 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de4f2d-6013-4584-bd38-81432dbab020 None admin] RBAC: Adding query filter params (role.id=ae7cbb39ab61467ba1976a753ba6693c, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=e9a1ec1f6bb7467dbd63ad1da36d48a9) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:25.915273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de4f2d-6013-4584-bd38-81432dbab020 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:25.916720 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de4f2d-6013-4584-bd38-81432dbab020 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:25.922099 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 273/521] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:52:25 2022] GET /identity/v3/role_assignments?user.id=e9a1ec1f6bb7467dbd63ad1da36d48a9&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=ae7cbb39ab61467ba1976a753ba6693c => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:25.922861 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de4f2d-6013-4584-bd38-81432dbab020 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:25.930789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:25.963432 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894f933-0de5-48fa-8bd4-728908687a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:25.964931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4894f933-0de5-48fa-8bd4-728908687a16 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:26.042914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:26.052732 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de4f2d-6013-4584-bd38-81432dbab020 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:26.088500 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 249/522] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:26.089473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894f933-0de5-48fa-8bd4-728908687a16 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:26.095717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c7cbd-eee9-4664-b2f8-9972209d8bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:26.096421 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c7cbd-eee9-4664-b2f8-9972209d8bed None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:26.096740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c7cbd-eee9-4664-b2f8-9972209d8bed None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:26.097102 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c7cbd-eee9-4664-b2f8-9972209d8bed None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:26.097765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c7cbd-eee9-4664-b2f8-9972209d8bed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:26.099280 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c7cbd-eee9-4664-b2f8-9972209d8bed None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:26.130855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 274/523] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:52:25 2022] POST /identity/v3/users => generated 247 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:52:26.130855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c7cbd-eee9-4664-b2f8-9972209d8bed None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:26.193659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:26.240135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4894f933-0de5-48fa-8bd4-728908687a16 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:26.261885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c7cbd-eee9-4664-b2f8-9972209d8bed None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:26.288826 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f10e42-3ce8-47e3-bb43-8733ca00c6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:26.289774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f10e42-3ce8-47e3-bb43-8733ca00c6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:26.290124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f10e42-3ce8-47e3-bb43-8733ca00c6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:26.290468 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f10e42-3ce8-47e3-bb43-8733ca00c6a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:26.302560 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f10e42-3ce8-47e3-bb43-8733ca00c6a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:26.304236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f10e42-3ce8-47e3-bb43-8733ca00c6a8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:26.308317 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea0d2a-42e5-40e4-af64-2ac30155c531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:26.309146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0d2a-42e5-40e4-af64-2ac30155c531 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:26.309428 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0d2a-42e5-40e4-af64-2ac30155c531 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:26.309706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea0d2a-42e5-40e4-af64-2ac30155c531 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:26.321453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea0d2a-42e5-40e4-af64-2ac30155c531 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:26.322961 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea0d2a-42e5-40e4-af64-2ac30155c531 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:26.325195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-81f10e42-3ce8-47e3-bb43-8733ca00c6a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:26.325195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:26.325195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:26.325195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:26.325195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:26.325195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:26.325195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:26.325195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:26.325195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:26.325195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:26.325195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:26.325195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:26.325195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:26.325195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:26.325195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:26.326008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:26.326913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:26.326913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:26.326913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:26.326913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:26.326913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 250/524] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:26.327968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f10e42-3ce8-47e3-bb43-8733ca00c6a8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-91ea0d2a-42e5-40e4-af64-2ac30155c531 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:26.346426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:26.347507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:26.348443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:26.348443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:26.348443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:26.348443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:26.348443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:26.348443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:26.348443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:26.348443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:26.348443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 15:52:26.348443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:26.348443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 275/525] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:26.348993 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea0d2a-42e5-40e4-af64-2ac30155c531 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:26.365016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:26.473149 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f10e42-3ce8-47e3-bb43-8733ca00c6a8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:26.477393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea0d2a-42e5-40e4-af64-2ac30155c531 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:26.507197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:26.517761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419e923-bea5-43f0-b179-cab9e0bf7725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:26.517971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b5126-9f63-480f-96f4-e88eec7fdf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:26.518904 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419e923-bea5-43f0-b179-cab9e0bf7725 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:26.519017 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b5126-9f63-480f-96f4-e88eec7fdf86 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:26.519356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419e923-bea5-43f0-b179-cab9e0bf7725 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:26.519466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b5126-9f63-480f-96f4-e88eec7fdf86 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:26.519810 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419e923-bea5-43f0-b179-cab9e0bf7725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:26.519922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b5126-9f63-480f-96f4-e88eec7fdf86 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:26.521265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b5126-9f63-480f-96f4-e88eec7fdf86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:26.521746 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b5126-9f63-480f-96f4-e88eec7fdf86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:26.524677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b5126-9f63-480f-96f4-e88eec7fdf86 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:26.531811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419e923-bea5-43f0-b179-cab9e0bf7725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:26.533371 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419e923-bea5-43f0-b179-cab9e0bf7725 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:26.546919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 276/526] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:26.547919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b5126-9f63-480f-96f4-e88eec7fdf86 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:26.561106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4419e923-bea5-43f0-b179-cab9e0bf7725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:26.561106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:26.561106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:26.561106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:26.561106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:26.561106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:26.561106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:26.561106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:26.561106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:26.561106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:26.561106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:26.561106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:26.561106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:26.561106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:26.561106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:26.562015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:26.562908 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:26.562908 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:26.562908 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:26.562908 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:26.567754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 251/527] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:26.569187 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419e923-bea5-43f0-b179-cab9e0bf7725 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:26.641168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:26.688951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b5126-9f63-480f-96f4-e88eec7fdf86 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:26.691667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419e923-bea5-43f0-b179-cab9e0bf7725 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:26.732804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fe562-7c06-4488-a6b9-96f1c9074033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:26.733619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fe562-7c06-4488-a6b9-96f1c9074033 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:26.733901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fe562-7c06-4488-a6b9-96f1c9074033 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:26.734271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fe562-7c06-4488-a6b9-96f1c9074033 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:26.735659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ec2fd-3d0e-46d8-8c30-b7b02edd7240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:26.737057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec2fd-3d0e-46d8-8c30-b7b02edd7240 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:26.737709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec2fd-3d0e-46d8-8c30-b7b02edd7240 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:26.738279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ec2fd-3d0e-46d8-8c30-b7b02edd7240 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:26.739509 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ec2fd-3d0e-46d8-8c30-b7b02edd7240 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:26.739920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ec2fd-3d0e-46d8-8c30-b7b02edd7240 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:26.741848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ec2fd-3d0e-46d8-8c30-b7b02edd7240 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:26.741966 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fe562-7c06-4488-a6b9-96f1c9074033 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:26.743337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fe562-7c06-4488-a6b9-96f1c9074033 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:26.758240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-208fe562-7c06-4488-a6b9-96f1c9074033 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:26.758240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:26.758240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:26.758240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:26.758240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:26.758240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:26.758240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:26.758240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:26.758240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:26.758240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:26.758240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:26.758240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:26.758240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:26.758240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:26.758240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:26.760548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:26.761824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:26.761824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:26.761824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:26.761824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:26.761824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:26.761824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:26.761824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:26.761824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:26.761824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 252/528] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:26.761824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fe562-7c06-4488-a6b9-96f1c9074033 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:26.775031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 277/529] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Jul 21 15:52:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:26.776015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ec2fd-3d0e-46d8-8c30-b7b02edd7240 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:26.810773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:26.883672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fe562-7c06-4488-a6b9-96f1c9074033 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:26.897046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ec2fd-3d0e-46d8-8c30-b7b02edd7240 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:26.921626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06579260-1386-47e7-bed9-06a84fde67d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:26.922652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06579260-1386-47e7-bed9-06a84fde67d5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:26.923397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06579260-1386-47e7-bed9-06a84fde67d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:26.923770 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06579260-1386-47e7-bed9-06a84fde67d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:26.924586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06579260-1386-47e7-bed9-06a84fde67d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:26.925005 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06579260-1386-47e7-bed9-06a84fde67d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:26.925426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:26.928393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06579260-1386-47e7-bed9-06a84fde67d5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:26.935058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a740b9-7437-4551-941e-772cf7e492b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:26.935819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a740b9-7437-4551-941e-772cf7e492b1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:26.936165 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a740b9-7437-4551-941e-772cf7e492b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:26.936509 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a740b9-7437-4551-941e-772cf7e492b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:26.937613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a740b9-7437-4551-941e-772cf7e492b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:26.937845 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a740b9-7437-4551-941e-772cf7e492b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:26.939429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a740b9-7437-4551-941e-772cf7e492b1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:26.943901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 253/530] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:26.944975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06579260-1386-47e7-bed9-06a84fde67d5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:26.952724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 278/531] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:26.953486 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a740b9-7437-4551-941e-772cf7e492b1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:27.048837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:27.053034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06579260-1386-47e7-bed9-06a84fde67d5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:27.061382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a740b9-7437-4551-941e-772cf7e492b1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:27.092787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71136a40-58ec-4cfd-9365-3aa09cdb6caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:27.093546 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71136a40-58ec-4cfd-9365-3aa09cdb6caf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:27.093865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71136a40-58ec-4cfd-9365-3aa09cdb6caf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:27.094142 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71136a40-58ec-4cfd-9365-3aa09cdb6caf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:27.099683 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596239d-980b-45c6-9900-f10d2718f52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:27.100672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596239d-980b-45c6-9900-f10d2718f52c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:27.101115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596239d-980b-45c6-9900-f10d2718f52c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:27.101527 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596239d-980b-45c6-9900-f10d2718f52c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:27.109048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596239d-980b-45c6-9900-f10d2718f52c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:27.110757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596239d-980b-45c6-9900-f10d2718f52c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:27.127089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-9596239d-980b-45c6-9900-f10d2718f52c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:27.127089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:27.127089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:27.127089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:27.127089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:27.127089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:27.127089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:27.127089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:27.127089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:27.127089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:27.127089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:27.127089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:27.127089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:27.127089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:27.127089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:27.128172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:27.129153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:27.129153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:27.129153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:27.129153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:27.129153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:27.129153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:27.129153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:27.129153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:27.131249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 279/532] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:27.132376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596239d-980b-45c6-9900-f10d2718f52c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:27.168035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71136a40-58ec-4cfd-9365-3aa09cdb6caf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:27.169637 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71136a40-58ec-4cfd-9365-3aa09cdb6caf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:27.181552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:27.245019 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596239d-980b-45c6-9900-f10d2718f52c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:27.281658 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24cda8-c8ee-48bc-a556-9f7345c738e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:27.282484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:27.283757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24cda8-c8ee-48bc-a556-9f7345c738e1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:27.284204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24cda8-c8ee-48bc-a556-9f7345c738e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:27.284618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24cda8-c8ee-48bc-a556-9f7345c738e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:27.285714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24cda8-c8ee-48bc-a556-9f7345c738e1 None admin] RBAC: Adding query filter params (role.id=ae7cbb39ab61467ba1976a753ba6693c, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=1a3418c0b46c404c8ca445cce9db632d) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:27.286166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24cda8-c8ee-48bc-a556-9f7345c738e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:27.287925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24cda8-c8ee-48bc-a556-9f7345c738e1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:27.291982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 254/533] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:27.292647 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71136a40-58ec-4cfd-9365-3aa09cdb6caf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:27.295116 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 280/534] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:52:27 2022] GET /identity/v3/role_assignments?user.id=1a3418c0b46c404c8ca445cce9db632d&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=ae7cbb39ab61467ba1976a753ba6693c => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:27.296259 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24cda8-c8ee-48bc-a556-9f7345c738e1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:27.408782 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71136a40-58ec-4cfd-9365-3aa09cdb6caf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:27.447565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542c0ac-f835-47a8-a6e3-b66f4a8e6ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:27.448171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c0ac-f835-47a8-a6e3-b66f4a8e6ada None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:27.448452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c0ac-f835-47a8-a6e3-b66f4a8e6ada None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:27.448727 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0542c0ac-f835-47a8-a6e3-b66f4a8e6ada None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:27.449629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542c0ac-f835-47a8-a6e3-b66f4a8e6ada None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:27.449964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542c0ac-f835-47a8-a6e3-b66f4a8e6ada None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:27.451516 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0542c0ac-f835-47a8-a6e3-b66f4a8e6ada None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:27.472931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 255/535] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:27.479212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542c0ac-f835-47a8-a6e3-b66f4a8e6ada None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:27.486691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24cda8-c8ee-48bc-a556-9f7345c738e1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:27.510885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:27.556283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648328c-e354-419c-b6f1-fd847a13faa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:27.558338 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648328c-e354-419c-b6f1-fd847a13faa4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:27.558954 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648328c-e354-419c-b6f1-fd847a13faa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:27.560689 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648328c-e354-419c-b6f1-fd847a13faa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:27.579417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648328c-e354-419c-b6f1-fd847a13faa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:27.581886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648328c-e354-419c-b6f1-fd847a13faa4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:27.583808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:27.612290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-c648328c-e354-419c-b6f1-fd847a13faa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:27.612290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:27.612290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:27.612290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:27.612290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:27.612290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:27.612290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:27.612290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:27.612290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:27.612290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:27.612290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:27.612290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:27.612290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:27.612290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:27.612290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:27.613230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:27.614076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:27.614076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:27.614076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:27.614076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:27.616812 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 281/536] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:27.622776 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648328c-e354-419c-b6f1-fd847a13faa4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:27.656377 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0542c0ac-f835-47a8-a6e3-b66f4a8e6ada None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:27.696620 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5c369-0b0b-4510-836d-5a7367b75289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:27.697296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5c369-0b0b-4510-836d-5a7367b75289 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:27.697631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5c369-0b0b-4510-836d-5a7367b75289 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:27.697841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5c369-0b0b-4510-836d-5a7367b75289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:27.702860 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5c369-0b0b-4510-836d-5a7367b75289 None admin] RBAC: Adding query filter params (role.id=ae7cbb39ab61467ba1976a753ba6693c, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=d8c629ecd4014e2b8051b853a0b4c18a) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:27.702860 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5c369-0b0b-4510-836d-5a7367b75289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:27.702860 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5c369-0b0b-4510-836d-5a7367b75289 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:27.711637 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 256/537] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:52:27 2022] GET /identity/v3/role_assignments?user.id=d8c629ecd4014e2b8051b853a0b4c18a&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=ae7cbb39ab61467ba1976a753ba6693c => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:27.764504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648328c-e354-419c-b6f1-fd847a13faa4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:27.801634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aacdff-f8ce-4660-a3e8-1521c33592bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:27.802320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aacdff-f8ce-4660-a3e8-1521c33592bd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:27.802599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aacdff-f8ce-4660-a3e8-1521c33592bd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:27.802905 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aacdff-f8ce-4660-a3e8-1521c33592bd None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:27.803659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aacdff-f8ce-4660-a3e8-1521c33592bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:27.803966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aacdff-f8ce-4660-a3e8-1521c33592bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:27.805375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aacdff-f8ce-4660-a3e8-1521c33592bd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:27.821438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 282/538] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:27.828056 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5c369-0b0b-4510-836d-5a7367b75289 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:27.950364 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5c369-0b0b-4510-836d-5a7367b75289 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:27.974481 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:27.986218 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f718dd-8c21-41c0-a3f4-6f67e328c566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:27.987069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f718dd-8c21-41c0-a3f4-6f67e328c566 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:27.987418 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f718dd-8c21-41c0-a3f4-6f67e328c566 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:27.987699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f718dd-8c21-41c0-a3f4-6f67e328c566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:27.995564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f718dd-8c21-41c0-a3f4-6f67e328c566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:27.997070 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f718dd-8c21-41c0-a3f4-6f67e328c566 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:28.012214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d6f718dd-8c21-41c0-a3f4-6f67e328c566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:28.012214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:28.012214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:28.012214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:28.012214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:28.012214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:28.012214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:28.012214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:28.012214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:28.012214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:28.012214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:28.012214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:28.012214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:28.012214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:28.012214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:28.013122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:28.013947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:28.013947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:28.013947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:28.013947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:28.013947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:28.013947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:28.013947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:28.013947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:28.013947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 257/539] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:28.019607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aacdff-f8ce-4660-a3e8-1521c33592bd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:28.049773 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:28.160017 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aacdff-f8ce-4660-a3e8-1521c33592bd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:28.216578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca16ace-5867-44d6-a549-d748506b50d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:28.217189 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca16ace-5867-44d6-a549-d748506b50d4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:28.217471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca16ace-5867-44d6-a549-d748506b50d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:28.217746 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca16ace-5867-44d6-a549-d748506b50d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:28.218552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca16ace-5867-44d6-a549-d748506b50d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:28.218889 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca16ace-5867-44d6-a549-d748506b50d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:28.220365 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca16ace-5867-44d6-a549-d748506b50d4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:28.245015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 283/540] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:28.250974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f718dd-8c21-41c0-a3f4-6f67e328c566 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:28.266394 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95864cb4-0850-4443-b602-b0f4ddce69c3 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:28.266726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95864cb4-0850-4443-b602-b0f4ddce69c3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:28.266980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95864cb4-0850-4443-b602-b0f4ddce69c3 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:28.268530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 284/541] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:28.274582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0341f-387a-471d-a88c-3bf85969e1b2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:28.274896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0341f-387a-471d-a88c-3bf85969e1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:28.275178 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0341f-387a-471d-a88c-3bf85969e1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:28.298304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-37e0341f-387a-471d-a88c-3bf85969e1b2 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:28.299590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-37e0341f-387a-471d-a88c-3bf85969e1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:28.383201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f718dd-8c21-41c0-a3f4-6f67e328c566 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:28.434367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09340c6-e338-4300-9263-0d93cbb293c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:28.435065 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09340c6-e338-4300-9263-0d93cbb293c3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:28.435343 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09340c6-e338-4300-9263-0d93cbb293c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:28.435614 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09340c6-e338-4300-9263-0d93cbb293c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:28.436464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09340c6-e338-4300-9263-0d93cbb293c3 None admin] RBAC: Adding query filter params (role.id=ae7cbb39ab61467ba1976a753ba6693c, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=1b46a82ffe92437fb8205bd186a8b05e) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:28.436774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09340c6-e338-4300-9263-0d93cbb293c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:28.438247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09340c6-e338-4300-9263-0d93cbb293c3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:28.444124 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 285/542] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:52:28.447292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 258/543] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:52:28 2022] GET /identity/v3/role_assignments?user.id=1b46a82ffe92437fb8205bd186a8b05e&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=ae7cbb39ab61467ba1976a753ba6693c => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:28.485738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0341f-387a-471d-a88c-3bf85969e1b2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:28.505640 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:28.623061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0341f-387a-471d-a88c-3bf85969e1b2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:28.668664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f86c8e-5125-47d8-9da4-f8389a08499f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:28.669500 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f86c8e-5125-47d8-9da4-f8389a08499f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:28.669781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f86c8e-5125-47d8-9da4-f8389a08499f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:28.670054 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f86c8e-5125-47d8-9da4-f8389a08499f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:28.682242 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f86c8e-5125-47d8-9da4-f8389a08499f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d1f86c8e-5125-47d8-9da4-f8389a08499f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:28.690632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:28.691664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:28.692471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:28.692471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:28.692471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:28.692471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:28.692471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:28.692471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:28.692471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:28.692471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:28.692471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:28.692471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:28.692471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:28.692471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:28.692471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 286/544] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:28.699574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09340c6-e338-4300-9263-0d93cbb293c3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:28.738219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28991342-7e66-4baf-85dd-c1a02f775c7b None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:28.738508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28991342-7e66-4baf-85dd-c1a02f775c7b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:28.738683 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28991342-7e66-4baf-85dd-c1a02f775c7b None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:28.740513 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 287/545] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:52:28.747752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831e5ac-74e1-4dfe-aac9-c34e8e34c8a9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:28.748055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831e5ac-74e1-4dfe-aac9-c34e8e34c8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:28.748358 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831e5ac-74e1-4dfe-aac9-c34e8e34c8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:28.763204 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:28.768952 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c831e5ac-74e1-4dfe-aac9-c34e8e34c8a9 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:28.770454 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c831e5ac-74e1-4dfe-aac9-c34e8e34c8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:28.823326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09340c6-e338-4300-9263-0d93cbb293c3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:28.850589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 288/546] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:52:28.871667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551df5b-b143-4183-9e4b-48b3daeb58cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:28.872737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551df5b-b143-4183-9e4b-48b3daeb58cf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:28.873226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551df5b-b143-4183-9e4b-48b3daeb58cf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:28.873696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e551df5b-b143-4183-9e4b-48b3daeb58cf None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:28.874698 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551df5b-b143-4183-9e4b-48b3daeb58cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:28.875228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551df5b-b143-4183-9e4b-48b3daeb58cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:28.876818 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e551df5b-b143-4183-9e4b-48b3daeb58cf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:28.886090 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 259/547] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:28.893997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831e5ac-74e1-4dfe-aac9-c34e8e34c8a9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:28.894184 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:28.905667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551df5b-b143-4183-9e4b-48b3daeb58cf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:29.082722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831e5ac-74e1-4dfe-aac9-c34e8e34c8a9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:29.092793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e551df5b-b143-4183-9e4b-48b3daeb58cf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:29.115572 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:29.145839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a867c-9762-42aa-9adf-a8aa55a23635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:29.146760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a867c-9762-42aa-9adf-a8aa55a23635 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:29.147079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a867c-9762-42aa-9adf-a8aa55a23635 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:29.147554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a867c-9762-42aa-9adf-a8aa55a23635 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:29.161072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a867c-9762-42aa-9adf-a8aa55a23635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-979a867c-9762-42aa-9adf-a8aa55a23635 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:29.173711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:29.174672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:29.175558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:29.175558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:29.175558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:29.175558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:29.175558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:29.175558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:29.175558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:29.175558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:29.175558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:29.175558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:29.175558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:29.175558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:29.175558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 260/548] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:29.184983 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbd848-66d5-461f-8ee3-22be6d3474f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:29.185819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd848-66d5-461f-8ee3-22be6d3474f3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:29.186103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd848-66d5-461f-8ee3-22be6d3474f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:29.186381 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dbd848-66d5-461f-8ee3-22be6d3474f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:29.188654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a867c-9762-42aa-9adf-a8aa55a23635 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:29.209563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbd848-66d5-461f-8ee3-22be6d3474f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:29.211166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dbd848-66d5-461f-8ee3-22be6d3474f3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:29.247344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d6dbd848-66d5-461f-8ee3-22be6d3474f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:29.247344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:29.247344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:29.247344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:29.247344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:29.247344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:29.247344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:29.247344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:29.247344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:29.247344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:29.247344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:29.247344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:29.247344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:29.247344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:29.247344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:29.248276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:29.249819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:29.249819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:29.249819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:29.249819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:29.264899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 289/549] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:29.285588 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbd848-66d5-461f-8ee3-22be6d3474f3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:29.361840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a867c-9762-42aa-9adf-a8aa55a23635 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:29.402777 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02da1-b97a-4f23-bb78-aec5c567856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:29.403571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02da1-b97a-4f23-bb78-aec5c567856d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:29.403728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02da1-b97a-4f23-bb78-aec5c567856d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:29.403999 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d02da1-b97a-4f23-bb78-aec5c567856d None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:29.404762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d02da1-b97a-4f23-bb78-aec5c567856d None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:29.405068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d02da1-b97a-4f23-bb78-aec5c567856d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:29.406460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d02da1-b97a-4f23-bb78-aec5c567856d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:29.422201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:29.430422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 261/550] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:29.436431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02da1-b97a-4f23-bb78-aec5c567856d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:29.491461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dbd848-66d5-461f-8ee3-22be6d3474f3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:29.530637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696d03f-8682-4aa2-9e48-9bc1b53a6fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:29.531488 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696d03f-8682-4aa2-9e48-9bc1b53a6fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:29.531646 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696d03f-8682-4aa2-9e48-9bc1b53a6fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:29.531930 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9696d03f-8682-4aa2-9e48-9bc1b53a6fa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:29.532679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696d03f-8682-4aa2-9e48-9bc1b53a6fa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:29.532992 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696d03f-8682-4aa2-9e48-9bc1b53a6fa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:29.534518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9696d03f-8682-4aa2-9e48-9bc1b53a6fa2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:29.544862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:29.549967 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 290/551] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:29.558279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696d03f-8682-4aa2-9e48-9bc1b53a6fa2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:29.641429 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d02da1-b97a-4f23-bb78-aec5c567856d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:29.682007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a5404-240c-44f1-a901-5dbef04c8b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:29.683015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a5404-240c-44f1-a901-5dbef04c8b51 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:29.683299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a5404-240c-44f1-a901-5dbef04c8b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:29.683585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a5404-240c-44f1-a901-5dbef04c8b51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:29.696407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a5404-240c-44f1-a901-5dbef04c8b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:29.697896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a5404-240c-44f1-a901-5dbef04c8b51 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:29.721280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a33a5404-240c-44f1-a901-5dbef04c8b51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:29.721280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:29.721280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:29.721280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:29.721280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:29.721280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:29.721280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:29.721280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:29.721280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:29.721280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:29.721280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:29.721280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:29.721280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:29.721280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:29.721280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:29.722394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:29.723362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:29.723362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:29.723362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:29.723362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:29.723362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 262/552] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:29.724234 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bcc5f-3bc6-4ce0-8aa0-1acd5630c06d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:29.724518 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bcc5f-3bc6-4ce0-8aa0-1acd5630c06d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:29.724795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bcc5f-3bc6-4ce0-8aa0-1acd5630c06d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:29.726091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 263/553] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:29.731058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bcc5f-3bc6-4ce0-8aa0-1acd5630c06d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:29.754500 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9696d03f-8682-4aa2-9e48-9bc1b53a6fa2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:29.769595 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:29.793129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01d72b-43cf-4a5a-b98e-1780fbf49469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:29.794314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01d72b-43cf-4a5a-b98e-1780fbf49469 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:29.794918 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01d72b-43cf-4a5a-b98e-1780fbf49469 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:29.795389 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01d72b-43cf-4a5a-b98e-1780fbf49469 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:29.804067 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01d72b-43cf-4a5a-b98e-1780fbf49469 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:29.805980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01d72b-43cf-4a5a-b98e-1780fbf49469 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:29.820241 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-0e01d72b-43cf-4a5a-b98e-1780fbf49469 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:29.821792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:29.822721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:29.823656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:29.823656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:29.823656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:29.823656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:29.823656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:29.823656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:29.823656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:29.823656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:29.823656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:52:29.823656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:29.831456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 291/554] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 15:52:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:29.833199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c1134-f04b-4173-a54f-e25b59cb97b8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:29.833685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c1134-f04b-4173-a54f-e25b59cb97b8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:29.834174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c1134-f04b-4173-a54f-e25b59cb97b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:29.841689 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bcc5f-3bc6-4ce0-8aa0-1acd5630c06d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:29.852349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-688c1134-f04b-4173-a54f-e25b59cb97b8 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:29.853906 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-688c1134-f04b-4173-a54f-e25b59cb97b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:29.879355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56b6ec-e98c-4cdc-8eea-c63d1c8c3f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:29.880066 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56b6ec-e98c-4cdc-8eea-c63d1c8c3f2b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:29.880343 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56b6ec-e98c-4cdc-8eea-c63d1c8c3f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:29.880618 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56b6ec-e98c-4cdc-8eea-c63d1c8c3f2b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:29.881413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56b6ec-e98c-4cdc-8eea-c63d1c8c3f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:29.881721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56b6ec-e98c-4cdc-8eea-c63d1c8c3f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:29.883516 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be56b6ec-e98c-4cdc-8eea-c63d1c8c3f2b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:29.898034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 264/555] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:29.906856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56b6ec-e98c-4cdc-8eea-c63d1c8c3f2b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:29.954473 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 292/556] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:29.955682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c1134-f04b-4173-a54f-e25b59cb97b8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:30.029662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be56b6ec-e98c-4cdc-8eea-c63d1c8c3f2b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:30.066505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e0a48-e3d3-4151-8b46-6c0dfa7856ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:30.067241 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e0a48-e3d3-4151-8b46-6c0dfa7856ba None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:30.067531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e0a48-e3d3-4151-8b46-6c0dfa7856ba None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:30.067797 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e0a48-e3d3-4151-8b46-6c0dfa7856ba None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:30.068644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e0a48-e3d3-4151-8b46-6c0dfa7856ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:30.068955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e0a48-e3d3-4151-8b46-6c0dfa7856ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:30.070400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77e0a48-e3d3-4151-8b46-6c0dfa7856ba None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:30.085307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:30.090065 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 265/557] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 15:52:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:30.094926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e0a48-e3d3-4151-8b46-6c0dfa7856ba None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:30.095588 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c1134-f04b-4173-a54f-e25b59cb97b8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:30.097973 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:30.132287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607370b2-95df-4a68-8030-35b1f3568b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:30.133119 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607370b2-95df-4a68-8030-35b1f3568b6d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:30.133433 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607370b2-95df-4a68-8030-35b1f3568b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:30.133710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607370b2-95df-4a68-8030-35b1f3568b6d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:30.141486 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607370b2-95df-4a68-8030-35b1f3568b6d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:30.143007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607370b2-95df-4a68-8030-35b1f3568b6d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-607370b2-95df-4a68-8030-35b1f3568b6d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:30.158279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:30.159942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:30.160886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:30.160886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:30.160886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:30.160886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:30.160886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:30.160886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:30.160886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:30.160886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:30.160886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 15:52:30.160886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:30.160886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 293/558] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:52:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:30.161470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a562a6-ae11-411b-b77d-d9bacac0d88e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:30.161470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a562a6-ae11-411b-b77d-d9bacac0d88e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:30.161596 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a562a6-ae11-411b-b77d-d9bacac0d88e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:30.163197 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 294/559] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:30.167671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a562a6-ae11-411b-b77d-d9bacac0d88e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:30.213546 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e0a48-e3d3-4151-8b46-6c0dfa7856ba None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:30.250257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4bc04-3b73-4b40-8abb-becd858fc434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:30.251246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4bc04-3b73-4b40-8abb-becd858fc434 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:30.251525 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4bc04-3b73-4b40-8abb-becd858fc434 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:30.251795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf4bc04-3b73-4b40-8abb-becd858fc434 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:30.263421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf4bc04-3b73-4b40-8abb-becd858fc434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7cf4bc04-3b73-4b40-8abb-becd858fc434 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:30.272079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:30.273230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:30.274118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:30.274118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:30.274118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:30.274118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:30.274118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:30.274118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:30.274118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:30.274118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:30.274118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:30.274118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:30.274118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:30.274118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:30.274118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 266/560] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:30.274834 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4bc04-3b73-4b40-8abb-becd858fc434 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:30.283816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a562a6-ae11-411b-b77d-d9bacac0d88e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:30.325270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cf12d-53e7-43b3-b3a6-46c60f2922ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:30.326387 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cf12d-53e7-43b3-b3a6-46c60f2922ca None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:30.326667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cf12d-53e7-43b3-b3a6-46c60f2922ca None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:30.326972 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cf12d-53e7-43b3-b3a6-46c60f2922ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:30.337767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cf12d-53e7-43b3-b3a6-46c60f2922ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:30.339452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00cf12d-53e7-43b3-b3a6-46c60f2922ca None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:30.351337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:30.360664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e00cf12d-53e7-43b3-b3a6-46c60f2922ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:30.360664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:30.360664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:30.360664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:30.360664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:30.360664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:30.360664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:30.360664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:30.360664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:30.360664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:30.360664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:30.360664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:30.360664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:30.360664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:30.360664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:30.361580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:30.362596 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:30.362596 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:30.362596 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:30.362596 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:30.362596 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 295/561] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:30.363453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f760a6-12fd-4b29-a0e1-89f0192be2bc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:30.363573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f760a6-12fd-4b29-a0e1-89f0192be2bc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:30.363766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f760a6-12fd-4b29-a0e1-89f0192be2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:30.381322 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d2f760a6-12fd-4b29-a0e1-89f0192be2bc None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:30.382523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d2f760a6-12fd-4b29-a0e1-89f0192be2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:30.396443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:30.401788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf4bc04-3b73-4b40-8abb-becd858fc434 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:30.438633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee7a5e-6860-4be3-a932-46d0e34558ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:30.439311 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee7a5e-6860-4be3-a932-46d0e34558ce None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:30.439532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee7a5e-6860-4be3-a932-46d0e34558ce None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:30.439804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee7a5e-6860-4be3-a932-46d0e34558ce None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:30.440739 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee7a5e-6860-4be3-a932-46d0e34558ce None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:30.441046 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee7a5e-6860-4be3-a932-46d0e34558ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:30.442506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee7a5e-6860-4be3-a932-46d0e34558ce None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:30.459186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 296/562] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:30.460402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 267/563] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 21 15:52:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:30.460682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f760a6-12fd-4b29-a0e1-89f0192be2bc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:30.461265 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee7a5e-6860-4be3-a932-46d0e34558ce None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:30.570317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee7a5e-6860-4be3-a932-46d0e34558ce None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:30.573202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f760a6-12fd-4b29-a0e1-89f0192be2bc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:30.589665 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:30.608105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4930ac6-b646-417f-9eb5-5b02db7c68f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:30.608767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4930ac6-b646-417f-9eb5-5b02db7c68f0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:30.609047 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4930ac6-b646-417f-9eb5-5b02db7c68f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:30.609314 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4930ac6-b646-417f-9eb5-5b02db7c68f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:30.610046 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4930ac6-b646-417f-9eb5-5b02db7c68f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:30.610351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4930ac6-b646-417f-9eb5-5b02db7c68f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:30.611801 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4930ac6-b646-417f-9eb5-5b02db7c68f0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:30.612684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcd063-3d21-46eb-aaef-4faddb3b2e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:30.613521 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcd063-3d21-46eb-aaef-4faddb3b2e06 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:30.613949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcd063-3d21-46eb-aaef-4faddb3b2e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:30.614393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcd063-3d21-46eb-aaef-4faddb3b2e06 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:30.615577 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcd063-3d21-46eb-aaef-4faddb3b2e06 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:30.615893 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcd063-3d21-46eb-aaef-4faddb3b2e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:30.617285 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcd063-3d21-46eb-aaef-4faddb3b2e06 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:30.624098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 268/564] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:30.624959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4930ac6-b646-417f-9eb5-5b02db7c68f0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:30.631214 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 297/565] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:30.632303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcd063-3d21-46eb-aaef-4faddb3b2e06 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:30.650185 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:30.737224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4930ac6-b646-417f-9eb5-5b02db7c68f0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:30.747099 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcd063-3d21-46eb-aaef-4faddb3b2e06 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:30.774856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fbe7e-c588-449a-95f8-914b7b73fa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:30.775525 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fbe7e-c588-449a-95f8-914b7b73fa92 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:30.775803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fbe7e-c588-449a-95f8-914b7b73fa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:30.776078 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fbe7e-c588-449a-95f8-914b7b73fa92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:30.785249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5658cc-69e0-4276-9df5-2dfa09181c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:30.786329 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5658cc-69e0-4276-9df5-2dfa09181c97 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:30.787153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5658cc-69e0-4276-9df5-2dfa09181c97 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:30.787632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5658cc-69e0-4276-9df5-2dfa09181c97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:30.799820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5658cc-69e0-4276-9df5-2dfa09181c97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2e5658cc-69e0-4276-9df5-2dfa09181c97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:30.807606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:30.808534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:30.809400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:30.809400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:30.809400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:30.809400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:30.809400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:30.809400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:30.809400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:30.809400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:30.809400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:30.809400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:30.809400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:30.809400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:30.809400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 298/566] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:30.810085 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5658cc-69e0-4276-9df5-2dfa09181c97 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:30.830848 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:30.859165 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fbe7e-c588-449a-95f8-914b7b73fa92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:30.860651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fbe7e-c588-449a-95f8-914b7b73fa92 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:30.880314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:30.915481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5658cc-69e0-4276-9df5-2dfa09181c97 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:30.950360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79891a1c-9f73-40cf-a6a4-7b4b6d19e805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:30.951350 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79891a1c-9f73-40cf-a6a4-7b4b6d19e805 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:30.951638 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79891a1c-9f73-40cf-a6a4-7b4b6d19e805 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:30.951918 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79891a1c-9f73-40cf-a6a4-7b4b6d19e805 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:30.959233 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79891a1c-9f73-40cf-a6a4-7b4b6d19e805 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:30.960707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79891a1c-9f73-40cf-a6a4-7b4b6d19e805 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:30.970257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 269/567] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:30.971137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fbe7e-c588-449a-95f8-914b7b73fa92 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:30.975895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-79891a1c-9f73-40cf-a6a4-7b4b6d19e805 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:30.975895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:30.975895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:30.975895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:30.975895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:30.975895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:30.975895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:30.975895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:30.975895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:30.975895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:30.975895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:30.975895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:30.975895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:30.975895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:30.975895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:30.976813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:30.977704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:30.977704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:30.977704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:30.977704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:30.977704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:30.977704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:30.977704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:30.977704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:30.977704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 299/568] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:30.978183 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79891a1c-9f73-40cf-a6a4-7b4b6d19e805 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:31.050692 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:31.073537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fbe7e-c588-449a-95f8-914b7b73fa92 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:31.080238 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79891a1c-9f73-40cf-a6a4-7b4b6d19e805 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:31.106906 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:31.107432 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0741cf-643c-4109-85ee-92f6e7570c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:31.108242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0741cf-643c-4109-85ee-92f6e7570c8e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:31.108522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0741cf-643c-4109-85ee-92f6e7570c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:31.108828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0741cf-643c-4109-85ee-92f6e7570c8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:31.115705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c196bd-5d1c-4fd4-a89a-b1eb6efda76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:31.116383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c196bd-5d1c-4fd4-a89a-b1eb6efda76f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:31.116663 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c196bd-5d1c-4fd4-a89a-b1eb6efda76f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:31.116935 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c196bd-5d1c-4fd4-a89a-b1eb6efda76f None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:31.117690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c196bd-5d1c-4fd4-a89a-b1eb6efda76f None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:31.118013 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c196bd-5d1c-4fd4-a89a-b1eb6efda76f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:31.119431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c196bd-5d1c-4fd4-a89a-b1eb6efda76f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:31.119618 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0741cf-643c-4109-85ee-92f6e7570c8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:31.121062 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0741cf-643c-4109-85ee-92f6e7570c8e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:31.127540 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 300/569] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:31.128862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d48ed-11b9-4fa9-b1e1-54e7fd570379 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:31.129153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d48ed-11b9-4fa9-b1e1-54e7fd570379 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:31.129431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d48ed-11b9-4fa9-b1e1-54e7fd570379 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:31.130666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 301/570] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:31.131403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d48ed-11b9-4fa9-b1e1-54e7fd570379 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:31.143648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-eb0741cf-643c-4109-85ee-92f6e7570c8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:31.143648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:31.143648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:31.143648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:31.143648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:31.143648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:31.143648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:31.143648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:31.143648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:31.143648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:31.143648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:31.143648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:31.143648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:31.143648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:31.143648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:31.144713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:31.145821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:31.145821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:31.145821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:31.145821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:31.145821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 270/571] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:31.146216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0741cf-643c-4109-85ee-92f6e7570c8e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:31.242933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d48ed-11b9-4fa9-b1e1-54e7fd570379 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:31.252411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0741cf-643c-4109-85ee-92f6e7570c8e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:31.276097 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5ea362-b631-4574-b78f-a03d70ad917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:31.276915 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ea362-b631-4574-b78f-a03d70ad917b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:31.277202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ea362-b631-4574-b78f-a03d70ad917b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:31.277481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5ea362-b631-4574-b78f-a03d70ad917b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:31.282059 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:31.288834 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895984c-0ac6-49d1-ada7-26288923b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:31.289000 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ea362-b631-4574-b78f-a03d70ad917b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:31.289504 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895984c-0ac6-49d1-ada7-26288923b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:31.289787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895984c-0ac6-49d1-ada7-26288923b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:31.290062 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895984c-0ac6-49d1-ada7-26288923b0a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:31.290645 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5ea362-b631-4574-b78f-a03d70ad917b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:31.290884 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895984c-0ac6-49d1-ada7-26288923b0a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:31.291216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895984c-0ac6-49d1-ada7-26288923b0a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:31.292651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895984c-0ac6-49d1-ada7-26288923b0a2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:31.304767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 271/572] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:31.305495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895984c-0ac6-49d1-ada7-26288923b0a2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:31.308766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-8f5ea362-b631-4574-b78f-a03d70ad917b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:31.308766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:31.308766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:31.308766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:31.308766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:31.308766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:31.308766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:31.308766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:31.308766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:31.308766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:31.308766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:31.308766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:31.308766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:31.308766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:31.308766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:31.309757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:31.310668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:31.310668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:31.310668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:31.310668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:31.310668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 302/573] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:31.311675 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c32be-f5c6-4e0e-b3f7-d1a25f9b44c8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:31.311967 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c32be-f5c6-4e0e-b3f7-d1a25f9b44c8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:31.312246 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c32be-f5c6-4e0e-b3f7-d1a25f9b44c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:31.330299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-288c32be-f5c6-4e0e-b3f7-d1a25f9b44c8 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:31.331556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-288c32be-f5c6-4e0e-b3f7-d1a25f9b44c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:31.367991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:31.402561 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 303/574] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:31.403485 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c32be-f5c6-4e0e-b3f7-d1a25f9b44c8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:31.414234 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895984c-0ac6-49d1-ada7-26288923b0a2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:31.452050 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3139ac-ac82-4fc0-920f-6cd8ad4e1fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:31.452848 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3139ac-ac82-4fc0-920f-6cd8ad4e1fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:31.453134 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3139ac-ac82-4fc0-920f-6cd8ad4e1fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:31.453412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3139ac-ac82-4fc0-920f-6cd8ad4e1fe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:31.464385 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3139ac-ac82-4fc0-920f-6cd8ad4e1fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:31.465897 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3139ac-ac82-4fc0-920f-6cd8ad4e1fe5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:31.483586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0f3139ac-ac82-4fc0-920f-6cd8ad4e1fe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:31.483586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:31.483586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:31.483586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:31.483586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:31.483586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:31.483586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:31.483586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:31.483586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:31.483586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:31.483586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:31.483586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:31.483586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:31.483586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:31.483586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:31.484611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:31.485537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:31.485537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:31.485537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:31.485537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:31.485537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 272/575] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:31.485845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3139ac-ac82-4fc0-920f-6cd8ad4e1fe5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:31.511962 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c32be-f5c6-4e0e-b3f7-d1a25f9b44c8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:31.532576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:31.547097 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6006f5-7baa-4b40-9eeb-2edc4ac52039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:31.547777 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6006f5-7baa-4b40-9eeb-2edc4ac52039 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:31.548063 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6006f5-7baa-4b40-9eeb-2edc4ac52039 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:31.548343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6006f5-7baa-4b40-9eeb-2edc4ac52039 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:31.549077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6006f5-7baa-4b40-9eeb-2edc4ac52039 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:31.549389 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6006f5-7baa-4b40-9eeb-2edc4ac52039 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:31.550884 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6006f5-7baa-4b40-9eeb-2edc4ac52039 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:31.562477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 304/576] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:31.563265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6006f5-7baa-4b40-9eeb-2edc4ac52039 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:31.592164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3139ac-ac82-4fc0-920f-6cd8ad4e1fe5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:31.597992 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:31.627490 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364ee9e-ab6c-4ec8-a73c-ceae5874af2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:31.628429 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364ee9e-ab6c-4ec8-a73c-ceae5874af2f None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:31.628706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364ee9e-ab6c-4ec8-a73c-ceae5874af2f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:31.628974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364ee9e-ab6c-4ec8-a73c-ceae5874af2f None admin] PATH_INFO: `/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/e9a1ec1f6bb7467dbd63ad1da36d48a9/roles/ae7cbb39ab61467ba1976a753ba6693c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:31.644066 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364ee9e-ab6c-4ec8-a73c-ceae5874af2f None admin] RBAC: Authorizing `identity:create_grant(project_id=0d717ed2993d4a3ab21195028a16e747, user_id=e9a1ec1f6bb7467dbd63ad1da36d48a9, role_id=ae7cbb39ab61467ba1976a753ba6693c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:31.645596 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364ee9e-ab6c-4ec8-a73c-ceae5874af2f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:31.658756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 273/577] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:52:31 2022] PUT /identity/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/e9a1ec1f6bb7467dbd63ad1da36d48a9/roles/ae7cbb39ab61467ba1976a753ba6693c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:52:31.659645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364ee9e-ab6c-4ec8-a73c-ceae5874af2f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:31.674482 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6006f5-7baa-4b40-9eeb-2edc4ac52039 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:31.713729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441c49c-eaf4-49f7-9bc6-a8a49b6194cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:31.714433 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441c49c-eaf4-49f7-9bc6-a8a49b6194cb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:31.714722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441c49c-eaf4-49f7-9bc6-a8a49b6194cb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:31.715041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441c49c-eaf4-49f7-9bc6-a8a49b6194cb None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:31.715801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441c49c-eaf4-49f7-9bc6-a8a49b6194cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:31.716124 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441c49c-eaf4-49f7-9bc6-a8a49b6194cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:31.717580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441c49c-eaf4-49f7-9bc6-a8a49b6194cb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:31.736756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 305/578] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:31.736756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441c49c-eaf4-49f7-9bc6-a8a49b6194cb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:31.769825 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:31.780604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364ee9e-ab6c-4ec8-a73c-ceae5874af2f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:31.820158 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209640e5-4f38-4ffb-ab1d-5adc4e21b799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:31.821254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209640e5-4f38-4ffb-ab1d-5adc4e21b799 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:31.822310 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209640e5-4f38-4ffb-ab1d-5adc4e21b799 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:31.822773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209640e5-4f38-4ffb-ab1d-5adc4e21b799 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:31.841052 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209640e5-4f38-4ffb-ab1d-5adc4e21b799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-209640e5-4f38-4ffb-ab1d-5adc4e21b799 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:31.849254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:31.850453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:31.851517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:31.851517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:31.851517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:31.851517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:31.851517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:31.851517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:31.851517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:31.851517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:31.851517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:31.851517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:31.851517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:31.851517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:31.851517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 274/579] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:31.851517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209640e5-4f38-4ffb-ab1d-5adc4e21b799 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:31.858384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:31.871155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441c49c-eaf4-49f7-9bc6-a8a49b6194cb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:31.907872 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83146d4-8bd1-4a26-8020-c78b23b57a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:31.908570 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83146d4-8bd1-4a26-8020-c78b23b57a0c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:31.908850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83146d4-8bd1-4a26-8020-c78b23b57a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:31.909130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83146d4-8bd1-4a26-8020-c78b23b57a0c None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:31.910001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83146d4-8bd1-4a26-8020-c78b23b57a0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:31.910781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83146d4-8bd1-4a26-8020-c78b23b57a0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:31.912230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83146d4-8bd1-4a26-8020-c78b23b57a0c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:31.928765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 306/580] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:31.928765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83146d4-8bd1-4a26-8020-c78b23b57a0c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:31.968786 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209640e5-4f38-4ffb-ab1d-5adc4e21b799 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:32.009822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23de27-539f-4c34-a4e7-0a8c47a6a84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:32.011041 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23de27-539f-4c34-a4e7-0a8c47a6a84c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:32.011329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23de27-539f-4c34-a4e7-0a8c47a6a84c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:32.011918 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23de27-539f-4c34-a4e7-0a8c47a6a84c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:32.021157 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23de27-539f-4c34-a4e7-0a8c47a6a84c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:32.022644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23de27-539f-4c34-a4e7-0a8c47a6a84c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:32.035982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83146d4-8bd1-4a26-8020-c78b23b57a0c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4e23de27-539f-4c34-a4e7-0a8c47a6a84c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:32.039102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:32.040079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:32.041574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:32.041574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:32.041574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:32.041574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:32.041574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:32.041574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:32.041574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:32.041574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:32.041574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 15:52:32.041574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:32.044613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 275/581] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:32.045267 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23de27-539f-4c34-a4e7-0a8c47a6a84c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:32.061441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:32.073132 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1117d71-0e45-4129-9358-93509e1faa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:32.073962 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1117d71-0e45-4129-9358-93509e1faa0b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:32.074253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1117d71-0e45-4129-9358-93509e1faa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:32.074528 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1117d71-0e45-4129-9358-93509e1faa0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:32.082240 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1117d71-0e45-4129-9358-93509e1faa0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:32.083761 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1117d71-0e45-4129-9358-93509e1faa0b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:32.098669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a1117d71-0e45-4129-9358-93509e1faa0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:32.098669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:32.098669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:32.098669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:32.098669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:32.098669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:32.098669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:32.098669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:32.098669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:32.098669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:32.098669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:32.098669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:32.098669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:32.098669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:32.098669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:32.099880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:32.101309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:32.101309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:32.101309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:32.101309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:32.101309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:32.101309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:32.101309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:32.101309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:32.101309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 307/582] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:32.101309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1117d71-0e45-4129-9358-93509e1faa0b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:32.119082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:32.158870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23de27-539f-4c34-a4e7-0a8c47a6a84c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:32.202353 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc9be9-2dfd-4cf8-8b83-33a0e9cb5556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:32.203158 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc9be9-2dfd-4cf8-8b83-33a0e9cb5556 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:32.203515 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc9be9-2dfd-4cf8-8b83-33a0e9cb5556 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:32.203863 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc9be9-2dfd-4cf8-8b83-33a0e9cb5556 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:32.204734 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc9be9-2dfd-4cf8-8b83-33a0e9cb5556 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:32.205010 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc9be9-2dfd-4cf8-8b83-33a0e9cb5556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:32.206510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc9be9-2dfd-4cf8-8b83-33a0e9cb5556 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:32.219629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 276/583] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:32.219629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc9be9-2dfd-4cf8-8b83-33a0e9cb5556 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:32.222032 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1117d71-0e45-4129-9358-93509e1faa0b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:32.259753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18b338-7939-4c65-85c7-1598353e96fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:32.260609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18b338-7939-4c65-85c7-1598353e96fd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:32.260891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18b338-7939-4c65-85c7-1598353e96fd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:32.261171 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18b338-7939-4c65-85c7-1598353e96fd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:32.269683 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18b338-7939-4c65-85c7-1598353e96fd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:32.271196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18b338-7939-4c65-85c7-1598353e96fd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ec18b338-7939-4c65-85c7-1598353e96fd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:32.286475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:32.287714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:32.288670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:32.288670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:32.288670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:32.288670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:32.288670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:32.288670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:32.288670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:32.288670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:32.288670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 15:52:32.288670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:32.288670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 308/584] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:32.288670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18b338-7939-4c65-85c7-1598353e96fd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:32.308623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:32.337870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc9be9-2dfd-4cf8-8b83-33a0e9cb5556 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:32.372170 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:32.388625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcff6d9-e5e1-4779-a65d-9ad7ec7eefa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:32.389539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcff6d9-e5e1-4779-a65d-9ad7ec7eefa9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:32.389651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcff6d9-e5e1-4779-a65d-9ad7ec7eefa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:32.389936 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcff6d9-e5e1-4779-a65d-9ad7ec7eefa9 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:32.390802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcff6d9-e5e1-4779-a65d-9ad7ec7eefa9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:32.391141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcff6d9-e5e1-4779-a65d-9ad7ec7eefa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:32.392606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcff6d9-e5e1-4779-a65d-9ad7ec7eefa9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:32.406983 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18b338-7939-4c65-85c7-1598353e96fd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:32.416967 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 277/585] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 21 15:52:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:32.416967 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcff6d9-e5e1-4779-a65d-9ad7ec7eefa9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:32.445902 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabec54c-aee7-444a-bf8f-15df76741741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:32.446570 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabec54c-aee7-444a-bf8f-15df76741741 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:32.446844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabec54c-aee7-444a-bf8f-15df76741741 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:32.447165 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabec54c-aee7-444a-bf8f-15df76741741 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:32.447961 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabec54c-aee7-444a-bf8f-15df76741741 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:32.448236 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabec54c-aee7-444a-bf8f-15df76741741 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:32.449827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabec54c-aee7-444a-bf8f-15df76741741 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:32.462278 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 309/586] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:32.463035 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabec54c-aee7-444a-bf8f-15df76741741 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:32.534547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcff6d9-e5e1-4779-a65d-9ad7ec7eefa9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:32.565468 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:32.569566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabec54c-aee7-444a-bf8f-15df76741741 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:32.571443 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b696f-4df5-467b-a79e-d2e81d4cd4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:32.572251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b696f-4df5-467b-a79e-d2e81d4cd4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:32.572848 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b696f-4df5-467b-a79e-d2e81d4cd4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:32.572848 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b696f-4df5-467b-a79e-d2e81d4cd4e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:32.583573 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b696f-4df5-467b-a79e-d2e81d4cd4e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:32.585029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b696f-4df5-467b-a79e-d2e81d4cd4e4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:32.601308 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:32.602948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b56b696f-4df5-467b-a79e-d2e81d4cd4e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:32.602948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:32.602948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:32.602948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:32.602948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:32.602948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:32.602948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:32.602948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:32.602948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:32.602948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:32.602948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:32.602948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:32.602948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:32.602948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:32.602948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:32.603898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:32.604788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:32.604788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:32.604788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:32.604788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:32.604788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 278/587] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:32.605074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b696f-4df5-467b-a79e-d2e81d4cd4e4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:32.617267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e76d0-e06a-496e-84bf-cf6e3532f9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:32.618069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e76d0-e06a-496e-84bf-cf6e3532f9aa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:32.618390 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e76d0-e06a-496e-84bf-cf6e3532f9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:32.618672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e76d0-e06a-496e-84bf-cf6e3532f9aa None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:32.619545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e76d0-e06a-496e-84bf-cf6e3532f9aa None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:32.619881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e76d0-e06a-496e-84bf-cf6e3532f9aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:32.624516 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e76d0-e06a-496e-84bf-cf6e3532f9aa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:32.644303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 310/588] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 21 15:52:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:32.645116 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e76d0-e06a-496e-84bf-cf6e3532f9aa None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:32.732508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b696f-4df5-467b-a79e-d2e81d4cd4e4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:32.751830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e76d0-e06a-496e-84bf-cf6e3532f9aa None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:32.768214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cba457-dbd5-47a2-8f9b-ce6dc6cbd692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:32.769091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cba457-dbd5-47a2-8f9b-ce6dc6cbd692 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:32.769369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cba457-dbd5-47a2-8f9b-ce6dc6cbd692 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:32.769643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cba457-dbd5-47a2-8f9b-ce6dc6cbd692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:32.781333 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cba457-dbd5-47a2-8f9b-ce6dc6cbd692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:32.782865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cba457-dbd5-47a2-8f9b-ce6dc6cbd692 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:32.792313 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d5bcd-515b-44fd-9597-491fff2867bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:32.792999 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d5bcd-515b-44fd-9597-491fff2867bb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:32.793286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d5bcd-515b-44fd-9597-491fff2867bb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:32.793563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d5bcd-515b-44fd-9597-491fff2867bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:32.794412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d5bcd-515b-44fd-9597-491fff2867bb None admin] RBAC: Adding query filter params (role.id=ae7cbb39ab61467ba1976a753ba6693c, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=dcee349bdb2640609cc71fb1c65794f1) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:32.794730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d5bcd-515b-44fd-9597-491fff2867bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:32.796230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d5bcd-515b-44fd-9597-491fff2867bb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:32.808271 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 311/589] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:52:32 2022] GET /identity/v3/role_assignments?user.id=dcee349bdb2640609cc71fb1c65794f1&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=ae7cbb39ab61467ba1976a753ba6693c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:32.808465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e5cba457-dbd5-47a2-8f9b-ce6dc6cbd692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:32.808465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:32.808465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:32.808465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:32.808465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:32.808465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:32.808465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:32.808465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:32.808465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:32.808465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:32.808465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:32.808465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:32.808465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:32.808465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:32.808465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:32.809416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:32.810318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:32.810318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:32.810318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:32.810318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:32.810540 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d5bcd-515b-44fd-9597-491fff2867bb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:32.810623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 279/590] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:32.810623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cba457-dbd5-47a2-8f9b-ce6dc6cbd692 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:32.858299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:32.899306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:32.936614 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cba457-dbd5-47a2-8f9b-ce6dc6cbd692 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:32.971293 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d5bcd-515b-44fd-9597-491fff2867bb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:32.988288 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3f412-a9c5-4695-87ea-844a51bbe6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:32.990774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3f412-a9c5-4695-87ea-844a51bbe6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:32.990774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3f412-a9c5-4695-87ea-844a51bbe6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:32.990774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3f412-a9c5-4695-87ea-844a51bbe6c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:33.003620 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3f412-a9c5-4695-87ea-844a51bbe6c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:33.005570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3f412-a9c5-4695-87ea-844a51bbe6c5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:33.015394 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196dc09-e30d-4023-9111-9e5b9f540c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:33.016192 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196dc09-e30d-4023-9111-9e5b9f540c2d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:33.016480 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196dc09-e30d-4023-9111-9e5b9f540c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:33.016759 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196dc09-e30d-4023-9111-9e5b9f540c2d None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:33.017502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196dc09-e30d-4023-9111-9e5b9f540c2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:33.017815 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196dc09-e30d-4023-9111-9e5b9f540c2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:33.019354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196dc09-e30d-4023-9111-9e5b9f540c2d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:33.026629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d9b3f412-a9c5-4695-87ea-844a51bbe6c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:33.026629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:33.026629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:33.026629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:33.026629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:33.026629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:33.026629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:33.026629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:33.026629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:33.026629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:33.026629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:33.026629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:33.026629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:33.026629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:33.026629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:33.027635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:33.029177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:33.029177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:33.029177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:33.029177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:33.029177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 280/591] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:33.029930 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3f412-a9c5-4695-87ea-844a51bbe6c5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:33.036996 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 312/592] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:33.037871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196dc09-e30d-4023-9111-9e5b9f540c2d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:33.142361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:33.159143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3f412-a9c5-4695-87ea-844a51bbe6c5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:33.161130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196dc09-e30d-4023-9111-9e5b9f540c2d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:33.184240 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:33.209857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd717024-8aaf-4874-b9fa-0ce9aee124c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:33.210548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd717024-8aaf-4874-b9fa-0ce9aee124c5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:33.210867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd717024-8aaf-4874-b9fa-0ce9aee124c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:33.211449 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd717024-8aaf-4874-b9fa-0ce9aee124c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:33.212009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd717024-8aaf-4874-b9fa-0ce9aee124c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:33.212404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd717024-8aaf-4874-b9fa-0ce9aee124c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:33.213829 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd717024-8aaf-4874-b9fa-0ce9aee124c5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:33.217712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f8533-bba8-4f1f-b634-a1900c8ed2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:33.218704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f8533-bba8-4f1f-b634-a1900c8ed2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:33.219206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f8533-bba8-4f1f-b634-a1900c8ed2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:33.219672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712f8533-bba8-4f1f-b634-a1900c8ed2a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:33.220602 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f8533-bba8-4f1f-b634-a1900c8ed2a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:33.221692 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f8533-bba8-4f1f-b634-a1900c8ed2a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:33.223896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712f8533-bba8-4f1f-b634-a1900c8ed2a9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:33.231159 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 281/593] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:33.232106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd717024-8aaf-4874-b9fa-0ce9aee124c5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:33.239525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 313/594] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:33.241047 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f8533-bba8-4f1f-b634-a1900c8ed2a9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:33.346552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712f8533-bba8-4f1f-b634-a1900c8ed2a9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:33.355721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd717024-8aaf-4874-b9fa-0ce9aee124c5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:33.385186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f6a38-96b3-4512-963e-e509a3219630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:33.386754 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f6a38-96b3-4512-963e-e509a3219630 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:33.387345 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f6a38-96b3-4512-963e-e509a3219630 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:33.387902 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8f6a38-96b3-4512-963e-e509a3219630 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:33.397239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f6a38-96b3-4512-963e-e509a3219630 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:33.398522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d8ba8-8793-406e-81a2-51f611d21c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:33.399143 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8f6a38-96b3-4512-963e-e509a3219630 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:33.399593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d8ba8-8793-406e-81a2-51f611d21c5b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:33.399975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d8ba8-8793-406e-81a2-51f611d21c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:33.400353 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d8ba8-8793-406e-81a2-51f611d21c5b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:33.409728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d8ba8-8793-406e-81a2-51f611d21c5b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:33.411376 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6d8ba8-8793-406e-81a2-51f611d21c5b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:33.416580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2a8f6a38-96b3-4512-963e-e509a3219630 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:33.416580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:33.416580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:33.416580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:33.416580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:33.416580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:33.416580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:33.416580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:33.416580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:33.416580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:33.416580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:33.416580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:33.416580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:33.416580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:33.416580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:33.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:33.418722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:33.418722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:33.418722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:33.418722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:33.418722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:33.418722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:33.418722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:33.418722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:33.421229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 314/595] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:33.422262 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f6a38-96b3-4512-963e-e509a3219630 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-bb6d8ba8-8793-406e-81a2-51f611d21c5b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:33.436354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:33.437492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:33.438654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:33.438654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:33.438654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:33.438654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:33.438654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:33.438654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:33.438654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:33.438654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:33.438654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 15:52:33.438654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:33.440998 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 282/596] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:33.442220 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d8ba8-8793-406e-81a2-51f611d21c5b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:33.463213 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:33.468096 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:33.541872 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8f6a38-96b3-4512-963e-e509a3219630 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:33.559783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6d8ba8-8793-406e-81a2-51f611d21c5b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:33.580804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f8c3b-ebb5-4963-8848-4849eaf0fbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:33.581835 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f8c3b-ebb5-4963-8848-4849eaf0fbfb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:33.582223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f8c3b-ebb5-4963-8848-4849eaf0fbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:33.582608 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f8c3b-ebb5-4963-8848-4849eaf0fbfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:33.590782 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f8c3b-ebb5-4963-8848-4849eaf0fbfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:33.592430 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f8c3b-ebb5-4963-8848-4849eaf0fbfb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:33.599006 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033845a9-ec9f-4c8b-a154-7ea1ccb54c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:33.599918 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033845a9-ec9f-4c8b-a154-7ea1ccb54c24 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:33.600356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033845a9-ec9f-4c8b-a154-7ea1ccb54c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:33.600783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033845a9-ec9f-4c8b-a154-7ea1ccb54c24 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:33.601745 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033845a9-ec9f-4c8b-a154-7ea1ccb54c24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:33.602192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033845a9-ec9f-4c8b-a154-7ea1ccb54c24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:33.603888 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033845a9-ec9f-4c8b-a154-7ea1ccb54c24 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:33.609195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a12f8c3b-ebb5-4963-8848-4849eaf0fbfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:33.609195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:33.609195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:33.609195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:33.609195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:33.609195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:33.609195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:33.609195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:33.609195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:33.609195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:33.609195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:33.609195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:33.609195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:33.609195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:33.609195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:33.610682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:33.611820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:33.611820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:33.611820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:33.611820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:33.611820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:33.611820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:33.611820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:33.611820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:33.618435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 315/597] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:33.619632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f8c3b-ebb5-4963-8848-4849eaf0fbfb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:33.622129 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 283/598] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:33.623328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033845a9-ec9f-4c8b-a154-7ea1ccb54c24 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:33.717024 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:33.723732 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:33.730722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f8c3b-ebb5-4963-8848-4849eaf0fbfb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:33.733402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033845a9-ec9f-4c8b-a154-7ea1ccb54c24 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:33.767000 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be6907-971b-4672-ae1c-a8af68cfed26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:33.768010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be6907-971b-4672-ae1c-a8af68cfed26 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:33.768549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be6907-971b-4672-ae1c-a8af68cfed26 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:33.768759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b02d2a-3af0-4706-9030-5c15e25ad2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:33.768878 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be6907-971b-4672-ae1c-a8af68cfed26 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:33.769577 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b02d2a-3af0-4706-9030-5c15e25ad2ba None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:33.769704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be6907-971b-4672-ae1c-a8af68cfed26 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:33.769886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b02d2a-3af0-4706-9030-5c15e25ad2ba None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:33.769992 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be6907-971b-4672-ae1c-a8af68cfed26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:33.770199 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b02d2a-3af0-4706-9030-5c15e25ad2ba None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:33.770935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b02d2a-3af0-4706-9030-5c15e25ad2ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:33.771226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b02d2a-3af0-4706-9030-5c15e25ad2ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:33.771521 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be6907-971b-4672-ae1c-a8af68cfed26 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:33.772626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b02d2a-3af0-4706-9030-5c15e25ad2ba None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:33.789494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 284/599] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:33.789494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b02d2a-3af0-4706-9030-5c15e25ad2ba None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:33.794516 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 316/600] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Jul 21 15:52:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:33.795922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124722b0-cafe-4eaf-968a-5c934375a479 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:33.796181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124722b0-cafe-4eaf-968a-5c934375a479 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:33.796490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124722b0-cafe-4eaf-968a-5c934375a479 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:33.797972 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 317/601] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:33.802571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124722b0-cafe-4eaf-968a-5c934375a479 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:33.897630 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b02d2a-3af0-4706-9030-5c15e25ad2ba None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:33.912673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124722b0-cafe-4eaf-968a-5c934375a479 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:33.926516 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:33.934636 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ba461-e2af-4014-a992-283d2eb3484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:33.935673 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ba461-e2af-4014-a992-283d2eb3484e None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:33.935949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ba461-e2af-4014-a992-283d2eb3484e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:33.936220 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ba461-e2af-4014-a992-283d2eb3484e None admin] PATH_INFO: `/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/1a3418c0b46c404c8ca445cce9db632d/roles/ae7cbb39ab61467ba1976a753ba6693c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:33.949326 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcf2b7-81ed-451e-85f9-f40776f6c067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:33.950234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcf2b7-81ed-451e-85f9-f40776f6c067 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:33.950522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcf2b7-81ed-451e-85f9-f40776f6c067 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:33.950848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcf2b7-81ed-451e-85f9-f40776f6c067 None admin] PATH_INFO: `/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/d8c629ecd4014e2b8051b853a0b4c18a/roles/ae7cbb39ab61467ba1976a753ba6693c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:33.952578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ba461-e2af-4014-a992-283d2eb3484e None admin] RBAC: Authorizing `identity:create_grant(project_id=0d717ed2993d4a3ab21195028a16e747, user_id=1a3418c0b46c404c8ca445cce9db632d, role_id=ae7cbb39ab61467ba1976a753ba6693c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:33.954014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ba461-e2af-4014-a992-283d2eb3484e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:33.974950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 285/602] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:52:33 2022] PUT /identity/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/1a3418c0b46c404c8ca445cce9db632d/roles/ae7cbb39ab61467ba1976a753ba6693c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:52:33.975150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbcf2b7-81ed-451e-85f9-f40776f6c067 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d717ed2993d4a3ab21195028a16e747, user_id=d8c629ecd4014e2b8051b853a0b4c18a, role_id=ae7cbb39ab61467ba1976a753ba6693c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:33.975274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ba461-e2af-4014-a992-283d2eb3484e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:33.975369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbcf2b7-81ed-451e-85f9-f40776f6c067 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:33.997639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 318/603] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:52:33 2022] PUT /identity/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/d8c629ecd4014e2b8051b853a0b4c18a/roles/ae7cbb39ab61467ba1976a753ba6693c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:52:34.000313 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fe615-ec5a-4142-ac6b-449eb4a2666c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:34.000690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fe615-ec5a-4142-ac6b-449eb4a2666c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:34.001043 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51fe615-ec5a-4142-ac6b-449eb4a2666c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:34.023908 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:34.028004 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f51fe615-ec5a-4142-ac6b-449eb4a2666c None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:34.029681 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f51fe615-ec5a-4142-ac6b-449eb4a2666c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:34.172992 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ba461-e2af-4014-a992-283d2eb3484e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:34.187195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 319/604] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:34.205417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fe615-ec5a-4142-ac6b-449eb4a2666c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:34.250180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a5ed5-de91-40cb-abcc-e091df1fa39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:34.251310 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a5ed5-de91-40cb-abcc-e091df1fa39d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:34.251697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a5ed5-de91-40cb-abcc-e091df1fa39d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:34.251979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a5ed5-de91-40cb-abcc-e091df1fa39d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:34.263418 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a5ed5-de91-40cb-abcc-e091df1fa39d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:34.265037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a5ed5-de91-40cb-abcc-e091df1fa39d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:34.286567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-295a5ed5-de91-40cb-abcc-e091df1fa39d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:34.286567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:34.286567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:34.286567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:34.286567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:34.286567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:34.286567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:34.286567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:34.286567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:34.286567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:34.286567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:34.286567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:34.286567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:34.286567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:34.286567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:34.287759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:34.288851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:34.288851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:34.288851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:34.288851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:34.288851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 286/605] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:34.295771 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a5ed5-de91-40cb-abcc-e091df1fa39d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:34.330027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51fe615-ec5a-4142-ac6b-449eb4a2666c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:34.336329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:34.367307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:34.374193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1206f-2e1a-4700-8de3-6f0649d2ba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:34.375069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1206f-2e1a-4700-8de3-6f0649d2ba59 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:34.375355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1206f-2e1a-4700-8de3-6f0649d2ba59 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:34.375633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1206f-2e1a-4700-8de3-6f0649d2ba59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:34.387429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1206f-2e1a-4700-8de3-6f0649d2ba59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-7cb1206f-2e1a-4700-8de3-6f0649d2ba59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:34.395711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:34.396684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:34.397545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:34.397545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:34.397545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:34.397545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:34.397545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:34.397545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:34.397545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:34.397545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:34.397545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:34.397545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:34.397545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:34.397545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:34.401903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 320/606] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:34.410859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1206f-2e1a-4700-8de3-6f0649d2ba59 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:34.453941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a5ed5-de91-40cb-abcc-e091df1fa39d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:34.507323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7450f1-0995-464b-842a-0bf9823993d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:34.507933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7450f1-0995-464b-842a-0bf9823993d5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:34.508217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7450f1-0995-464b-842a-0bf9823993d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:34.508498 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7450f1-0995-464b-842a-0bf9823993d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:34.509270 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7450f1-0995-464b-842a-0bf9823993d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:34.509584 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7450f1-0995-464b-842a-0bf9823993d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:34.513106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7450f1-0995-464b-842a-0bf9823993d5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:34.532258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 287/607] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:34.538016 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7450f1-0995-464b-842a-0bf9823993d5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:34.594018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1206f-2e1a-4700-8de3-6f0649d2ba59 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:34.638521 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:34.650857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7450f1-0995-464b-842a-0bf9823993d5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:34.668862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e1d49-a17c-46e9-81e3-7454865f10fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:34.669660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e1d49-a17c-46e9-81e3-7454865f10fd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:34.670016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e1d49-a17c-46e9-81e3-7454865f10fd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:34.670364 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e1d49-a17c-46e9-81e3-7454865f10fd None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:34.671247 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e1d49-a17c-46e9-81e3-7454865f10fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:34.671627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e1d49-a17c-46e9-81e3-7454865f10fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:34.673116 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e1d49-a17c-46e9-81e3-7454865f10fd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:34.694654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 321/608] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:34.696678 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e1d49-a17c-46e9-81e3-7454865f10fd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:34.735640 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8384c-1a1e-4709-af41-568e3b72ba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:34.736562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8384c-1a1e-4709-af41-568e3b72ba9a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:34.736857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8384c-1a1e-4709-af41-568e3b72ba9a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:34.737126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8384c-1a1e-4709-af41-568e3b72ba9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:34.756149 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8384c-1a1e-4709-af41-568e3b72ba9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:34.757583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8384c-1a1e-4709-af41-568e3b72ba9a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:34.779340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:34.791141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-58d8384c-1a1e-4709-af41-568e3b72ba9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:34.791141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:34.791141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:34.791141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:34.791141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:34.791141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:34.791141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:34.791141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:34.791141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:34.791141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:34.791141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:34.791141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:34.791141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:34.791141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:34.791141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:34.792227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:34.793131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:34.793131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:34.793131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:34.793131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:34.793131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:34.793131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:34.793131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:34.793131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:34.799397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 288/609] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:34.803837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8384c-1a1e-4709-af41-568e3b72ba9a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:34.831438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e1d49-a17c-46e9-81e3-7454865f10fd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:34.898955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f92458-3a4f-4a1f-b942-068956154a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:34.899802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f92458-3a4f-4a1f-b942-068956154a7b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:34.900082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f92458-3a4f-4a1f-b942-068956154a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:34.900358 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f92458-3a4f-4a1f-b942-068956154a7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:34.934600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f92458-3a4f-4a1f-b942-068956154a7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:34.936276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f92458-3a4f-4a1f-b942-068956154a7b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:34.960724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a5f92458-3a4f-4a1f-b942-068956154a7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:34.960724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:34.960724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:34.960724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:34.960724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:34.960724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:34.960724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:34.960724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:34.960724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:34.960724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:34.960724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:34.960724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:34.960724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:34.960724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:34.960724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:34.961709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:34.962609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:34.962609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:34.962609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:34.962609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:34.962609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 322/610] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:34.968191 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f92458-3a4f-4a1f-b942-068956154a7b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:35.061777 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8384c-1a1e-4709-af41-568e3b72ba9a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:35.092159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f92458-3a4f-4a1f-b942-068956154a7b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:35.102290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:35.125925 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97558dc9-41e0-403b-b1b8-4b7b4e2d765a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:35.126758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97558dc9-41e0-403b-b1b8-4b7b4e2d765a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:35.127171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97558dc9-41e0-403b-b1b8-4b7b4e2d765a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:35.127550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97558dc9-41e0-403b-b1b8-4b7b4e2d765a None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:35.128558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97558dc9-41e0-403b-b1b8-4b7b4e2d765a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:35.128981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97558dc9-41e0-403b-b1b8-4b7b4e2d765a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:35.130596 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97558dc9-41e0-403b-b1b8-4b7b4e2d765a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:35.149201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 289/611] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:35.156895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97558dc9-41e0-403b-b1b8-4b7b4e2d765a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:35.157744 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd3239-9b1e-47a1-9540-134793df0d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:35.158858 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd3239-9b1e-47a1-9540-134793df0d56 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:35.161778 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd3239-9b1e-47a1-9540-134793df0d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:35.162170 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd3239-9b1e-47a1-9540-134793df0d56 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:35.163078 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd3239-9b1e-47a1-9540-134793df0d56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:35.163496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd3239-9b1e-47a1-9540-134793df0d56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:35.165899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd3239-9b1e-47a1-9540-134793df0d56 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:35.177712 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:35.191196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 323/612] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:35.192899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18a85-9f33-40a9-955d-0c5dce4c31d8 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:35.193326 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18a85-9f33-40a9-955d-0c5dce4c31d8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:35.193736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18a85-9f33-40a9-955d-0c5dce4c31d8 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:35.200286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 324/613] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:35.202120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde417-909d-4116-9db3-88e7f0ea52a9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:35.202556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde417-909d-4116-9db3-88e7f0ea52a9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:35.203041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde417-909d-4116-9db3-88e7f0ea52a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:35.220031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6ccde417-909d-4116-9db3-88e7f0ea52a9 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:35.221598 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6ccde417-909d-4116-9db3-88e7f0ea52a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:35.289280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97558dc9-41e0-403b-b1b8-4b7b4e2d765a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:35.294257 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 325/614] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:52:35.295161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde417-909d-4116-9db3-88e7f0ea52a9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:35.327454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02213c-f369-40a3-8a86-460c5b006a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:35.328522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02213c-f369-40a3-8a86-460c5b006a59 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:35.328919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02213c-f369-40a3-8a86-460c5b006a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:35.329408 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02213c-f369-40a3-8a86-460c5b006a59 None admin] PATH_INFO: `/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/1b46a82ffe92437fb8205bd186a8b05e/roles/ae7cbb39ab61467ba1976a753ba6693c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:35.347521 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02213c-f369-40a3-8a86-460c5b006a59 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d717ed2993d4a3ab21195028a16e747, user_id=1b46a82ffe92437fb8205bd186a8b05e, role_id=ae7cbb39ab61467ba1976a753ba6693c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:35.349162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba02213c-f369-40a3-8a86-460c5b006a59 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:35.371302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 290/615] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:52:35 2022] PUT /identity/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/1b46a82ffe92437fb8205bd186a8b05e/roles/ae7cbb39ab61467ba1976a753ba6693c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:52:35.372366 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02213c-f369-40a3-8a86-460c5b006a59 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:35.422687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:35.430161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde417-909d-4116-9db3-88e7f0ea52a9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:35.448489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:35.473382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503f44d-e3fb-4dae-9844-b4422b605a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:35.474507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503f44d-e3fb-4dae-9844-b4422b605a59 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:35.474960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503f44d-e3fb-4dae-9844-b4422b605a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:35.475373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503f44d-e3fb-4dae-9844-b4422b605a59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:35.485163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503f44d-e3fb-4dae-9844-b4422b605a59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:35.487096 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503f44d-e3fb-4dae-9844-b4422b605a59 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:35.499174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba02213c-f369-40a3-8a86-460c5b006a59 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-4503f44d-e3fb-4dae-9844-b4422b605a59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:35.504304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:35.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:35.506508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:35.506508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:35.506508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:35.506508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:35.506508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:35.506508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:35.506508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:35.506508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:35.506508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:52:35.506508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:35.508932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 326/616] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 15:52:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:35.520607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503f44d-e3fb-4dae-9844-b4422b605a59 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:35.557167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed765a2-a647-4644-bc41-ca6b3805c9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:35.558058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed765a2-a647-4644-bc41-ca6b3805c9ad None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:35.558347 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed765a2-a647-4644-bc41-ca6b3805c9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:35.558622 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed765a2-a647-4644-bc41-ca6b3805c9ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:35.584184 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed765a2-a647-4644-bc41-ca6b3805c9ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7ed765a2-a647-4644-bc41-ca6b3805c9ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:35.603746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:35.604773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:35.605615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:35.605615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:35.605615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:35.605615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:35.605615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:35.605615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:35.605615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:35.605615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:35.605615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:35.605615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:35.605615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:35.605615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:35.605615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 291/617] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:35.611460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed765a2-a647-4644-bc41-ca6b3805c9ad None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:35.684777 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503f44d-e3fb-4dae-9844-b4422b605a59 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:35.727712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a07c91-2816-4b50-a9f8-b48a036b97a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:35.728754 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a07c91-2816-4b50-a9f8-b48a036b97a7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:35.729247 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a07c91-2816-4b50-a9f8-b48a036b97a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:35.729716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a07c91-2816-4b50-a9f8-b48a036b97a7 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:35.731869 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a07c91-2816-4b50-a9f8-b48a036b97a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:35.732468 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a07c91-2816-4b50-a9f8-b48a036b97a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:35.734204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a07c91-2816-4b50-a9f8-b48a036b97a7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:35.742863 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed765a2-a647-4644-bc41-ca6b3805c9ad None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:35.766190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 327/618] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 15:52:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:35.770158 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a07c91-2816-4b50-a9f8-b48a036b97a7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:35.779244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:35.807187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:35.811741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506ad13-98f8-4380-af4a-9edd0dd46d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:35.812448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506ad13-98f8-4380-af4a-9edd0dd46d90 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:35.812728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506ad13-98f8-4380-af4a-9edd0dd46d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:35.813006 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a506ad13-98f8-4380-af4a-9edd0dd46d90 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:35.813787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506ad13-98f8-4380-af4a-9edd0dd46d90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:35.814098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506ad13-98f8-4380-af4a-9edd0dd46d90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:35.815603 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a506ad13-98f8-4380-af4a-9edd0dd46d90 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:35.838328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 292/619] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:35.845052 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506ad13-98f8-4380-af4a-9edd0dd46d90 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:35.986203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a07c91-2816-4b50-a9f8-b48a036b97a7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:36.058630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3abb8b-3002-4fdb-90b2-4d49a4115cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:36.059725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3abb8b-3002-4fdb-90b2-4d49a4115cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:36.060231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3abb8b-3002-4fdb-90b2-4d49a4115cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:36.060718 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3abb8b-3002-4fdb-90b2-4d49a4115cf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:36.065771 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a506ad13-98f8-4380-af4a-9edd0dd46d90 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:36.138930 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed43c2-8ca1-4481-bf6b-2154aaafb1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:36.140138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed43c2-8ca1-4481-bf6b-2154aaafb1ed None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:36.140792 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed43c2-8ca1-4481-bf6b-2154aaafb1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:36.141363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed43c2-8ca1-4481-bf6b-2154aaafb1ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:36.161982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed43c2-8ca1-4481-bf6b-2154aaafb1ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:36.165145 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbed43c2-8ca1-4481-bf6b-2154aaafb1ed None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:36.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-cbed43c2-8ca1-4481-bf6b-2154aaafb1ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:36.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:36.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:36.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:36.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:36.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:36.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:36.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:36.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:36.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:36.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:36.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:36.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:36.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:36.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:36.209253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:36.210153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:36.210153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:36.210153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:36.210153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:36.220293 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3abb8b-3002-4fdb-90b2-4d49a4115cf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:36.222235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3abb8b-3002-4fdb-90b2-4d49a4115cf2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:36.222674 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 293/620] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:36.224934 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed43c2-8ca1-4481-bf6b-2154aaafb1ed None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:36.256702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:36.307217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:36.362507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 328/621] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:36.368848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3abb8b-3002-4fdb-90b2-4d49a4115cf2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:36.437669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed43c2-8ca1-4481-bf6b-2154aaafb1ed None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:36.474067 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3abb8b-3002-4fdb-90b2-4d49a4115cf2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:36.475109 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225c149-32ea-49e4-abb2-1b0aca6c423a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:36.475790 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225c149-32ea-49e4-abb2-1b0aca6c423a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:36.476073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225c149-32ea-49e4-abb2-1b0aca6c423a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:36.476348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225c149-32ea-49e4-abb2-1b0aca6c423a None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:36.477197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225c149-32ea-49e4-abb2-1b0aca6c423a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:36.477511 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225c149-32ea-49e4-abb2-1b0aca6c423a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:36.479074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225c149-32ea-49e4-abb2-1b0aca6c423a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:36.491691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:36.499882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 294/622] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:36.501428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba46619-a1c4-485d-a205-5f6f71cc1083 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:36.501724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba46619-a1c4-485d-a205-5f6f71cc1083 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:36.502011 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba46619-a1c4-485d-a205-5f6f71cc1083 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:36.507832 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 295/623] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:36.509019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba46619-a1c4-485d-a205-5f6f71cc1083 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:36.515472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212af9c-da10-404d-b447-74c09864b9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:36.516599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212af9c-da10-404d-b447-74c09864b9ad None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:36.517108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212af9c-da10-404d-b447-74c09864b9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:36.517633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212af9c-da10-404d-b447-74c09864b9ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:36.528880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212af9c-da10-404d-b447-74c09864b9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:36.530748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212af9c-da10-404d-b447-74c09864b9ad None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:36.549763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2212af9c-da10-404d-b447-74c09864b9ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:36.549763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:36.549763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:36.549763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:36.549763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:36.549763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:36.549763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:36.549763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:36.549763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:36.549763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:36.549763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:36.549763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:36.549763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:36.549763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:36.549763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:36.550923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:36.552069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:36.552069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:36.552069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:36.552069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:36.558073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 329/624] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:36.558073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a966e62-869d-4c81-a92e-6c024ed5d448 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:36.558073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a966e62-869d-4c81-a92e-6c024ed5d448 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:36.558073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a966e62-869d-4c81-a92e-6c024ed5d448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:36.575250 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3a966e62-869d-4c81-a92e-6c024ed5d448 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:36.576463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3a966e62-869d-4c81-a92e-6c024ed5d448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:36.610192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:36.620589 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba46619-a1c4-485d-a205-5f6f71cc1083 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:36.646875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 330/625] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:36.647411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b043-9b84-4eca-acfc-77e4c33fcf4a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:36.647711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b043-9b84-4eca-acfc-77e4c33fcf4a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:36.647990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b043-9b84-4eca-acfc-77e4c33fcf4a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:36.650946 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 331/626] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:36.650946 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111b043-9b84-4eca-acfc-77e4c33fcf4a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:36.668226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d19586-ebd6-4bb4-be62-a963d53a0c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:36.669203 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d19586-ebd6-4bb4-be62-a963d53a0c60 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:36.669597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d19586-ebd6-4bb4-be62-a963d53a0c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:36.669880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d19586-ebd6-4bb4-be62-a963d53a0c60 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:36.679230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d19586-ebd6-4bb4-be62-a963d53a0c60 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:36.680733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d19586-ebd6-4bb4-be62-a963d53a0c60 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b0d19586-ebd6-4bb4-be62-a963d53a0c60 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:36.697764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:36.698838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:36.700547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:36.700547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:36.700547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:36.700547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:36.700547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:36.700547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:36.700547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:36.700547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:36.700547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 15:52:36.700547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:36.700547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 296/627] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:52:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:36.700547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada3b6a-0557-4a99-bacd-4feb259fb9b3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:36.701249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada3b6a-0557-4a99-bacd-4feb259fb9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:36.701249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada3b6a-0557-4a99-bacd-4feb259fb9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:36.717853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-aada3b6a-0557-4a99-bacd-4feb259fb9b3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:36.719097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aada3b6a-0557-4a99-bacd-4feb259fb9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:36.762453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:36.770471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111b043-9b84-4eca-acfc-77e4c33fcf4a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:36.791143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 297/628] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:36.793387 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada3b6a-0557-4a99-bacd-4feb259fb9b3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:36.817420 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888220c-69e4-4251-b202-af71e4ec7570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:36.818180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888220c-69e4-4251-b202-af71e4ec7570 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:36.818544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888220c-69e4-4251-b202-af71e4ec7570 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:36.818843 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888220c-69e4-4251-b202-af71e4ec7570 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:36.819759 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888220c-69e4-4251-b202-af71e4ec7570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:36.820073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888220c-69e4-4251-b202-af71e4ec7570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:36.821602 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888220c-69e4-4251-b202-af71e4ec7570 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:36.838176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 332/629] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:36.838176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888220c-69e4-4251-b202-af71e4ec7570 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:36.899415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:36.917351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada3b6a-0557-4a99-bacd-4feb259fb9b3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:36.947110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888220c-69e4-4251-b202-af71e4ec7570 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:36.955359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4100adb-145c-4460-a072-6fd2bef9cfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:36.956247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4100adb-145c-4460-a072-6fd2bef9cfe7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:36.956531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4100adb-145c-4460-a072-6fd2bef9cfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:36.956806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4100adb-145c-4460-a072-6fd2bef9cfe7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:36.969353 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4100adb-145c-4460-a072-6fd2bef9cfe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f4100adb-145c-4460-a072-6fd2bef9cfe7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:36.980892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:36.981937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:36.982791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:36.982791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:36.982791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:36.982791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:36.982791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:36.982791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:36.982791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:36.982791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:36.982791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:36.982791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:36.982791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:36.982791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:36.982791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 298/630] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:36.984249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4100adb-145c-4460-a072-6fd2bef9cfe7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:36.992535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c3020-467a-4cdc-aef0-d2855e2eeffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:36.993235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c3020-467a-4cdc-aef0-d2855e2eeffa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:36.993520 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c3020-467a-4cdc-aef0-d2855e2eeffa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:36.993799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c3020-467a-4cdc-aef0-d2855e2eeffa None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:36.995141 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c3020-467a-4cdc-aef0-d2855e2eeffa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:36.995462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c3020-467a-4cdc-aef0-d2855e2eeffa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:36.997279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c3020-467a-4cdc-aef0-d2855e2eeffa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:37.015961 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 333/631] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 21 15:52:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:37.017105 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c3020-467a-4cdc-aef0-d2855e2eeffa None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:37.034467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:37.099926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4100adb-145c-4460-a072-6fd2bef9cfe7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:37.128320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c3020-467a-4cdc-aef0-d2855e2eeffa None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:37.138503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb469ef-2571-4e7a-945a-8350dcee18d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:37.139413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb469ef-2571-4e7a-945a-8350dcee18d3 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:37.140019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb469ef-2571-4e7a-945a-8350dcee18d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:37.140299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb469ef-2571-4e7a-945a-8350dcee18d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:37.152464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb469ef-2571-4e7a-945a-8350dcee18d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3fb469ef-2571-4e7a-945a-8350dcee18d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:37.160466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:37.161441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:37.162282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:37.162282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:37.162282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:37.162282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:37.162282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:37.162282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:37.162282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:37.162282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:37.162282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:37.162282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:37.162282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:37.162282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:37.162282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 299/632] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:37.163008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb469ef-2571-4e7a-945a-8350dcee18d3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:37.168471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:37.170489 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97b73f-65f8-4bcb-b18c-0d66b9de0cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:37.171381 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97b73f-65f8-4bcb-b18c-0d66b9de0cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:37.171668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97b73f-65f8-4bcb-b18c-0d66b9de0cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:37.171978 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97b73f-65f8-4bcb-b18c-0d66b9de0cb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:37.184124 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97b73f-65f8-4bcb-b18c-0d66b9de0cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:37.185605 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97b73f-65f8-4bcb-b18c-0d66b9de0cb4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:37.203539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-af97b73f-65f8-4bcb-b18c-0d66b9de0cb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:37.203539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:37.203539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:37.203539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:37.203539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:37.203539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:37.203539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:37.203539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:37.203539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:37.203539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:37.203539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:37.203539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:37.203539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:37.203539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:37.203539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:37.204458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:37.205451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:37.205451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:37.205451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:37.205451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:37.205451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:37.205451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:37.205451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:37.205451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:37.205451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 334/633] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:37.206029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97b73f-65f8-4bcb-b18c-0d66b9de0cb4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:37.283916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb469ef-2571-4e7a-945a-8350dcee18d3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:37.293950 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:37.321362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97b73f-65f8-4bcb-b18c-0d66b9de0cb4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:37.323296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a7953-2e36-4515-b38a-039b23323b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:37.323963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a7953-2e36-4515-b38a-039b23323b81 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:37.324248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a7953-2e36-4515-b38a-039b23323b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:37.324525 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a7953-2e36-4515-b38a-039b23323b81 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:37.325326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a7953-2e36-4515-b38a-039b23323b81 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:37.325627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a7953-2e36-4515-b38a-039b23323b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:37.327080 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a7953-2e36-4515-b38a-039b23323b81 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:37.336144 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 300/634] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:37.336993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a7953-2e36-4515-b38a-039b23323b81 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:37.363740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d6c29-a0d7-4722-a97c-13a6041ebaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:37.364525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d6c29-a0d7-4722-a97c-13a6041ebaaa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:37.364809 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d6c29-a0d7-4722-a97c-13a6041ebaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:37.365081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d6c29-a0d7-4722-a97c-13a6041ebaaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:37.376554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d6c29-a0d7-4722-a97c-13a6041ebaaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:37.378142 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d6c29-a0d7-4722-a97c-13a6041ebaaa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:37.396763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-5a6d6c29-a0d7-4722-a97c-13a6041ebaaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:37.396763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:37.396763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:37.396763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:37.396763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:37.396763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:37.396763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:37.396763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:37.396763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:37.396763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:37.396763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:37.396763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:37.396763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:37.396763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:37.396763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:37.397743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:37.398656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:37.398656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:37.398656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:37.398656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:37.398656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 335/635] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:37.399566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d6c29-a0d7-4722-a97c-13a6041ebaaa None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:37.411908 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:37.451569 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a7953-2e36-4515-b38a-039b23323b81 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:37.492928 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e07f38-67d2-4a92-a6f5-09e17253fadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:37.493586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e07f38-67d2-4a92-a6f5-09e17253fadc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:37.493871 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e07f38-67d2-4a92-a6f5-09e17253fadc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:37.494149 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e07f38-67d2-4a92-a6f5-09e17253fadc None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:37.494981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e07f38-67d2-4a92-a6f5-09e17253fadc None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:37.495295 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e07f38-67d2-4a92-a6f5-09e17253fadc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:37.496793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e07f38-67d2-4a92-a6f5-09e17253fadc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:37.506199 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 301/636] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:37.507124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e07f38-67d2-4a92-a6f5-09e17253fadc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:37.524925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d6c29-a0d7-4722-a97c-13a6041ebaaa None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:37.556841 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:37.567275 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5ceb1-433d-4d48-8aeb-db3dc0c4a7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:37.568012 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5ceb1-433d-4d48-8aeb-db3dc0c4a7bf None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:37.568321 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5ceb1-433d-4d48-8aeb-db3dc0c4a7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:37.568599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5ceb1-433d-4d48-8aeb-db3dc0c4a7bf None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:37.569431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5ceb1-433d-4d48-8aeb-db3dc0c4a7bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:37.569744 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5ceb1-433d-4d48-8aeb-db3dc0c4a7bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:37.571253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5ceb1-433d-4d48-8aeb-db3dc0c4a7bf None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:37.583938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 336/637] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:37.584800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5ceb1-433d-4d48-8aeb-db3dc0c4a7bf None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:37.625799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e07f38-67d2-4a92-a6f5-09e17253fadc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:37.655406 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:37.665098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85033c9e-f12a-4a4b-8cdf-d76329721263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:37.666259 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85033c9e-f12a-4a4b-8cdf-d76329721263 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:37.666540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85033c9e-f12a-4a4b-8cdf-d76329721263 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:37.666845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85033c9e-f12a-4a4b-8cdf-d76329721263 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:37.678252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85033c9e-f12a-4a4b-8cdf-d76329721263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:37.680027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85033c9e-f12a-4a4b-8cdf-d76329721263 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:37.688516 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5ceb1-433d-4d48-8aeb-db3dc0c4a7bf None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:37.698190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-85033c9e-f12a-4a4b-8cdf-d76329721263 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:37.698190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:37.698190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:37.698190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:37.698190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:37.698190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:37.698190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:37.698190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:37.698190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:37.698190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:37.698190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:37.698190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:37.698190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:37.698190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:37.698190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:37.699464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:37.700663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:37.700663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:37.700663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:37.700663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:37.700663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 302/638] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:37.700663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85033c9e-f12a-4a4b-8cdf-d76329721263 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:37.730806 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271ee5a-a54e-4afd-9da7-8237dfcadef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:37.731554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271ee5a-a54e-4afd-9da7-8237dfcadef9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:37.731830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271ee5a-a54e-4afd-9da7-8237dfcadef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:37.732099 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271ee5a-a54e-4afd-9da7-8237dfcadef9 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:37.732865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271ee5a-a54e-4afd-9da7-8237dfcadef9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:37.733178 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271ee5a-a54e-4afd-9da7-8237dfcadef9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:37.734682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271ee5a-a54e-4afd-9da7-8237dfcadef9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:37.751702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 337/639] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:37.751702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271ee5a-a54e-4afd-9da7-8237dfcadef9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:37.798284 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:37.814016 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85033c9e-f12a-4a4b-8cdf-d76329721263 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:37.849860 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b03127-f8c8-4375-b32e-968b670db4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:37.850675 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b03127-f8c8-4375-b32e-968b670db4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:37.851000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b03127-f8c8-4375-b32e-968b670db4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:37.851276 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b03127-f8c8-4375-b32e-968b670db4b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:37.853059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271ee5a-a54e-4afd-9da7-8237dfcadef9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:37.863125 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b03127-f8c8-4375-b32e-968b670db4b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:37.864604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b03127-f8c8-4375-b32e-968b670db4b6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:37.882699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-48b03127-f8c8-4375-b32e-968b670db4b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:37.882699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:37.882699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:37.882699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:37.882699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:37.882699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:37.882699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:37.882699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:37.882699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:37.882699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:37.882699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:37.882699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:37.882699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:37.882699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:37.882699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:37.884471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:37.886670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:37.886670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:37.886670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:37.886670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:37.886670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 303/640] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:37.886670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b03127-f8c8-4375-b32e-968b670db4b6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:37.893684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a42387-5903-4a33-9ac4-279420054734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:37.894899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a42387-5903-4a33-9ac4-279420054734 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:37.895195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a42387-5903-4a33-9ac4-279420054734 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:37.895479 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a42387-5903-4a33-9ac4-279420054734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:37.896356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a42387-5903-4a33-9ac4-279420054734 None admin] RBAC: Adding query filter params (role.id=ae7cbb39ab61467ba1976a753ba6693c, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=e9a1ec1f6bb7467dbd63ad1da36d48a9) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:37.897030 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a42387-5903-4a33-9ac4-279420054734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:37.898848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a42387-5903-4a33-9ac4-279420054734 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:37.905122 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 338/641] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:52:37 2022] GET /identity/v3/role_assignments?user.id=e9a1ec1f6bb7467dbd63ad1da36d48a9&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=ae7cbb39ab61467ba1976a753ba6693c => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:37.905931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a42387-5903-4a33-9ac4-279420054734 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:37.920019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:38.002378 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b03127-f8c8-4375-b32e-968b670db4b6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:38.038499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a42387-5903-4a33-9ac4-279420054734 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:38.038720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8050a-a74e-4d9a-96d6-4c627c9bc6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:38.039282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8050a-a74e-4d9a-96d6-4c627c9bc6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:38.039562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8050a-a74e-4d9a-96d6-4c627c9bc6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:38.039836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8050a-a74e-4d9a-96d6-4c627c9bc6d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:38.040586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8050a-a74e-4d9a-96d6-4c627c9bc6d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:38.040887 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8050a-a74e-4d9a-96d6-4c627c9bc6d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:38.042292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8050a-a74e-4d9a-96d6-4c627c9bc6d2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:38.050440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:38.056421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 304/642] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:38.057858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700ce43-dec4-4488-a3c5-a9967dfbff92 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:38.058257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700ce43-dec4-4488-a3c5-a9967dfbff92 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:38.058427 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700ce43-dec4-4488-a3c5-a9967dfbff92 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:38.062969 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 305/643] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:38.062969 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700ce43-dec4-4488-a3c5-a9967dfbff92 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:38.086038 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479b088-c958-4ef2-b671-9648833fa675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:38.086944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479b088-c958-4ef2-b671-9648833fa675 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:38.087225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479b088-c958-4ef2-b671-9648833fa675 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:38.087494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479b088-c958-4ef2-b671-9648833fa675 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:38.095245 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479b088-c958-4ef2-b671-9648833fa675 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:38.096969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479b088-c958-4ef2-b671-9648833fa675 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:38.112621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-6479b088-c958-4ef2-b671-9648833fa675 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:38.112621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:38.112621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:38.112621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:38.112621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:38.112621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:38.112621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:38.112621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:38.112621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:38.112621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:38.112621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:38.112621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:38.112621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:38.112621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:38.112621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:38.113788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:38.115451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:38.115451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:38.115451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:38.115451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:38.115451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:38.115451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:38.115451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:38.115451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:38.117079 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 339/644] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:38.117797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479b088-c958-4ef2-b671-9648833fa675 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:38.182799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:38.196677 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700ce43-dec4-4488-a3c5-a9967dfbff92 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:38.234481 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965d63f6-b1db-4daf-90fe-4d2173dbf7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:38.235194 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d63f6-b1db-4daf-90fe-4d2173dbf7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:38.235473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d63f6-b1db-4daf-90fe-4d2173dbf7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:38.235750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965d63f6-b1db-4daf-90fe-4d2173dbf7a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:38.236494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d63f6-b1db-4daf-90fe-4d2173dbf7a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:38.236802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d63f6-b1db-4daf-90fe-4d2173dbf7a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:38.238296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965d63f6-b1db-4daf-90fe-4d2173dbf7a2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:38.239152 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479b088-c958-4ef2-b671-9648833fa675 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:38.255770 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 306/645] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:38.255770 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9556e9-19bf-4806-a157-8c621f36191d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:38.255770 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9556e9-19bf-4806-a157-8c621f36191d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:38.255770 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9556e9-19bf-4806-a157-8c621f36191d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:38.274944 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3c9556e9-19bf-4806-a157-8c621f36191d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:38.276312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3c9556e9-19bf-4806-a157-8c621f36191d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:38.282104 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967f852-9718-4d19-b447-f02a16679232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:38.282982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967f852-9718-4d19-b447-f02a16679232 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:38.283267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967f852-9718-4d19-b447-f02a16679232 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:38.283564 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967f852-9718-4d19-b447-f02a16679232 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:38.292493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967f852-9718-4d19-b447-f02a16679232 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:38.294000 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967f852-9718-4d19-b447-f02a16679232 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-6967f852-9718-4d19-b447-f02a16679232 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:38.309751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:38.311039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:38.317224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:38.317224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:38.317224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:38.317224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:38.317224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:38.317224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:38.317224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:38.317224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:38.317224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 15:52:38.317224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:38.317224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 340/646] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:38.317224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967f852-9718-4d19-b447-f02a16679232 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:38.347138 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:38.364651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 307/647] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:38.371747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9556e9-19bf-4806-a157-8c621f36191d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:38.423274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967f852-9718-4d19-b447-f02a16679232 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:38.462472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3df19b-c439-4a1c-bc55-442ee12d76e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:38.463190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3df19b-c439-4a1c-bc55-442ee12d76e4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:38.463477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3df19b-c439-4a1c-bc55-442ee12d76e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:38.463757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3df19b-c439-4a1c-bc55-442ee12d76e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:38.464568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3df19b-c439-4a1c-bc55-442ee12d76e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:38.464882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3df19b-c439-4a1c-bc55-442ee12d76e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:38.466382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3df19b-c439-4a1c-bc55-442ee12d76e4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:38.467892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:38.484622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 341/648] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:38.485705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3df19b-c439-4a1c-bc55-442ee12d76e4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:38.488925 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9556e9-19bf-4806-a157-8c621f36191d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:38.529271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360f06d-513c-41ac-b568-157567488410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:38.530031 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360f06d-513c-41ac-b568-157567488410 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:38.530843 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360f06d-513c-41ac-b568-157567488410 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:38.531136 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e360f06d-513c-41ac-b568-157567488410 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:38.541414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360f06d-513c-41ac-b568-157567488410 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:38.542949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e360f06d-513c-41ac-b568-157567488410 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e360f06d-513c-41ac-b568-157567488410 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:38.561175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:38.562285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:38.563619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:38.563619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:38.563619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:38.563619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:38.563619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:38.563619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:38.563619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:38.563619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:38.563619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 15:52:38.563619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:38.563619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 308/649] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:38.563619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360f06d-513c-41ac-b568-157567488410 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:38.596376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:38.606862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3df19b-c439-4a1c-bc55-442ee12d76e4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:38.642462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26cb47-a114-4d31-a371-4dfb46263caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:38.643188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26cb47-a114-4d31-a371-4dfb46263caa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:38.643498 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26cb47-a114-4d31-a371-4dfb46263caa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:38.643786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26cb47-a114-4d31-a371-4dfb46263caa None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:38.644645 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26cb47-a114-4d31-a371-4dfb46263caa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:38.644959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26cb47-a114-4d31-a371-4dfb46263caa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:38.646414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d26cb47-a114-4d31-a371-4dfb46263caa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:38.664820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 342/650] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 21 15:52:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:38.665740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26cb47-a114-4d31-a371-4dfb46263caa None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:38.680827 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e360f06d-513c-41ac-b568-157567488410 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:38.718927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d3bca-b92c-4a08-b793-0012f0a1f8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:38.720175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d3bca-b92c-4a08-b793-0012f0a1f8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:38.720634 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d3bca-b92c-4a08-b793-0012f0a1f8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:38.721079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d3bca-b92c-4a08-b793-0012f0a1f8f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:38.733066 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d3bca-b92c-4a08-b793-0012f0a1f8f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-321d3bca-b92c-4a08-b793-0012f0a1f8f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:38.742048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:38.743054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:38.743906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:38.743906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:38.743906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:38.743906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:38.743906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:38.743906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:38.743906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:38.743906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:38.743906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:38.743906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:38.743906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:38.743906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:38.744541 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 309/651] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:38.745298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d3bca-b92c-4a08-b793-0012f0a1f8f6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:38.750866 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:38.774706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26cb47-a114-4d31-a371-4dfb46263caa None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:38.808854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca442034-5684-45ea-a538-052f78213df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:38.809727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca442034-5684-45ea-a538-052f78213df9 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:38.810050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca442034-5684-45ea-a538-052f78213df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:38.810328 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca442034-5684-45ea-a538-052f78213df9 None admin] PATH_INFO: `/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/dcee349bdb2640609cc71fb1c65794f1/roles/ae7cbb39ab61467ba1976a753ba6693c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:38.826076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca442034-5684-45ea-a538-052f78213df9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d717ed2993d4a3ab21195028a16e747, user_id=dcee349bdb2640609cc71fb1c65794f1, role_id=ae7cbb39ab61467ba1976a753ba6693c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:38.827717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca442034-5684-45ea-a538-052f78213df9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:38.837279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:38.851659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 343/652] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:52:38 2022] PUT /identity/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/dcee349bdb2640609cc71fb1c65794f1/roles/ae7cbb39ab61467ba1976a753ba6693c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:52:38.851659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca442034-5684-45ea-a538-052f78213df9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:38.872784 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d3bca-b92c-4a08-b793-0012f0a1f8f6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:38.918000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b4ca3-a7d5-43b1-bcf8-84eb886663b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:38.918768 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b4ca3-a7d5-43b1-bcf8-84eb886663b8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:38.919144 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b4ca3-a7d5-43b1-bcf8-84eb886663b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:38.919500 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b4ca3-a7d5-43b1-bcf8-84eb886663b8 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:38.920535 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b4ca3-a7d5-43b1-bcf8-84eb886663b8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:38.920845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b4ca3-a7d5-43b1-bcf8-84eb886663b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:38.922441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b4ca3-a7d5-43b1-bcf8-84eb886663b8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:38.945720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 310/653] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Jul 21 15:52:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:38.946763 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b4ca3-a7d5-43b1-bcf8-84eb886663b8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:39.006124 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca442034-5684-45ea-a538-052f78213df9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:39.035448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:39.051149 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0e28d-670c-4099-a778-e7dfdcd31068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:39.052112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0e28d-670c-4099-a778-e7dfdcd31068 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:39.052402 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0e28d-670c-4099-a778-e7dfdcd31068 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:39.052682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0e28d-670c-4099-a778-e7dfdcd31068 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:39.084259 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b4ca3-a7d5-43b1-bcf8-84eb886663b8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:39.123078 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d247a5-1d0d-4081-8cd8-b917e6e7e5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:39.123777 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d247a5-1d0d-4081-8cd8-b917e6e7e5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:39.124059 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d247a5-1d0d-4081-8cd8-b917e6e7e5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:39.124334 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d247a5-1d0d-4081-8cd8-b917e6e7e5a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:39.125109 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d247a5-1d0d-4081-8cd8-b917e6e7e5a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:39.125420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d247a5-1d0d-4081-8cd8-b917e6e7e5a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:39.126981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d247a5-1d0d-4081-8cd8-b917e6e7e5a1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:39.136242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 311/654] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:39.137094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d247a5-1d0d-4081-8cd8-b917e6e7e5a1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:39.137955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:39.147466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0e28d-670c-4099-a778-e7dfdcd31068 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:39.151319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a0e28d-670c-4099-a778-e7dfdcd31068 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:39.267393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d247a5-1d0d-4081-8cd8-b917e6e7e5a1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:39.271201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 344/655] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:39.272231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0e28d-670c-4099-a778-e7dfdcd31068 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:39.295309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:39.315189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa2906-731f-434f-8cb1-da4b11c16d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:39.316263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa2906-731f-434f-8cb1-da4b11c16d0d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:39.316745 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa2906-731f-434f-8cb1-da4b11c16d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:39.317198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa2906-731f-434f-8cb1-da4b11c16d0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:39.394389 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa2906-731f-434f-8cb1-da4b11c16d0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:39.395182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:39.396366 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa2906-731f-434f-8cb1-da4b11c16d0d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:39.400440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0e28d-670c-4099-a778-e7dfdcd31068 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:39.446077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c773e01-335b-46fa-833c-152f7e1ccdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:39.447382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c773e01-335b-46fa-833c-152f7e1ccdfb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:39.448088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c773e01-335b-46fa-833c-152f7e1ccdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:39.448555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c773e01-335b-46fa-833c-152f7e1ccdfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:39.463446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c773e01-335b-46fa-833c-152f7e1ccdfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:39.465552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c773e01-335b-46fa-833c-152f7e1ccdfb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:39.490439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-9c773e01-335b-46fa-833c-152f7e1ccdfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:39.490439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:39.490439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:39.490439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:39.490439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:39.490439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:39.490439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:39.490439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:39.490439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:39.490439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:39.490439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:39.490439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:39.490439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:39.490439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:39.490439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:39.491631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:39.492556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:39.492556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:39.492556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:39.492556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:39.499158 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 345/656] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:39.499572 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c773e01-335b-46fa-833c-152f7e1ccdfb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:39.512597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 312/657] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:39.513643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa2906-731f-434f-8cb1-da4b11c16d0d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:39.540783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:39.605952 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c773e01-335b-46fa-833c-152f7e1ccdfb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:39.629499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa2906-731f-434f-8cb1-da4b11c16d0d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:39.644147 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0bd51-1a01-4774-81d5-7544607e1cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:39.645397 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0bd51-1a01-4774-81d5-7544607e1cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:39.645875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0bd51-1a01-4774-81d5-7544607e1cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:39.646337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0bd51-1a01-4774-81d5-7544607e1cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:39.657413 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0bd51-1a01-4774-81d5-7544607e1cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:39.659396 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0bd51-1a01-4774-81d5-7544607e1cc7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:39.668534 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffbf77-037a-463b-88b2-6fc33b033f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:39.669285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffbf77-037a-463b-88b2-6fc33b033f81 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:39.669570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffbf77-037a-463b-88b2-6fc33b033f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:39.669845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ffbf77-037a-463b-88b2-6fc33b033f81 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:39.670747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ffbf77-037a-463b-88b2-6fc33b033f81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:39.671154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ffbf77-037a-463b-88b2-6fc33b033f81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:39.672600 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ffbf77-037a-463b-88b2-6fc33b033f81 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:39.681621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-76d0bd51-1a01-4774-81d5-7544607e1cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:39.681621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:39.681621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:39.681621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:39.681621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:39.681621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:39.681621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:39.681621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:39.681621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:39.681621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:39.681621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:39.681621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:39.681621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:39.681621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:39.681621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:39.682599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:39.683555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:39.683555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:39.683555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:39.683555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:39.686035 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 346/658] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:39.690855 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 313/659] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:39.691033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0bd51-1a01-4774-81d5-7544607e1cc7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:39.692035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffbf77-037a-463b-88b2-6fc33b033f81 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:39.695782 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:39.788265 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:39.798061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0bd51-1a01-4774-81d5-7544607e1cc7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:39.810412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ffbf77-037a-463b-88b2-6fc33b033f81 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:39.834791 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c3286-ba5c-402b-8793-ac137632f862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:39.836445 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c3286-ba5c-402b-8793-ac137632f862 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:39.836927 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c3286-ba5c-402b-8793-ac137632f862 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:39.837395 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c3286-ba5c-402b-8793-ac137632f862 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:39.849098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c240da-0a8f-403d-9bbb-9709d21e6608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:39.849711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c3286-ba5c-402b-8793-ac137632f862 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:39.849843 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c240da-0a8f-403d-9bbb-9709d21e6608 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:39.850045 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c240da-0a8f-403d-9bbb-9709d21e6608 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:39.850325 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c240da-0a8f-403d-9bbb-9709d21e6608 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:39.851185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c240da-0a8f-403d-9bbb-9709d21e6608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:39.851504 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c240da-0a8f-403d-9bbb-9709d21e6608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:39.852373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c3286-ba5c-402b-8793-ac137632f862 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:39.852884 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c240da-0a8f-403d-9bbb-9709d21e6608 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:39.867526 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 314/660] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:39.868544 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c240da-0a8f-403d-9bbb-9709d21e6608 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:39.873276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-eb1c3286-ba5c-402b-8793-ac137632f862 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:39.873276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:39.873276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:39.873276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:39.873276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:39.873276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:39.873276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:39.873276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:39.873276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:39.873276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:39.873276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:39.873276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:39.873276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:39.873276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:39.873276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:39.874220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:39.875163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:39.875163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:39.875163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:39.875163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:39.877399 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 347/661] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:39.878531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c3286-ba5c-402b-8793-ac137632f862 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:39.935985 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:39.982684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c3286-ba5c-402b-8793-ac137632f862 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:39.983058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c240da-0a8f-403d-9bbb-9709d21e6608 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:40.019929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fe8ab-ff1e-4152-a3fd-185f5a5669d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:40.021251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fe8ab-ff1e-4152-a3fd-185f5a5669d0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:40.021791 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fe8ab-ff1e-4152-a3fd-185f5a5669d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:40.022205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fe8ab-ff1e-4152-a3fd-185f5a5669d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:40.022520 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab71b95-9446-413b-b8b5-f3684f7e2ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:40.023517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab71b95-9446-413b-b8b5-f3684f7e2ead None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:40.023903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab71b95-9446-413b-b8b5-f3684f7e2ead None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:40.024414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab71b95-9446-413b-b8b5-f3684f7e2ead None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:40.030493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fe8ab-ff1e-4152-a3fd-185f5a5669d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:40.032298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8fe8ab-ff1e-4152-a3fd-185f5a5669d0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:40.032879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab71b95-9446-413b-b8b5-f3684f7e2ead None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:40.034580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab71b95-9446-413b-b8b5-f3684f7e2ead None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:40.047767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-0b8fe8ab-ff1e-4152-a3fd-185f5a5669d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:40.047767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:40.047767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:40.047767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:40.047767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:40.047767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:40.047767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:40.047767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:40.047767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:40.047767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:40.047767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:40.047767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:40.047767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:40.047767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:40.047767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:40.048870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:40.050519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:40.050519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:40.050519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:40.050519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:40.050519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:40.050519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:40.050519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:40.050519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:40.050519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 348/662] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:40.050519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fe8ab-ff1e-4152-a3fd-185f5a5669d0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7ab71b95-9446-413b-b8b5-f3684f7e2ead None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:40.051300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:40.052171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:40.054489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:40.054489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:40.054489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:40.054489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:40.054489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:40.054489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:40.054489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:40.054489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:40.054489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 15:52:40.054489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:40.054489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 315/663] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:40.054489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be530589-be61-4b93-989c-7e06f7b0e297 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:40.054489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be530589-be61-4b93-989c-7e06f7b0e297 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:40.060330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be530589-be61-4b93-989c-7e06f7b0e297 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:40.060330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 316/664] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:40.060330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be530589-be61-4b93-989c-7e06f7b0e297 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:40.060330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:40.163275 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8fe8ab-ff1e-4152-a3fd-185f5a5669d0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:40.167029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be530589-be61-4b93-989c-7e06f7b0e297 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:40.181267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:40.204332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696b9a1-c8e2-470f-84ea-d2619915fd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:40.205027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696b9a1-c8e2-470f-84ea-d2619915fd57 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:40.205312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696b9a1-c8e2-470f-84ea-d2619915fd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:40.205583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696b9a1-c8e2-470f-84ea-d2619915fd57 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:40.206465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696b9a1-c8e2-470f-84ea-d2619915fd57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:40.206727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa3674-f131-46a6-8861-2618080034c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:40.206862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696b9a1-c8e2-470f-84ea-d2619915fd57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:40.207426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa3674-f131-46a6-8861-2618080034c2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:40.207708 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa3674-f131-46a6-8861-2618080034c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:40.207979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa3674-f131-46a6-8861-2618080034c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:40.208263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696b9a1-c8e2-470f-84ea-d2619915fd57 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:40.208704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa3674-f131-46a6-8861-2618080034c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:40.209010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa3674-f131-46a6-8861-2618080034c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:40.210381 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa3674-f131-46a6-8861-2618080034c2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:40.225606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 317/665] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:40.225606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696b9a1-c8e2-470f-84ea-d2619915fd57 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:40.229572 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 349/666] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:40.230848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbfed8-e1c6-4766-a758-31c071c2c333 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:40.230848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbfed8-e1c6-4766-a758-31c071c2c333 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:40.230848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbfed8-e1c6-4766-a758-31c071c2c333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:40.249147 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-32fbfed8-e1c6-4766-a758-31c071c2c333 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:40.250419 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-32fbfed8-e1c6-4766-a758-31c071c2c333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:40.284442 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:40.321777 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 350/667] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:40.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbfed8-e1c6-4766-a758-31c071c2c333 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:40.331623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696b9a1-c8e2-470f-84ea-d2619915fd57 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:40.368836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64289e-7b64-48c6-8772-f9d3a21f33ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:40.369567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64289e-7b64-48c6-8772-f9d3a21f33ec None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:40.369800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64289e-7b64-48c6-8772-f9d3a21f33ec None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:40.370085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e64289e-7b64-48c6-8772-f9d3a21f33ec None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:40.370984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64289e-7b64-48c6-8772-f9d3a21f33ec None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:40.371358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64289e-7b64-48c6-8772-f9d3a21f33ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:40.372800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e64289e-7b64-48c6-8772-f9d3a21f33ec None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:40.396718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 318/668] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Jul 21 15:52:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:40.397907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64289e-7b64-48c6-8772-f9d3a21f33ec None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:40.441539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbfed8-e1c6-4766-a758-31c071c2c333 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:40.445151 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:40.483959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cf0b4-01f0-49a5-85af-4a7302d7c0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:40.484646 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cf0b4-01f0-49a5-85af-4a7302d7c0d9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:40.484936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cf0b4-01f0-49a5-85af-4a7302d7c0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:40.485668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cf0b4-01f0-49a5-85af-4a7302d7c0d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:40.486945 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cf0b4-01f0-49a5-85af-4a7302d7c0d9 None admin] RBAC: Adding query filter params (role.id=ae7cbb39ab61467ba1976a753ba6693c, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=1a3418c0b46c404c8ca445cce9db632d) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:40.487407 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cf0b4-01f0-49a5-85af-4a7302d7c0d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:40.489759 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cf0b4-01f0-49a5-85af-4a7302d7c0d9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:40.497620 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 351/669] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:52:40 2022] GET /identity/v3/role_assignments?user.id=1a3418c0b46c404c8ca445cce9db632d&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=ae7cbb39ab61467ba1976a753ba6693c => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:40.498488 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cf0b4-01f0-49a5-85af-4a7302d7c0d9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:40.523498 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e64289e-7b64-48c6-8772-f9d3a21f33ec None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:40.554052 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:40.574638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dce4cc-1f9c-47f4-8213-cf2151131290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:40.576593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dce4cc-1f9c-47f4-8213-cf2151131290 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:40.577093 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dce4cc-1f9c-47f4-8213-cf2151131290 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:40.577800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dce4cc-1f9c-47f4-8213-cf2151131290 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:40.586923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dce4cc-1f9c-47f4-8213-cf2151131290 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:40.588620 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dce4cc-1f9c-47f4-8213-cf2151131290 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:40.604850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-97dce4cc-1f9c-47f4-8213-cf2151131290 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:40.604850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:40.604850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:40.604850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:40.604850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:40.604850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:40.604850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:40.604850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:40.604850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:40.604850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:40.604850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:40.604850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:40.604850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:40.604850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:40.604850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:40.606060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:40.607057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:40.607057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:40.607057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:40.607057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:40.607057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:40.607057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:40.607057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:40.607057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:40.611636 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 319/670] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:40.612950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dce4cc-1f9c-47f4-8213-cf2151131290 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:40.625408 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cf0b4-01f0-49a5-85af-4a7302d7c0d9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:40.680919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731a93f-cddd-4f6f-9d4c-4712da27b381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:40.681825 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731a93f-cddd-4f6f-9d4c-4712da27b381 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:40.682102 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731a93f-cddd-4f6f-9d4c-4712da27b381 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:40.682374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b731a93f-cddd-4f6f-9d4c-4712da27b381 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:40.696236 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b731a93f-cddd-4f6f-9d4c-4712da27b381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-b731a93f-cddd-4f6f-9d4c-4712da27b381 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:40.704823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:40.705826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:40.707251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:40.707251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:40.707251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:40.707251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:40.707251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:40.707251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:40.707251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:40.707251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:40.707251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:40.707251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:40.707251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:40.707251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:40.707251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 352/671] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:52:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:40.708199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731a93f-cddd-4f6f-9d4c-4712da27b381 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:40.746665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:40.760003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dce4cc-1f9c-47f4-8213-cf2151131290 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:40.803324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9292e7-411d-4453-a5d1-19f98508caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:40.805281 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9292e7-411d-4453-a5d1-19f98508caa6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:40.805798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9292e7-411d-4453-a5d1-19f98508caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:40.806741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9292e7-411d-4453-a5d1-19f98508caa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:40.835469 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b731a93f-cddd-4f6f-9d4c-4712da27b381 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:40.873617 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:40.876213 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953db6ed-64c2-4574-88c7-56a246d534cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:40.877002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953db6ed-64c2-4574-88c7-56a246d534cf None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:40.877296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953db6ed-64c2-4574-88c7-56a246d534cf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:40.877583 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953db6ed-64c2-4574-88c7-56a246d534cf None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:40.878908 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953db6ed-64c2-4574-88c7-56a246d534cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:40.879633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953db6ed-64c2-4574-88c7-56a246d534cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:40.881237 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953db6ed-64c2-4574-88c7-56a246d534cf None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:40.896516 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 353/672] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:40.897464 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953db6ed-64c2-4574-88c7-56a246d534cf None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:40.898104 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9292e7-411d-4453-a5d1-19f98508caa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:40.899610 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9292e7-411d-4453-a5d1-19f98508caa6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:41.010697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:41.022760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 320/673] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:41.024423 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9292e7-411d-4453-a5d1-19f98508caa6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:41.025173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953db6ed-64c2-4574-88c7-56a246d534cf None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:41.065723 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a226805-6d31-40ef-a077-4e2d755214fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:41.066419 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a226805-6d31-40ef-a077-4e2d755214fa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:41.066709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a226805-6d31-40ef-a077-4e2d755214fa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:41.067021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a226805-6d31-40ef-a077-4e2d755214fa None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:41.067852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a226805-6d31-40ef-a077-4e2d755214fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:41.068166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a226805-6d31-40ef-a077-4e2d755214fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:41.069635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a226805-6d31-40ef-a077-4e2d755214fa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:41.078805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 354/674] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:41.079713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a226805-6d31-40ef-a077-4e2d755214fa None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:41.124843 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:41.146767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9292e7-411d-4453-a5d1-19f98508caa6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:41.190495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f96e9ba-647b-4259-92cb-747485c39b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:41.191543 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96e9ba-647b-4259-92cb-747485c39b23 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:41.192019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96e9ba-647b-4259-92cb-747485c39b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:41.192457 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f96e9ba-647b-4259-92cb-747485c39b23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:41.193459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96e9ba-647b-4259-92cb-747485c39b23 None admin] RBAC: Adding query filter params (role.id=ae7cbb39ab61467ba1976a753ba6693c, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=d8c629ecd4014e2b8051b853a0b4c18a) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:41.193965 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96e9ba-647b-4259-92cb-747485c39b23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:41.195630 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f96e9ba-647b-4259-92cb-747485c39b23 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:41.197109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a226805-6d31-40ef-a077-4e2d755214fa None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:41.210846 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 321/675] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:52:41 2022] GET /identity/v3/role_assignments?user.id=d8c629ecd4014e2b8051b853a0b4c18a&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=ae7cbb39ab61467ba1976a753ba6693c => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:41.210846 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806aaea-3c6b-4e12-8566-895c1efc7690 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:41.210846 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806aaea-3c6b-4e12-8566-895c1efc7690 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:41.210846 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806aaea-3c6b-4e12-8566-895c1efc7690 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:41.210846 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 322/676] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:41.210846 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806aaea-3c6b-4e12-8566-895c1efc7690 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:41.253152 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b0a14a-eec4-4134-96db-63be23f219e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:41.254136 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0a14a-eec4-4134-96db-63be23f219e7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:41.254524 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0a14a-eec4-4134-96db-63be23f219e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:41.254920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b0a14a-eec4-4134-96db-63be23f219e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:41.273944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0a14a-eec4-4134-96db-63be23f219e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:41.276631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b0a14a-eec4-4134-96db-63be23f219e7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:41.304722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e8b0a14a-eec4-4134-96db-63be23f219e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:41.304722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:41.304722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:41.304722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:41.304722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:41.304722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:41.304722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:41.304722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:41.304722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:41.304722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:41.304722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:41.304722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:41.304722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:41.304722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:41.304722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:41.305740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:41.312652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:41.312652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:41.312652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:41.312652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:41.312652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 355/677] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:41.313038 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4425ade-fd72-448e-a39c-10c225fb85a6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:41.313403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4425ade-fd72-448e-a39c-10c225fb85a6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:41.313507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4425ade-fd72-448e-a39c-10c225fb85a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:41.319571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:41.333939 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d4425ade-fd72-448e-a39c-10c225fb85a6 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:41.335304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d4425ade-fd72-448e-a39c-10c225fb85a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:41.359650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806aaea-3c6b-4e12-8566-895c1efc7690 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:41.404948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd3b3-db62-4d01-93f3-889e076ceda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:41.406176 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd3b3-db62-4d01-93f3-889e076ceda6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:41.406659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd3b3-db62-4d01-93f3-889e076ceda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:41.408042 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bd3b3-db62-4d01-93f3-889e076ceda6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:41.419815 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bd3b3-db62-4d01-93f3-889e076ceda6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:41.421645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bd3b3-db62-4d01-93f3-889e076ceda6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:41.424953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:41.432891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 356/678] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:41.434154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4425ade-fd72-448e-a39c-10c225fb85a6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:41.442494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-714bd3b3-db62-4d01-93f3-889e076ceda6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:41.442494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:41.442494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:41.442494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:41.442494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:41.442494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:41.442494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:41.442494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:41.442494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:41.442494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:41.442494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:41.442494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:41.442494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:41.442494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:41.442494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:41.443615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:41.444708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:41.444708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:41.444708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:41.444708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:41.445923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 323/679] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:41.451528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd3b3-db62-4d01-93f3-889e076ceda6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:41.567773 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4425ade-fd72-448e-a39c-10c225fb85a6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:41.583205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bd3b3-db62-4d01-93f3-889e076ceda6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:41.608483 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:41.617042 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221d3e9-fc9b-45a1-b69f-00f21e51177f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:41.618566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221d3e9-fc9b-45a1-b69f-00f21e51177f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:41.619174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221d3e9-fc9b-45a1-b69f-00f21e51177f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:41.619719 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221d3e9-fc9b-45a1-b69f-00f21e51177f None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:41.620867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221d3e9-fc9b-45a1-b69f-00f21e51177f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:41.621749 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221d3e9-fc9b-45a1-b69f-00f21e51177f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:41.623616 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221d3e9-fc9b-45a1-b69f-00f21e51177f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:41.626765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21a9f8-de3a-4e6f-862f-2a9a5f320d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:41.627505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21a9f8-de3a-4e6f-862f-2a9a5f320d7b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:41.627818 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21a9f8-de3a-4e6f-862f-2a9a5f320d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:41.628126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21a9f8-de3a-4e6f-862f-2a9a5f320d7b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:41.628871 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21a9f8-de3a-4e6f-862f-2a9a5f320d7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:41.629179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21a9f8-de3a-4e6f-862f-2a9a5f320d7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:41.630578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21a9f8-de3a-4e6f-862f-2a9a5f320d7b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:41.638713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 357/680] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:41.640453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221d3e9-fc9b-45a1-b69f-00f21e51177f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:41.646242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 324/681] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:41.647181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21a9f8-de3a-4e6f-862f-2a9a5f320d7b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:41.722414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:41.775478 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21a9f8-de3a-4e6f-862f-2a9a5f320d7b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:41.778989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221d3e9-fc9b-45a1-b69f-00f21e51177f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:41.818556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331eae10-411b-49e3-93f5-2885cb555517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:41.819353 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331eae10-411b-49e3-93f5-2885cb555517 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:41.819631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331eae10-411b-49e3-93f5-2885cb555517 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:41.819905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331eae10-411b-49e3-93f5-2885cb555517 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:41.824472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988a7a8-5d91-487d-8a1c-c3905c4da48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:41.825553 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988a7a8-5d91-487d-8a1c-c3905c4da48f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:41.826019 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988a7a8-5d91-487d-8a1c-c3905c4da48f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:41.826473 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988a7a8-5d91-487d-8a1c-c3905c4da48f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:41.829899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331eae10-411b-49e3-93f5-2885cb555517 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:41.831540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331eae10-411b-49e3-93f5-2885cb555517 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:41.839190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988a7a8-5d91-487d-8a1c-c3905c4da48f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a988a7a8-5d91-487d-8a1c-c3905c4da48f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:41.847319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:41.848307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:41.849154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:41.849154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:41.849154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:41.849154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:41.849154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:41.849154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:41.849154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:41.849154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:41.849154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:41.849154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:41.849154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:41.849154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:41.850916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-331eae10-411b-49e3-93f5-2885cb555517 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:41.850916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:41.850916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:41.850916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:41.850916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:41.850916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:41.850916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:41.850916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:41.850916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:41.850916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:41.850916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:41.850916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:41.850916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:41.850916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:41.850916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:41.851906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:41.852783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:41.852783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:41.852783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:41.852783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:41.852783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:41.852783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:41.852783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:41.852783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:41.854184 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 358/682] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:41.855318 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988a7a8-5d91-487d-8a1c-c3905c4da48f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:41.855866 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 325/683] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:41.856960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331eae10-411b-49e3-93f5-2885cb555517 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:41.916998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:41.969105 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988a7a8-5d91-487d-8a1c-c3905c4da48f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:41.989051 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331eae10-411b-49e3-93f5-2885cb555517 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:42.005500 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b38f19-4689-4696-8b19-37f06a153f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:42.006456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b38f19-4689-4696-8b19-37f06a153f82 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:42.006854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b38f19-4689-4696-8b19-37f06a153f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:42.007243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b38f19-4689-4696-8b19-37f06a153f82 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:42.012019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:42.016576 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b38f19-4689-4696-8b19-37f06a153f82 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:42.018169 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b38f19-4689-4696-8b19-37f06a153f82 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:42.032964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655fe4f-8b41-4b48-9d93-b79d71aa44ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:42.033942 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655fe4f-8b41-4b48-9d93-b79d71aa44ce None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:42.034345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655fe4f-8b41-4b48-9d93-b79d71aa44ce None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:42.034711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3655fe4f-8b41-4b48-9d93-b79d71aa44ce None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:42.035591 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655fe4f-8b41-4b48-9d93-b79d71aa44ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:42.035992 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655fe4f-8b41-4b48-9d93-b79d71aa44ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-36b38f19-4689-4696-8b19-37f06a153f82 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:42.036487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:42.037591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:42.038839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:42.038839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:42.038839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:42.038839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:42.038839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:42.038839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:42.038839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:42.038839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:42.038839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:52:42.038839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:42.040107 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3655fe4f-8b41-4b48-9d93-b79d71aa44ce None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:42.041315 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 359/684] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 15:52:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:42.042325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b38f19-4689-4696-8b19-37f06a153f82 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:42.053886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 326/685] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:42.053886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655fe4f-8b41-4b48-9d93-b79d71aa44ce None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:42.166379 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b38f19-4689-4696-8b19-37f06a153f82 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:42.182164 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:42.188965 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3655fe4f-8b41-4b48-9d93-b79d71aa44ce None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:42.207089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13added6-acad-4d34-8987-d7cdb1ec4bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:42.208052 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13added6-acad-4d34-8987-d7cdb1ec4bcb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:42.208337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13added6-acad-4d34-8987-d7cdb1ec4bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:42.208614 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13added6-acad-4d34-8987-d7cdb1ec4bcb None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:42.209427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13added6-acad-4d34-8987-d7cdb1ec4bcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:42.209739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13added6-acad-4d34-8987-d7cdb1ec4bcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:42.211806 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13added6-acad-4d34-8987-d7cdb1ec4bcb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:42.230970 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 360/686] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:42.232151 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13added6-acad-4d34-8987-d7cdb1ec4bcb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:42.239802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908651b-ad6d-4fa3-bfb2-13a3005a04b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:42.240808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908651b-ad6d-4fa3-bfb2-13a3005a04b1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:42.241087 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908651b-ad6d-4fa3-bfb2-13a3005a04b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:42.241360 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908651b-ad6d-4fa3-bfb2-13a3005a04b1 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:42.242210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908651b-ad6d-4fa3-bfb2-13a3005a04b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:42.242516 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908651b-ad6d-4fa3-bfb2-13a3005a04b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:42.244115 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908651b-ad6d-4fa3-bfb2-13a3005a04b1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:42.269168 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 327/687] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 15:52:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:42.270256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908651b-ad6d-4fa3-bfb2-13a3005a04b1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:42.308263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:42.338196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13added6-acad-4d34-8987-d7cdb1ec4bcb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:42.374252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ea0b1-5020-4ae6-8762-21ddc1d9eb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:42.375358 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ea0b1-5020-4ae6-8762-21ddc1d9eb8a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:42.375812 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ea0b1-5020-4ae6-8762-21ddc1d9eb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:42.376284 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ea0b1-5020-4ae6-8762-21ddc1d9eb8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:42.381506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908651b-ad6d-4fa3-bfb2-13a3005a04b1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:42.387657 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ea0b1-5020-4ae6-8762-21ddc1d9eb8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:42.389335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ea0b1-5020-4ae6-8762-21ddc1d9eb8a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:42.408955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-5e0ea0b1-5020-4ae6-8762-21ddc1d9eb8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:42.408955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:42.408955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:42.408955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:42.408955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:42.408955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:42.408955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:42.408955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:42.408955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:42.408955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:42.408955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:42.408955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:42.408955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:42.408955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:42.408955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:42.410181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:42.411306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:42.411306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:42.411306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:42.411306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:42.417600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 361/688] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:42.418702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ea0b1-5020-4ae6-8762-21ddc1d9eb8a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:42.419123 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ec317-e17c-4c8b-b34d-b49264df2c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:42.419922 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ec317-e17c-4c8b-b34d-b49264df2c52 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:42.420280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ec317-e17c-4c8b-b34d-b49264df2c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:42.420625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ec317-e17c-4c8b-b34d-b49264df2c52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:42.421692 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ec317-e17c-4c8b-b34d-b49264df2c52 None admin] RBAC: Adding query filter params (role.id=ae7cbb39ab61467ba1976a753ba6693c, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=1b46a82ffe92437fb8205bd186a8b05e) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:42.422086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ec317-e17c-4c8b-b34d-b49264df2c52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:42.424446 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ec317-e17c-4c8b-b34d-b49264df2c52 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:42.439069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 328/689] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:52:42 2022] GET /identity/v3/role_assignments?user.id=1b46a82ffe92437fb8205bd186a8b05e&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=ae7cbb39ab61467ba1976a753ba6693c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:42.440433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ec317-e17c-4c8b-b34d-b49264df2c52 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:42.448259 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:42.534216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ea0b1-5020-4ae6-8762-21ddc1d9eb8a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:42.572274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:42.576747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ec317-e17c-4c8b-b34d-b49264df2c52 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:42.587740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb151e92-839f-4c48-8837-41de2e60b53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:42.588434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb151e92-839f-4c48-8837-41de2e60b53a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:42.588721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb151e92-839f-4c48-8837-41de2e60b53a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:42.589002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb151e92-839f-4c48-8837-41de2e60b53a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:42.618045 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cc41c-d1a7-45d1-a6fc-4ef4a904ed70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:42.619159 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cc41c-d1a7-45d1-a6fc-4ef4a904ed70 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:42.619630 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cc41c-d1a7-45d1-a6fc-4ef4a904ed70 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:42.620109 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cc41c-d1a7-45d1-a6fc-4ef4a904ed70 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:42.621032 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cc41c-d1a7-45d1-a6fc-4ef4a904ed70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:42.621546 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cc41c-d1a7-45d1-a6fc-4ef4a904ed70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:42.623230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cc41c-d1a7-45d1-a6fc-4ef4a904ed70 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:42.637568 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 329/690] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:42.643879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cc41c-d1a7-45d1-a6fc-4ef4a904ed70 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:42.743876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb151e92-839f-4c48-8837-41de2e60b53a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:42.747687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb151e92-839f-4c48-8837-41de2e60b53a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:42.782865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:42.810653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cc41c-d1a7-45d1-a6fc-4ef4a904ed70 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:42.849747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74ba7d-d16c-4311-999b-f05d262eaeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:42.850859 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74ba7d-d16c-4311-999b-f05d262eaeed None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:42.851162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74ba7d-d16c-4311-999b-f05d262eaeed None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:42.851691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74ba7d-d16c-4311-999b-f05d262eaeed None admin] PATH_INFO: `/v3/users/swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:42.862910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74ba7d-d16c-4311-999b-f05d262eaeed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:42.865441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74ba7d-d16c-4311-999b-f05d262eaeed None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:42.871290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 362/691] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:42.872939 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c813e-c62b-4d73-ba76-71d5357c4c68 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:42.873321 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c813e-c62b-4d73-ba76-71d5357c4c68 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:42.873674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c813e-c62b-4d73-ba76-71d5357c4c68 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:42.879710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 363/692] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:42.880653 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c813e-c62b-4d73-ba76-71d5357c4c68 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-bc74ba7d-d16c-4311-999b-f05d262eaeed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:42.881963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:42.883003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:42.883970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:42.883970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:42.883970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:42.883970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:42.883970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:42.883970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:42.883970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:42.883970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:42.883970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 15:52:42.883970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:42.883970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 330/693] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:52:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:42.887075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1903fc-fdfd-4854-ba40-489471cda785 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:42.887377 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1903fc-fdfd-4854-ba40-489471cda785 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:42.887654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1903fc-fdfd-4854-ba40-489471cda785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:42.909469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ae1903fc-fdfd-4854-ba40-489471cda785 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:42.910694 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ae1903fc-fdfd-4854-ba40-489471cda785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:42.927216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:42.989997 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 331/694] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:42.991297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1903fc-fdfd-4854-ba40-489471cda785 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:43.041782 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c813e-c62b-4d73-ba76-71d5357c4c68 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:43.072503 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:43.085681 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515583d-1402-492a-b55f-c5d17172e571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:43.086687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515583d-1402-492a-b55f-c5d17172e571 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:43.087146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515583d-1402-492a-b55f-c5d17172e571 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:43.087577 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515583d-1402-492a-b55f-c5d17172e571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:43.100543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515583d-1402-492a-b55f-c5d17172e571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:43.102203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515583d-1402-492a-b55f-c5d17172e571 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:43.122622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-4515583d-1402-492a-b55f-c5d17172e571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:43.122622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:43.122622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:43.122622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:43.122622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:43.122622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:43.122622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:43.122622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:43.122622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:43.122622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:43.122622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:43.122622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:43.122622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:43.122622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:43.122622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:43.124423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:43.126490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:43.126490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:43.126490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:43.126490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:43.126490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 364/695] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:43.126490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515583d-1402-492a-b55f-c5d17172e571 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:43.147592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1903fc-fdfd-4854-ba40-489471cda785 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:43.199110 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb451df5-81a6-4c7e-84ba-69ae094c1317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:43.199999 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451df5-81a6-4c7e-84ba-69ae094c1317 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:43.200461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451df5-81a6-4c7e-84ba-69ae094c1317 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:43.200963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451df5-81a6-4c7e-84ba-69ae094c1317 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:43.202096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb451df5-81a6-4c7e-84ba-69ae094c1317 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:43.202560 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb451df5-81a6-4c7e-84ba-69ae094c1317 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:43.204237 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb451df5-81a6-4c7e-84ba-69ae094c1317 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:43.229125 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 332/696] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 21 15:52:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:43.230395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb451df5-81a6-4c7e-84ba-69ae094c1317 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:43.232754 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515583d-1402-492a-b55f-c5d17172e571 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:43.242464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:43.271628 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e306a-109d-4419-b2c0-b447be592da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:43.272501 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e306a-109d-4419-b2c0-b447be592da5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:43.272783 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e306a-109d-4419-b2c0-b447be592da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:43.273055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e306a-109d-4419-b2c0-b447be592da5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:43.284013 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e306a-109d-4419-b2c0-b447be592da5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:43.285721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e306a-109d-4419-b2c0-b447be592da5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:43.304800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-200e306a-109d-4419-b2c0-b447be592da5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:43.304800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:43.304800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:43.304800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:43.304800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:43.304800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:43.304800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:43.304800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:43.304800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:43.304800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:43.304800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:43.304800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:43.304800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:43.304800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:43.304800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:43.305948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:43.307088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:43.307088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:43.307088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:43.307088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:43.311203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 365/697] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:43.312692 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e306a-109d-4419-b2c0-b447be592da5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:43.345084 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb451df5-81a6-4c7e-84ba-69ae094c1317 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:43.345796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:43.389382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6bc8b-ae86-43ea-8e58-43f8ad7bb6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:43.390852 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6bc8b-ae86-43ea-8e58-43f8ad7bb6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:43.391475 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6bc8b-ae86-43ea-8e58-43f8ad7bb6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:43.392113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6bc8b-ae86-43ea-8e58-43f8ad7bb6e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:43.393610 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6bc8b-ae86-43ea-8e58-43f8ad7bb6e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:43.394401 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6bc8b-ae86-43ea-8e58-43f8ad7bb6e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:43.396894 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f6bc8b-ae86-43ea-8e58-43f8ad7bb6e5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:43.417681 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 333/698] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:43.419025 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6bc8b-ae86-43ea-8e58-43f8ad7bb6e5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:43.432436 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e306a-109d-4419-b2c0-b447be592da5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:43.471135 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09848f00-874f-4912-92f6-fa4207dd1681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:43.471838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09848f00-874f-4912-92f6-fa4207dd1681 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:43.472124 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09848f00-874f-4912-92f6-fa4207dd1681 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:43.472405 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09848f00-874f-4912-92f6-fa4207dd1681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:43.498272 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:43.534450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6bc8b-ae86-43ea-8e58-43f8ad7bb6e5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:43.550256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09848f00-874f-4912-92f6-fa4207dd1681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:43.552803 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09848f00-874f-4912-92f6-fa4207dd1681 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:43.572358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677b653-3644-481e-8396-4274d6fe1091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:43.572970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b653-3644-481e-8396-4274d6fe1091 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:43.573240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b653-3644-481e-8396-4274d6fe1091 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:43.573522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677b653-3644-481e-8396-4274d6fe1091 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:43.574258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677b653-3644-481e-8396-4274d6fe1091 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:43.574587 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677b653-3644-481e-8396-4274d6fe1091 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:43.576001 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677b653-3644-481e-8396-4274d6fe1091 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:43.584832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:43.588711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 334/699] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:43.594074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677b653-3644-481e-8396-4274d6fe1091 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:43.666317 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 366/700] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:43.668112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c53b0e-6a57-4bae-8f37-49fcdac558f4 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:43.668621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c53b0e-6a57-4bae-8f37-49fcdac558f4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:43.669089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c53b0e-6a57-4bae-8f37-49fcdac558f4 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:43.670966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 367/701] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:43.671907 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c53b0e-6a57-4bae-8f37-49fcdac558f4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:43.700670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677b653-3644-481e-8396-4274d6fe1091 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:43.728821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:43.737293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f97f54-b8b0-4bc4-9816-e8c7e3ed843e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:43.738110 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f97f54-b8b0-4bc4-9816-e8c7e3ed843e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:43.738397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f97f54-b8b0-4bc4-9816-e8c7e3ed843e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:43.738681 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f97f54-b8b0-4bc4-9816-e8c7e3ed843e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:43.745980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f97f54-b8b0-4bc4-9816-e8c7e3ed843e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:43.747488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f97f54-b8b0-4bc4-9816-e8c7e3ed843e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:43.761661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-10f97f54-b8b0-4bc4-9816-e8c7e3ed843e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:43.761661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:43.761661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:43.761661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:43.761661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:43.761661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:43.761661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:43.761661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:43.761661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:43.761661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:43.761661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:43.761661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:43.761661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:43.761661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:43.761661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:43.762631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:43.763564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:43.763564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:43.763564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:43.763564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:43.763564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:43.763564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:43.763564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:43.763564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:43.763564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 335/702] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:43.764093 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f97f54-b8b0-4bc4-9816-e8c7e3ed843e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:43.793214 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c53b0e-6a57-4bae-8f37-49fcdac558f4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:43.824554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:43.833252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943e383-3a11-44ae-908e-48456c47265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:43.833990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943e383-3a11-44ae-908e-48456c47265c None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:43.834280 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943e383-3a11-44ae-908e-48456c47265c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:43.834603 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943e383-3a11-44ae-908e-48456c47265c None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:43.835383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943e383-3a11-44ae-908e-48456c47265c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:43.836901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943e383-3a11-44ae-908e-48456c47265c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:43.861925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 368/703] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:52:43 2022] POST /identity/v3/users => generated 254 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:52:43.863798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5281055-75fb-42cb-b39c-7a531d0c4db7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:43.864143 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5281055-75fb-42cb-b39c-7a531d0c4db7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:43.864426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5281055-75fb-42cb-b39c-7a531d0c4db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:43.891749 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b5281055-75fb-42cb-b39c-7a531d0c4db7 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:43.893955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b5281055-75fb-42cb-b39c-7a531d0c4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:43.894076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f97f54-b8b0-4bc4-9816-e8c7e3ed843e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:43.944676 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab52a31-715a-4705-ba63-8a59dfebafbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:43.945513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab52a31-715a-4705-ba63-8a59dfebafbc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:43.945796 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab52a31-715a-4705-ba63-8a59dfebafbc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:43.946080 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab52a31-715a-4705-ba63-8a59dfebafbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:43.962718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab52a31-715a-4705-ba63-8a59dfebafbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:43.964794 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab52a31-715a-4705-ba63-8a59dfebafbc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:43.982520 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 369/704] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:43.983902 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5281055-75fb-42cb-b39c-7a531d0c4db7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:43.986277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7ab52a31-715a-4705-ba63-8a59dfebafbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:43.986277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:43.986277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:43.986277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:43.986277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:43.986277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:43.986277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:43.986277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:43.986277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:43.986277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:43.986277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:43.986277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:43.986277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:43.986277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:43.986277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:43.987309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:43.993305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:43.993305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:43.993305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:43.993305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:43.993305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 336/705] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:43.996331 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab52a31-715a-4705-ba63-8a59dfebafbc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:44.059650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:44.126877 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5281055-75fb-42cb-b39c-7a531d0c4db7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:44.133209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab52a31-715a-4705-ba63-8a59dfebafbc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:44.146225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:44.179191 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf692b7-6820-4359-9b1d-cb58f3dba510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:44.180264 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf692b7-6820-4359-9b1d-cb58f3dba510 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:44.180549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf692b7-6820-4359-9b1d-cb58f3dba510 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:44.180825 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf692b7-6820-4359-9b1d-cb58f3dba510 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:44.181673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf692b7-6820-4359-9b1d-cb58f3dba510 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:44.181988 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf692b7-6820-4359-9b1d-cb58f3dba510 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:44.183493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf692b7-6820-4359-9b1d-cb58f3dba510 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:44.185167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65f319-6ec0-4433-ab6c-93f3f436b995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:44.186430 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65f319-6ec0-4433-ab6c-93f3f436b995 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:44.186926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65f319-6ec0-4433-ab6c-93f3f436b995 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:44.187401 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65f319-6ec0-4433-ab6c-93f3f436b995 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:44.188316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65f319-6ec0-4433-ab6c-93f3f436b995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:44.188835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65f319-6ec0-4433-ab6c-93f3f436b995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:44.195937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65f319-6ec0-4433-ab6c-93f3f436b995 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:44.202865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 370/706] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:44.202865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf692b7-6820-4359-9b1d-cb58f3dba510 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:44.214368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 337/707] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:44.218849 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65f319-6ec0-4433-ab6c-93f3f436b995 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:44.330061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf692b7-6820-4359-9b1d-cb58f3dba510 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:44.335473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:44.339774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65f319-6ec0-4433-ab6c-93f3f436b995 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:44.368893 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0003ea-182a-4502-af16-c28b6414efba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:44.370168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0003ea-182a-4502-af16-c28b6414efba None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:44.370758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0003ea-182a-4502-af16-c28b6414efba None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:44.371399 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0003ea-182a-4502-af16-c28b6414efba None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:44.372279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0003ea-182a-4502-af16-c28b6414efba None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:44.374005 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0003ea-182a-4502-af16-c28b6414efba None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:44.385394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8402f-b9ed-47fb-adf6-2a395f0de1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:44.385996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8402f-b9ed-47fb-adf6-2a395f0de1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:44.386279 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8402f-b9ed-47fb-adf6-2a395f0de1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:44.386557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8402f-b9ed-47fb-adf6-2a395f0de1a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:44.388235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8402f-b9ed-47fb-adf6-2a395f0de1a1 None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=e9a1ec1f6bb7467dbd63ad1da36d48a9) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:44.388665 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8402f-b9ed-47fb-adf6-2a395f0de1a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:44.390140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8402f-b9ed-47fb-adf6-2a395f0de1a1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-3f0003ea-182a-4502-af16-c28b6414efba None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:44.392455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:44.393544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:44.394457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:44.394457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:44.394457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:44.394457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:44.394457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:44.394457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:44.394457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:44.394457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:44.394457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:44.394457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:44.394457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:44.394457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:52:44.394457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:44.394457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 15:52:44.394457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:44.398386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 338/708] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:52:44 2022] GET /identity/v3/role_assignments?user.id=e9a1ec1f6bb7467dbd63ad1da36d48a9&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:44.398386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8402f-b9ed-47fb-adf6-2a395f0de1a1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:44.405994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 371/709] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Jul 21 15:52:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:44.408398 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0003ea-182a-4502-af16-c28b6414efba None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:44.524000 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:44.581167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8402f-b9ed-47fb-adf6-2a395f0de1a1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:44.638573 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701728b7-f8b5-4685-90dd-24e2630bdc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:44.639350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701728b7-f8b5-4685-90dd-24e2630bdc7a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:44.639632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701728b7-f8b5-4685-90dd-24e2630bdc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:44.639912 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701728b7-f8b5-4685-90dd-24e2630bdc7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:44.642464 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0003ea-182a-4502-af16-c28b6414efba None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:44.658876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701728b7-f8b5-4685-90dd-24e2630bdc7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:44.658876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701728b7-f8b5-4685-90dd-24e2630bdc7a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:44.677811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-701728b7-f8b5-4685-90dd-24e2630bdc7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:44.677811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:44.677811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:44.677811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:44.677811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:44.677811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:44.677811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:44.677811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:44.677811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:44.677811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:44.677811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:44.677811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:44.677811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:44.677811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:44.677811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:44.678879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:44.679861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:44.679861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:44.679861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:44.679861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:44.679861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:44.679861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:44.679861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:44.679861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:44.683854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 339/710] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:44.689517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701728b7-f8b5-4685-90dd-24e2630bdc7a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:44.713516 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb4e22-30ac-4246-8230-ab124bb2c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:44.714677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb4e22-30ac-4246-8230-ab124bb2c9cb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:44.714990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb4e22-30ac-4246-8230-ab124bb2c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:44.715531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb4e22-30ac-4246-8230-ab124bb2c9cb None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:44.716272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb4e22-30ac-4246-8230-ab124bb2c9cb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:44.719208 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb4e22-30ac-4246-8230-ab124bb2c9cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:44.720864 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb4e22-30ac-4246-8230-ab124bb2c9cb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:44.729976 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 372/711] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 21 15:52:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:44.734740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:44.735653 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb4e22-30ac-4246-8230-ab124bb2c9cb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:44.852993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701728b7-f8b5-4685-90dd-24e2630bdc7a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:44.881518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb4e22-30ac-4246-8230-ab124bb2c9cb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:44.883765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:44.896839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bb31c6-aca9-49c4-ac08-915a07ffc72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:44.897527 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb31c6-aca9-49c4-ac08-915a07ffc72e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:44.897876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb31c6-aca9-49c4-ac08-915a07ffc72e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:44.898233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bb31c6-aca9-49c4-ac08-915a07ffc72e None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:44.899124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb31c6-aca9-49c4-ac08-915a07ffc72e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:44.899504 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb31c6-aca9-49c4-ac08-915a07ffc72e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:44.901018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bb31c6-aca9-49c4-ac08-915a07ffc72e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:44.914693 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 340/712] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:44.916982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a59ec-1f33-4536-8cda-ada4328a064f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:44.917583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a59ec-1f33-4536-8cda-ada4328a064f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:44.918028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a59ec-1f33-4536-8cda-ada4328a064f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:44.920332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 341/713] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:44.921226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a59ec-1f33-4536-8cda-ada4328a064f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:44.925752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefa48d-d4de-4173-8085-dfc101e41468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:44.927111 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefa48d-d4de-4173-8085-dfc101e41468 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:44.927575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefa48d-d4de-4173-8085-dfc101e41468 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:44.928045 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefa48d-d4de-4173-8085-dfc101e41468 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:44.928969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefa48d-d4de-4173-8085-dfc101e41468 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:44.929457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefa48d-d4de-4173-8085-dfc101e41468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:44.931224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefa48d-d4de-4173-8085-dfc101e41468 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:44.938580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 373/714] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 21 15:52:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:44.940334 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1a44-4f35-4f85-9d46-73bb460a69dc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:44.940828 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1a44-4f35-4f85-9d46-73bb460a69dc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:44.941270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aba1a44-4f35-4f85-9d46-73bb460a69dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:44.972702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9aba1a44-4f35-4f85-9d46-73bb460a69dc None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:44.974359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9aba1a44-4f35-4f85-9d46-73bb460a69dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:45.054471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 374/715] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:45.066622 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:45.087768 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a59ec-1f33-4536-8cda-ada4328a064f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:45.088793 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba1a44-4f35-4f85-9d46-73bb460a69dc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:45.133767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38333484-70b4-4ccf-a712-a1814e967904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:45.134642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38333484-70b4-4ccf-a712-a1814e967904 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:45.135072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38333484-70b4-4ccf-a712-a1814e967904 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:45.135483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38333484-70b4-4ccf-a712-a1814e967904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:45.136921 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38333484-70b4-4ccf-a712-a1814e967904 None admin] RBAC: Adding query filter params (role.id=ae7cbb39ab61467ba1976a753ba6693c, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=dcee349bdb2640609cc71fb1c65794f1) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:45.137235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38333484-70b4-4ccf-a712-a1814e967904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:45.138943 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38333484-70b4-4ccf-a712-a1814e967904 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:45.149742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 342/716] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:52:44 2022] GET /identity/v3/role_assignments?user.id=dcee349bdb2640609cc71fb1c65794f1&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=ae7cbb39ab61467ba1976a753ba6693c => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:45.234408 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:45.244155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aba1a44-4f35-4f85-9d46-73bb460a69dc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:45.285195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed182b6a-ccaa-4338-8269-e32bf56c4fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:45.286037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed182b6a-ccaa-4338-8269-e32bf56c4fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:45.286316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed182b6a-ccaa-4338-8269-e32bf56c4fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:45.286587 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed182b6a-ccaa-4338-8269-e32bf56c4fe5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:45.287299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed182b6a-ccaa-4338-8269-e32bf56c4fe5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:45.288772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed182b6a-ccaa-4338-8269-e32bf56c4fe5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-ed182b6a-ccaa-4338-8269-e32bf56c4fe5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:45.301882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:45.302997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:45.303842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:45.303842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:45.303842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:45.303842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:45.303842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:45.303842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:45.303842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:45.303842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:45.303842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:45.303842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:45.303842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:52:45.303842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:45.303842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 15:52:45.303842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:45.303842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 375/717] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:45 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:45.310877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38333484-70b4-4ccf-a712-a1814e967904 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:45.425973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38333484-70b4-4ccf-a712-a1814e967904 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:45.460090 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045b355-1935-4867-8c1d-6ee7581e60e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:45.460775 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045b355-1935-4867-8c1d-6ee7581e60e8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:45.461056 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045b355-1935-4867-8c1d-6ee7581e60e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:45.461329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045b355-1935-4867-8c1d-6ee7581e60e8 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:45.462040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045b355-1935-4867-8c1d-6ee7581e60e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:45.462344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045b355-1935-4867-8c1d-6ee7581e60e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:45.463823 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045b355-1935-4867-8c1d-6ee7581e60e8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:45.469446 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 343/718] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 15:52:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:45.475144 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed182b6a-ccaa-4338-8269-e32bf56c4fe5 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:45.590342 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed182b6a-ccaa-4338-8269-e32bf56c4fe5 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:45.626702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec6e40-4794-4244-a903-883d63eca464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:45.627885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec6e40-4794-4244-a903-883d63eca464 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:45.628409 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec6e40-4794-4244-a903-883d63eca464 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:45.628962 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec6e40-4794-4244-a903-883d63eca464 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:45.629974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec6e40-4794-4244-a903-883d63eca464 None admin] RBAC: Adding query filter params (type=network) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:45.630525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec6e40-4794-4244-a903-883d63eca464 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:45.632174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec6e40-4794-4244-a903-883d63eca464 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:45.638151 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 376/719] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 15:52:45 2022] GET /identity/v3/services?type=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:46.156219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389200f-8a57-467e-b89e-504113566141 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:46.156574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389200f-8a57-467e-b89e-504113566141 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:46.156899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389200f-8a57-467e-b89e-504113566141 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:46.158565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 344/720] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:46.165029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926a443-b61f-482c-999e-0865e040de79 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:46.165533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926a443-b61f-482c-999e-0865e040de79 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:46.165946 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926a443-b61f-482c-999e-0865e040de79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:46.203016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c926a443-b61f-482c-999e-0865e040de79 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:46.204228 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c926a443-b61f-482c-999e-0865e040de79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:46.227630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:46.298715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 377/721] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:46.330184 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389200f-8a57-467e-b89e-504113566141 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:46.350293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:46.474399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389200f-8a57-467e-b89e-504113566141 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:46.510090 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b8227-8ce1-41d1-ab57-3387e2dd5b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:46.510938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b8227-8ce1-41d1-ab57-3387e2dd5b64 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:46.511227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b8227-8ce1-41d1-ab57-3387e2dd5b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:46.511505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b8227-8ce1-41d1-ab57-3387e2dd5b64 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:46.522601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b8227-8ce1-41d1-ab57-3387e2dd5b64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-cc0b8227-8ce1-41d1-ab57-3387e2dd5b64 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:46.530499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:46.531480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:46.532309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:46.532309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:46.532309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:46.532309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:46.532309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:46.532309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:46.532309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:46.532309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:46.532309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:46.532309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:46.532309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:46.532309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:46.532309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 345/722] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:46.539174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926a443-b61f-482c-999e-0865e040de79 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:46.682711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926a443-b61f-482c-999e-0865e040de79 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:46.726167 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c473b-b156-4136-92e9-ed4ad1e49412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:46.726797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c473b-b156-4136-92e9-ed4ad1e49412 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:46.727077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c473b-b156-4136-92e9-ed4ad1e49412 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:46.727351 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c473b-b156-4136-92e9-ed4ad1e49412 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:46.728106 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c473b-b156-4136-92e9-ed4ad1e49412 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:46.728410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c473b-b156-4136-92e9-ed4ad1e49412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:46.729790 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c473b-b156-4136-92e9-ed4ad1e49412 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:46.738485 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 378/723] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:46.747923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b8227-8ce1-41d1-ab57-3387e2dd5b64 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:46.833384 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:46.855553 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373b595-12fc-4532-8b98-c971311d0ce7 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:46.856386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373b595-12fc-4532-8b98-c971311d0ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:46.856885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373b595-12fc-4532-8b98-c971311d0ce7 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:46.858573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 379/724] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:52:46.864115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf27414-8f54-46a2-8bd0-2034b31b5e4f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:46.864682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf27414-8f54-46a2-8bd0-2034b31b5e4f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:46.865565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf27414-8f54-46a2-8bd0-2034b31b5e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:46.871219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b8227-8ce1-41d1-ab57-3387e2dd5b64 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:46.901521 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3bf27414-8f54-46a2-8bd0-2034b31b5e4f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:46.903858 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3bf27414-8f54-46a2-8bd0-2034b31b5e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:46.927129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:46.940868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34962b54-23ff-4a64-aec8-58badf99fcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:46.942058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34962b54-23ff-4a64-aec8-58badf99fcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:46.943439 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34962b54-23ff-4a64-aec8-58badf99fcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:46.946555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34962b54-23ff-4a64-aec8-58badf99fcb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:46.966036 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34962b54-23ff-4a64-aec8-58badf99fcb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:46.968585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34962b54-23ff-4a64-aec8-58badf99fcb6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:47.000761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-34962b54-23ff-4a64-aec8-58badf99fcb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:47.000761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:47.000761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:47.000761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:47.000761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:47.000761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:47.000761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:47.000761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:47.000761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:47.000761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:47.000761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:47.000761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:47.000761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:47.000761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:47.000761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:47.001973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:47.003197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:47.003197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:47.003197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:47.003197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:47.008328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 346/725] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:47.016273 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34962b54-23ff-4a64-aec8-58badf99fcb6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:47.043861 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 380/726] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 15:52:47.085496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf27414-8f54-46a2-8bd0-2034b31b5e4f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:47.203140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34962b54-23ff-4a64-aec8-58badf99fcb6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:47.230317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:47.248648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e680726-6595-4e8e-bd21-ca3a484e99ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:47.249620 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e680726-6595-4e8e-bd21-ca3a484e99ab None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:47.251205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e680726-6595-4e8e-bd21-ca3a484e99ab None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:47.251641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e680726-6595-4e8e-bd21-ca3a484e99ab None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:47.252525 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e680726-6595-4e8e-bd21-ca3a484e99ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:47.254891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e680726-6595-4e8e-bd21-ca3a484e99ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:47.256466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e680726-6595-4e8e-bd21-ca3a484e99ab None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:47.283337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 347/727] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:47.289022 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e680726-6595-4e8e-bd21-ca3a484e99ab None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:47.294142 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf27414-8f54-46a2-8bd0-2034b31b5e4f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:47.338364 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a40ca7-5a76-4242-8c19-6ecff1a9f18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:47.342106 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a40ca7-5a76-4242-8c19-6ecff1a9f18c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:47.342557 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a40ca7-5a76-4242-8c19-6ecff1a9f18c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:47.343005 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a40ca7-5a76-4242-8c19-6ecff1a9f18c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:47.363769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a40ca7-5a76-4242-8c19-6ecff1a9f18c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-84a40ca7-5a76-4242-8c19-6ecff1a9f18c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:47.374592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:47.375757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:47.376797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:47.376797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:47.376797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:47.376797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:47.376797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:47.376797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:47.376797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:47.376797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:47.376797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:47.376797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:47.376797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:47.376797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:47.384023 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 381/728] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:52:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:47.385476 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a40ca7-5a76-4242-8c19-6ecff1a9f18c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:47.395391 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:47.494587 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a40ca7-5a76-4242-8c19-6ecff1a9f18c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:47.529609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e680726-6595-4e8e-bd21-ca3a484e99ab None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:47.540433 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24941f58-2a80-4777-b28b-e7ae4e120505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:47.541878 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24941f58-2a80-4777-b28b-e7ae4e120505 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:47.542640 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24941f58-2a80-4777-b28b-e7ae4e120505 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:47.543157 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24941f58-2a80-4777-b28b-e7ae4e120505 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:47.544385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24941f58-2a80-4777-b28b-e7ae4e120505 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:47.545410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24941f58-2a80-4777-b28b-e7ae4e120505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:47.547618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24941f58-2a80-4777-b28b-e7ae4e120505 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:47.560786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 382/729] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:47.562627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759738a0-8c02-4e59-b06d-58c375d5bf1e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:47.563157 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759738a0-8c02-4e59-b06d-58c375d5bf1e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:47.563659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759738a0-8c02-4e59-b06d-58c375d5bf1e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:47.569817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 383/730] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:47.569817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759738a0-8c02-4e59-b06d-58c375d5bf1e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:47.579570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f959fdb-0337-4a6c-a9f4-96cc79eab0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:47.581294 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f959fdb-0337-4a6c-a9f4-96cc79eab0d0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:47.581806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f959fdb-0337-4a6c-a9f4-96cc79eab0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:47.582692 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f959fdb-0337-4a6c-a9f4-96cc79eab0d0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:47.593525 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f959fdb-0337-4a6c-a9f4-96cc79eab0d0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:47.595891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f959fdb-0337-4a6c-a9f4-96cc79eab0d0 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9f959fdb-0337-4a6c-a9f4-96cc79eab0d0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:47.618804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:47.619874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:47.620821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:47.620821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:47.620821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:47.620821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:47.620821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:47.620821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:47.620821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:47.620821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:47.620821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 15:52:47.620821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:47.627073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 348/731] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 15:52:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:47.627073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec8945-eb85-4326-b7a4-f8fe90ee3338 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:47.627073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec8945-eb85-4326-b7a4-f8fe90ee3338 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:47.627073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec8945-eb85-4326-b7a4-f8fe90ee3338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:47.652638 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:47.654158 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d4ec8945-eb85-4326-b7a4-f8fe90ee3338 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:47.656175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d4ec8945-eb85-4326-b7a4-f8fe90ee3338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:47.694149 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759738a0-8c02-4e59-b06d-58c375d5bf1e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:47.711813 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:47.731583 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436e485-ab67-47d8-9db7-e267e82a175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:47.732867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436e485-ab67-47d8-9db7-e267e82a175f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:47.732867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436e485-ab67-47d8-9db7-e267e82a175f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:47.733116 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436e485-ab67-47d8-9db7-e267e82a175f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:47.745626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436e485-ab67-47d8-9db7-e267e82a175f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:47.747260 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2436e485-ab67-47d8-9db7-e267e82a175f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:47.757652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 349/732] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:47.757652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec8945-eb85-4326-b7a4-f8fe90ee3338 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:47.771819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2436e485-ab67-47d8-9db7-e267e82a175f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:47.771819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:47.771819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:47.771819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:47.771819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:47.771819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:47.771819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:47.771819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:47.771819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:47.771819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:47.771819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:47.771819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:47.771819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:47.771819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:47.771819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:47.772799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:47.773688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:47.773688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:47.773688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:47.773688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:47.777755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 384/733] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:47.783734 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436e485-ab67-47d8-9db7-e267e82a175f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:47.898688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2436e485-ab67-47d8-9db7-e267e82a175f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:47.910717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec8945-eb85-4326-b7a4-f8fe90ee3338 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:47.928115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:47.947795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d483b7c-f84b-4375-a18a-d98d02ab037d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:47.948956 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d483b7c-f84b-4375-a18a-d98d02ab037d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:47.949445 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d483b7c-f84b-4375-a18a-d98d02ab037d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:47.949899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d483b7c-f84b-4375-a18a-d98d02ab037d None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:47.950003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaa92b-aea7-4f6e-bddc-38712f9b1c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:47.950733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaa92b-aea7-4f6e-bddc-38712f9b1c93 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:47.951160 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d483b7c-f84b-4375-a18a-d98d02ab037d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:47.951265 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaa92b-aea7-4f6e-bddc-38712f9b1c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:47.951500 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaa92b-aea7-4f6e-bddc-38712f9b1c93 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:47.951910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d483b7c-f84b-4375-a18a-d98d02ab037d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:47.952461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaa92b-aea7-4f6e-bddc-38712f9b1c93 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:47.952827 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaa92b-aea7-4f6e-bddc-38712f9b1c93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:47.953853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d483b7c-f84b-4375-a18a-d98d02ab037d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:47.954396 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaa92b-aea7-4f6e-bddc-38712f9b1c93 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:47.975600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 385/734] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:47.976669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d483b7c-f84b-4375-a18a-d98d02ab037d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:47.987808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 350/735] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 21 15:52:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:47.988145 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaa92b-aea7-4f6e-bddc-38712f9b1c93 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:48.032134 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:48.089141 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d483b7c-f84b-4375-a18a-d98d02ab037d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:48.127803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaa92b-aea7-4f6e-bddc-38712f9b1c93 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:48.134099 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468184c-e1b1-4c52-8b20-a502d289770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:48.134780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468184c-e1b1-4c52-8b20-a502d289770a None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:48.135090 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468184c-e1b1-4c52-8b20-a502d289770a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:48.135366 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6468184c-e1b1-4c52-8b20-a502d289770a None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:48.136100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468184c-e1b1-4c52-8b20-a502d289770a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:48.137564 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6468184c-e1b1-4c52-8b20-a502d289770a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:48.162843 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 386/736] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 15:52:47 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:52:48.162843 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468184c-e1b1-4c52-8b20-a502d289770a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:48.188121 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1c89a-9684-40af-947c-b4e81182c0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:48.189021 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1c89a-9684-40af-947c-b4e81182c0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:48.189314 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1c89a-9684-40af-947c-b4e81182c0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:48.189593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1c89a-9684-40af-947c-b4e81182c0e8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:48.197942 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1c89a-9684-40af-947c-b4e81182c0e8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:48.199505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1c89a-9684-40af-947c-b4e81182c0e8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:48.209193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-91d1c89a-9684-40af-947c-b4e81182c0e8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:48.215730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:48.216835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:48.218433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:48.218433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:48.218433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:48.218433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:48.218433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:48.218433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:48.218433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:48.218433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:48.218433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:52:48.218433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:48.218433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 351/737] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 15:52:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:48.219079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b390b7-bd11-42ee-a6c6-799a24c7cc3e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:48.219079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b390b7-bd11-42ee-a6c6-799a24c7cc3e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:48.219431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b390b7-bd11-42ee-a6c6-799a24c7cc3e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:48.225113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 352/738] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:48.225113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff2d73-7ce8-490d-ba85-ec2d641a2669 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:48.225113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff2d73-7ce8-490d-ba85-ec2d641a2669 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:48.225113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff2d73-7ce8-490d-ba85-ec2d641a2669 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:48.225113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 353/739] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:48.225765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff2d73-7ce8-490d-ba85-ec2d641a2669 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:48.285547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6468184c-e1b1-4c52-8b20-a502d289770a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:48.324146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bf25e-c7dd-4b63-a47a-05037f34ce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:48.324954 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bf25e-c7dd-4b63-a47a-05037f34ce00 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:48.325144 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bf25e-c7dd-4b63-a47a-05037f34ce00 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:48.325419 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6bf25e-c7dd-4b63-a47a-05037f34ce00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:48.331094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:48.349019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff2d73-7ce8-490d-ba85-ec2d641a2669 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:48.390416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d050fe-d76e-40cc-9dd5-67693d4b4ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:48.391260 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d050fe-d76e-40cc-9dd5-67693d4b4ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:48.391543 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d050fe-d76e-40cc-9dd5-67693d4b4ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:48.392037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d050fe-d76e-40cc-9dd5-67693d4b4ff9 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:48.392810 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d050fe-d76e-40cc-9dd5-67693d4b4ff9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:48.393122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d050fe-d76e-40cc-9dd5-67693d4b4ff9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:48.394747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d050fe-d76e-40cc-9dd5-67693d4b4ff9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:48.401641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bf25e-c7dd-4b63-a47a-05037f34ce00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:48.403061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6bf25e-c7dd-4b63-a47a-05037f34ce00 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:48.419138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 354/740] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 15:52:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:48.419138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2f2be-b7fe-4fb4-b0fb-06b14a893622 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:48.419138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2f2be-b7fe-4fb4-b0fb-06b14a893622 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:48.419138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2f2be-b7fe-4fb4-b0fb-06b14a893622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:48.435910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-20e2f2be-b7fe-4fb4-b0fb-06b14a893622 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:48.437109 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-20e2f2be-b7fe-4fb4-b0fb-06b14a893622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:48.451386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:48.515599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 355/741] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:48.515599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6448e2c-bbc5-4596-89c2-fc0d492624c1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:48.515599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6448e2c-bbc5-4596-89c2-fc0d492624c1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:48.515599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6448e2c-bbc5-4596-89c2-fc0d492624c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:48.524424 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 387/742] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:48 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 15:52:48.525408 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bf25e-c7dd-4b63-a47a-05037f34ce00 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:48.535917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c6448e2c-bbc5-4596-89c2-fc0d492624c1 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:48.537131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c6448e2c-bbc5-4596-89c2-fc0d492624c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:48.622937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 356/743] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:48 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 15:52:48.622937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6448e2c-bbc5-4596-89c2-fc0d492624c1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:48.630143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:48.646402 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6bf25e-c7dd-4b63-a47a-05037f34ce00 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:48.687994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23722e-bf04-4725-b732-e2d5e7650c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:48.688828 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23722e-bf04-4725-b732-e2d5e7650c76 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:48.689091 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23722e-bf04-4725-b732-e2d5e7650c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:48.689371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23722e-bf04-4725-b732-e2d5e7650c76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:48.697986 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:48.700403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23722e-bf04-4725-b732-e2d5e7650c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:48.701945 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23722e-bf04-4725-b732-e2d5e7650c76 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:48.720601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-1c23722e-bf04-4725-b732-e2d5e7650c76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:48.720601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:48.720601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:48.720601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:48.720601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:48.720601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:48.720601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:48.720601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:48.720601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:48.720601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:48.720601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:48.720601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:48.720601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:48.720601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:48.720601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:48.721810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:48.722730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:48.722730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:48.722730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:48.722730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:48.722730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 388/744] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:48.723101 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23722e-bf04-4725-b732-e2d5e7650c76 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:48.739320 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6448e2c-bbc5-4596-89c2-fc0d492624c1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:48.779641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cd4a9-3425-4002-a696-31d942de918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:48.780631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cd4a9-3425-4002-a696-31d942de918c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:48.781315 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cd4a9-3425-4002-a696-31d942de918c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:48.781596 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cd4a9-3425-4002-a696-31d942de918c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:48.793655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cd4a9-3425-4002-a696-31d942de918c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:48.795174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cd4a9-3425-4002-a696-31d942de918c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:48.815436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-989cd4a9-3425-4002-a696-31d942de918c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:48.815436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:48.815436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:48.815436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:48.815436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:48.815436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:48.815436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:48.815436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:48.815436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:48.815436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:48.815436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:48.815436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:48.815436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:48.815436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:48.815436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:48.816454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:48.817923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:48.817923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:48.817923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:48.817923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:48.817923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 357/745] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:48.818337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cd4a9-3425-4002-a696-31d942de918c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:48.842089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23722e-bf04-4725-b732-e2d5e7650c76 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:48.882536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3a72d-aa49-498d-b851-ba6b82dc3305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:48.883192 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3a72d-aa49-498d-b851-ba6b82dc3305 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:48.883325 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:48.883474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3a72d-aa49-498d-b851-ba6b82dc3305 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:48.883752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3a72d-aa49-498d-b851-ba6b82dc3305 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:48.884549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3a72d-aa49-498d-b851-ba6b82dc3305 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:48.886047 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3a72d-aa49-498d-b851-ba6b82dc3305 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:48.902315 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 389/746] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 15:52:48 2022] POST /identity/v3/services => generated 240 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:52:48.903511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3a72d-aa49-498d-b851-ba6b82dc3305 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:48.933981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cd4a9-3425-4002-a696-31d942de918c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:48.980171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e4112-de3d-47f1-96e1-e1734c048061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:48.981408 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e4112-de3d-47f1-96e1-e1734c048061 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:48.981828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e4112-de3d-47f1-96e1-e1734c048061 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:48.982135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e4112-de3d-47f1-96e1-e1734c048061 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:48.990726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:48.996816 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e4112-de3d-47f1-96e1-e1734c048061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-809e4112-de3d-47f1-96e1-e1734c048061 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:49.007938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:49.009082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:49.010599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:49.010599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:49.010599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:49.010599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:49.010599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:49.010599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:49.010599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:49.010599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:49.010599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:49.010599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:49.010599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:49.010599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:49.010599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 358/747] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:52:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:49.010599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e4112-de3d-47f1-96e1-e1734c048061 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:49.062716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3a72d-aa49-498d-b851-ba6b82dc3305 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:49.112976 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199ae9a-d5c3-4df9-a616-db728f889428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:49.113669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199ae9a-d5c3-4df9-a616-db728f889428 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:49.113956 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199ae9a-d5c3-4df9-a616-db728f889428 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:49.114236 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199ae9a-d5c3-4df9-a616-db728f889428 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:49.115501 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199ae9a-d5c3-4df9-a616-db728f889428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:49.115814 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199ae9a-d5c3-4df9-a616-db728f889428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:49.117244 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199ae9a-d5c3-4df9-a616-db728f889428 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:49.136780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 390/748] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:49.136780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199ae9a-d5c3-4df9-a616-db728f889428 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:49.152374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e4112-de3d-47f1-96e1-e1734c048061 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:49.169576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:49.201950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9776ef3-850d-4afd-9604-e18c975a4e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:49.202909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9776ef3-850d-4afd-9604-e18c975a4e8b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:49.203343 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9776ef3-850d-4afd-9604-e18c975a4e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:49.203783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9776ef3-850d-4afd-9604-e18c975a4e8b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:49.204791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9776ef3-850d-4afd-9604-e18c975a4e8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:49.205336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9776ef3-850d-4afd-9604-e18c975a4e8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:49.206980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9776ef3-850d-4afd-9604-e18c975a4e8b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:49.221412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 359/749] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:49.222883 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9776ef3-850d-4afd-9604-e18c975a4e8b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:49.256512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199ae9a-d5c3-4df9-a616-db728f889428 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:49.271292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:49.295080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ee6f3-d3a7-4289-bc92-fba69d844e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:49.295778 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ee6f3-d3a7-4289-bc92-fba69d844e16 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:49.296056 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ee6f3-d3a7-4289-bc92-fba69d844e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:49.296327 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ee6f3-d3a7-4289-bc92-fba69d844e16 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:49.297397 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ee6f3-d3a7-4289-bc92-fba69d844e16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:49.297719 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ee6f3-d3a7-4289-bc92-fba69d844e16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:49.299296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ee6f3-d3a7-4289-bc92-fba69d844e16 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:49.310920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 391/750] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:49.311391 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ee6f3-d3a7-4289-bc92-fba69d844e16 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:49.347250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9776ef3-850d-4afd-9604-e18c975a4e8b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:49.386653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f1562-a546-4ebb-be89-0b18f56d718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:49.387653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f1562-a546-4ebb-be89-0b18f56d718a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:49.387950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f1562-a546-4ebb-be89-0b18f56d718a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:49.388301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f1562-a546-4ebb-be89-0b18f56d718a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:49.396128 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f1562-a546-4ebb-be89-0b18f56d718a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:49.397827 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f1562-a546-4ebb-be89-0b18f56d718a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:49.413219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d68f1562-a546-4ebb-be89-0b18f56d718a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:49.413219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:49.413219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:49.413219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:49.413219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:49.413219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:49.413219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:49.413219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:49.413219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:49.413219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:49.413219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:49.413219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:49.413219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:49.413219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:49.413219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:49.414335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:49.415328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:49.415328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:49.415328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:49.415328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:49.415328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:49.415328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:49.415328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:49.415328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:49.420245 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 360/751] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:49.421201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f1562-a546-4ebb-be89-0b18f56d718a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:49.431868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ee6f3-d3a7-4289-bc92-fba69d844e16 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:49.459883 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:49.471404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303dc76-b46b-4ff6-aa0a-ba45af76cd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:49.472555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303dc76-b46b-4ff6-aa0a-ba45af76cd09 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:49.472979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303dc76-b46b-4ff6-aa0a-ba45af76cd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:49.473422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303dc76-b46b-4ff6-aa0a-ba45af76cd09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:49.489202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303dc76-b46b-4ff6-aa0a-ba45af76cd09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:49.491634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303dc76-b46b-4ff6-aa0a-ba45af76cd09 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:49.507862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2303dc76-b46b-4ff6-aa0a-ba45af76cd09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:49.507862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:49.507862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:49.507862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:49.507862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:49.507862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:49.507862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:49.507862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:49.507862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:49.507862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:49.507862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:49.507862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:49.507862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:49.507862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:49.507862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:49.509058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:49.510120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:49.510120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:49.510120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:49.510120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:49.510120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:49.510120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:49.510120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:49.510120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:49.512495 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 392/752] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:49.513775 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303dc76-b46b-4ff6-aa0a-ba45af76cd09 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:49.534390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f1562-a546-4ebb-be89-0b18f56d718a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:49.551983 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:49.573082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed36d2-c389-4929-90d5-bb16a04ee946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:49.573899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed36d2-c389-4929-90d5-bb16a04ee946 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:49.574181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed36d2-c389-4929-90d5-bb16a04ee946 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:49.574453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed36d2-c389-4929-90d5-bb16a04ee946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:49.586738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed36d2-c389-4929-90d5-bb16a04ee946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:49.588240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed36d2-c389-4929-90d5-bb16a04ee946 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:49.607354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-58ed36d2-c389-4929-90d5-bb16a04ee946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:49.607354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:49.607354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:49.607354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:49.607354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:49.607354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:49.607354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:49.607354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:49.607354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:49.607354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:49.607354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:49.607354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:49.607354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:49.607354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:49.607354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:49.608666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:49.609717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:49.609717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:49.609717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:49.609717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:49.613600 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 361/753] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:49.614628 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed36d2-c389-4929-90d5-bb16a04ee946 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:49.632746 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303dc76-b46b-4ff6-aa0a-ba45af76cd09 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:49.671677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc18f2b-cf7f-4a3c-a301-b2f89559c804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:49.672752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc18f2b-cf7f-4a3c-a301-b2f89559c804 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:49.673307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc18f2b-cf7f-4a3c-a301-b2f89559c804 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:49.673790 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc18f2b-cf7f-4a3c-a301-b2f89559c804 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:49.674900 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc18f2b-cf7f-4a3c-a301-b2f89559c804 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:49.675433 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc18f2b-cf7f-4a3c-a301-b2f89559c804 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:49.677459 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc18f2b-cf7f-4a3c-a301-b2f89559c804 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:49.692648 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 393/754] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:49.694015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc18f2b-cf7f-4a3c-a301-b2f89559c804 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:49.716832 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:49.735123 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed36d2-c389-4929-90d5-bb16a04ee946 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:49.776575 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1f48-2722-44cd-b1d0-60d7bb6e933c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:49.777368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1f48-2722-44cd-b1d0-60d7bb6e933c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:49.777606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1f48-2722-44cd-b1d0-60d7bb6e933c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:49.777899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1f48-2722-44cd-b1d0-60d7bb6e933c None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:49.778750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a1f48-2722-44cd-b1d0-60d7bb6e933c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:49.779111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a1f48-2722-44cd-b1d0-60d7bb6e933c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:49.780887 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a1f48-2722-44cd-b1d0-60d7bb6e933c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:49.795832 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 362/755] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:49.796863 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1f48-2722-44cd-b1d0-60d7bb6e933c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:49.828484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:49.838416 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc18f2b-cf7f-4a3c-a301-b2f89559c804 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:49.887571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007da839-da63-4d14-98cd-da3cbfd3b46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:49.888997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007da839-da63-4d14-98cd-da3cbfd3b46a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:49.889485 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007da839-da63-4d14-98cd-da3cbfd3b46a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:49.890237 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007da839-da63-4d14-98cd-da3cbfd3b46a None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:49.891503 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007da839-da63-4d14-98cd-da3cbfd3b46a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:49.892055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007da839-da63-4d14-98cd-da3cbfd3b46a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:49.894368 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007da839-da63-4d14-98cd-da3cbfd3b46a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:49.913195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 394/756] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:49.915171 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007da839-da63-4d14-98cd-da3cbfd3b46a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:49.918427 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1f48-2722-44cd-b1d0-60d7bb6e933c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:49.963760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2c8d2-005a-46d0-ac08-89757c627dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:49.965191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2c8d2-005a-46d0-ac08-89757c627dbc None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:49.966189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2c8d2-005a-46d0-ac08-89757c627dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:49.967250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2c8d2-005a-46d0-ac08-89757c627dbc None admin] PATH_INFO: `/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/e9a1ec1f6bb7467dbd63ad1da36d48a9/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:49.969779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2c8d2-005a-46d0-ac08-89757c627dbc None admin] RBAC: Authorizing `identity:create_grant(project_id=0d717ed2993d4a3ab21195028a16e747, user_id=e9a1ec1f6bb7467dbd63ad1da36d48a9, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:49.971632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2c8d2-005a-46d0-ac08-89757c627dbc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:49.997551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 363/757] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:52:49 2022] PUT /identity/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/e9a1ec1f6bb7467dbd63ad1da36d48a9/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:52:49.999166 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2c8d2-005a-46d0-ac08-89757c627dbc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:50.020229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:50.057293 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007da839-da63-4d14-98cd-da3cbfd3b46a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:50.102412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27e628-97ce-47b8-accd-2aef67e7354b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:50.103510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27e628-97ce-47b8-accd-2aef67e7354b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:50.103799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27e628-97ce-47b8-accd-2aef67e7354b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:50.104076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27e628-97ce-47b8-accd-2aef67e7354b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:50.106160 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27e628-97ce-47b8-accd-2aef67e7354b None admin] RBAC: Adding query filter params (role.id=ae7cbb39ab61467ba1976a753ba6693c, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=8d1d0d0f2d544d41a86f1e0dda8d110c) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:50.106160 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27e628-97ce-47b8-accd-2aef67e7354b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:50.111824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27e628-97ce-47b8-accd-2aef67e7354b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:50.124510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 395/758] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:52:49 2022] GET /identity/v3/role_assignments?user.id=8d1d0d0f2d544d41a86f1e0dda8d110c&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=ae7cbb39ab61467ba1976a753ba6693c => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:50.202469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2c8d2-005a-46d0-ac08-89757c627dbc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:50.244908 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b521604-29f1-4bd1-acd1-2794137b37a6 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:50.245103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b521604-29f1-4bd1-acd1-2794137b37a6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:50.245372 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b521604-29f1-4bd1-acd1-2794137b37a6 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:50.247027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 396/759] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:52:50.253314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3389ad7-fd6f-4722-b2e3-00eff31fb78d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:50.253756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3389ad7-fd6f-4722-b2e3-00eff31fb78d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:50.254142 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3389ad7-fd6f-4722-b2e3-00eff31fb78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:50.264434 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b407356-6156-49c7-a5c6-3294321f6b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:50.266008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b407356-6156-49c7-a5c6-3294321f6b18 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:50.266637 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b407356-6156-49c7-a5c6-3294321f6b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:50.268111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b407356-6156-49c7-a5c6-3294321f6b18 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:50.275158 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e3389ad7-fd6f-4722-b2e3-00eff31fb78d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:50.276565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e3389ad7-fd6f-4722-b2e3-00eff31fb78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:50.288040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b407356-6156-49c7-a5c6-3294321f6b18 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:50.289873 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b407356-6156-49c7-a5c6-3294321f6b18 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:50.316002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4b407356-6156-49c7-a5c6-3294321f6b18 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:50.317604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:50.321044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:50.322250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:50.322250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:50.322250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:50.322250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:50.322250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:50.322250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:50.322250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:50.322250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:50.322250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 15:52:50.322250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:50.322250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 364/760] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:52:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:50.327812 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b407356-6156-49c7-a5c6-3294321f6b18 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:50.380531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 397/761] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:52:50.407430 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3389ad7-fd6f-4722-b2e3-00eff31fb78d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:50.408658 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:50.452850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b407356-6156-49c7-a5c6-3294321f6b18 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:50.515445 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3389ad7-fd6f-4722-b2e3-00eff31fb78d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:50.516341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5f997-9796-4a12-aa43-261b42eca8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:50.517325 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5f997-9796-4a12-aa43-261b42eca8ef None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:50.517845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5f997-9796-4a12-aa43-261b42eca8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:50.518393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5f997-9796-4a12-aa43-261b42eca8ef None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:50.519610 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5f997-9796-4a12-aa43-261b42eca8ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:50.520231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5f997-9796-4a12-aa43-261b42eca8ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:50.521953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5f997-9796-4a12-aa43-261b42eca8ef None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:50.552824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67443589-dddb-48ac-867d-1ae2202a0e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:50.553651 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67443589-dddb-48ac-867d-1ae2202a0e80 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:50.553933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67443589-dddb-48ac-867d-1ae2202a0e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:50.554210 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67443589-dddb-48ac-867d-1ae2202a0e80 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:50.554706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 365/762] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 21 15:52:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:50.555784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67443589-dddb-48ac-867d-1ae2202a0e80 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:50.558854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67443589-dddb-48ac-867d-1ae2202a0e80 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:50.560360 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5f997-9796-4a12-aa43-261b42eca8ef None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-67443589-dddb-48ac-867d-1ae2202a0e80 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:50.570356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:50.571437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:50.577392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 398/763] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Jul 21 15:52:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:50.578251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67443589-dddb-48ac-867d-1ae2202a0e80 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:50.594669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:50.687690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67443589-dddb-48ac-867d-1ae2202a0e80 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:50.724517 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495cb79-172b-4179-8c31-844ba05e37f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:50.725193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495cb79-172b-4179-8c31-844ba05e37f8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:50.725478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495cb79-172b-4179-8c31-844ba05e37f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:50.725755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8495cb79-172b-4179-8c31-844ba05e37f8 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:50.727670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495cb79-172b-4179-8c31-844ba05e37f8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:50.727670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495cb79-172b-4179-8c31-844ba05e37f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:50.728196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8495cb79-172b-4179-8c31-844ba05e37f8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:50.737821 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 399/764] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 21 15:52:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:50.739168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495cb79-172b-4179-8c31-844ba05e37f8 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:50.800537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5f997-9796-4a12-aa43-261b42eca8ef None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:50.837302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:50.844215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6f0eb-f5b3-4137-b0f7-6ba6d885d0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:50.846805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6f0eb-f5b3-4137-b0f7-6ba6d885d0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:50.846805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6f0eb-f5b3-4137-b0f7-6ba6d885d0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:50.846805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6f0eb-f5b3-4137-b0f7-6ba6d885d0d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:50.885995 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:50.927129 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6f0eb-f5b3-4137-b0f7-6ba6d885d0d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:50.928865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6f0eb-f5b3-4137-b0f7-6ba6d885d0d1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:50.929883 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8495cb79-172b-4179-8c31-844ba05e37f8 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:51.005233 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c06d9-b4a7-46d7-bd19-08c5bf5fbe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:51.006242 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c06d9-b4a7-46d7-bd19-08c5bf5fbe40 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:51.006676 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c06d9-b4a7-46d7-bd19-08c5bf5fbe40 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:51.007164 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c06d9-b4a7-46d7-bd19-08c5bf5fbe40 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:51.008104 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c06d9-b4a7-46d7-bd19-08c5bf5fbe40 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:51.008606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c06d9-b4a7-46d7-bd19-08c5bf5fbe40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:51.012500 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c06d9-b4a7-46d7-bd19-08c5bf5fbe40 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:51.023813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 400/765] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 21 15:52:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:51.029159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c06d9-b4a7-46d7-bd19-08c5bf5fbe40 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:51.112372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 366/766] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:50 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:52:51.118256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6f0eb-f5b3-4137-b0f7-6ba6d885d0d1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:51.146666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:51.268480 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c06d9-b4a7-46d7-bd19-08c5bf5fbe40 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:51.272020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6f0eb-f5b3-4137-b0f7-6ba6d885d0d1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:51.314741 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9d916-f641-45ad-aeea-5b27cdc5d2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:51.315486 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9d916-f641-45ad-aeea-5b27cdc5d2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:51.315669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a533b-43d1-4036-b01c-1a132fd7266d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:51.315788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9d916-f641-45ad-aeea-5b27cdc5d2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:51.316034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9d916-f641-45ad-aeea-5b27cdc5d2d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:51.316500 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a533b-43d1-4036-b01c-1a132fd7266d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:51.316784 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a533b-43d1-4036-b01c-1a132fd7266d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:51.316889 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9d916-f641-45ad-aeea-5b27cdc5d2d0 None admin] RBAC: Adding query filter params (interface=public, service_id=1eed4e84213a42f083842d4446762bae, region_id=RegionOne) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:51.317058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a533b-43d1-4036-b01c-1a132fd7266d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:51.317156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9d916-f641-45ad-aeea-5b27cdc5d2d0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:51.318520 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b9d916-f641-45ad-aeea-5b27cdc5d2d0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:51.328290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a533b-43d1-4036-b01c-1a132fd7266d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:51.329505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 401/767] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 15:52:51 2022] GET /identity/v3/endpoints?service_id=1eed4e84213a42f083842d4446762bae&interface=public®ion_id=RegionOne => generated 194 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:51.329745 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a533b-43d1-4036-b01c-1a132fd7266d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:51.334928 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac97cd7-560e-43ff-b0f6-732cfb668491 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:51.335259 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac97cd7-560e-43ff-b0f6-732cfb668491 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:51.335543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac97cd7-560e-43ff-b0f6-732cfb668491 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:51.336892 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 402/768] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:51.337611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac97cd7-560e-43ff-b0f6-732cfb668491 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:51.348437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:51.356147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-973a533b-43d1-4036-b01c-1a132fd7266d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:51.356147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:51.356147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:51.356147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:51.356147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:51.356147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:51.356147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:51.356147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:51.356147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:51.356147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:51.356147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:51.356147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:51.356147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:51.356147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:51.356147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:51.357127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:51.358066 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:51.358066 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:51.358066 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:51.358066 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:51.358066 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 367/769] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:51.363850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4101e-36b4-4bfa-805c-ef529f2c5b8a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:51.364087 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4101e-36b4-4bfa-805c-ef529f2c5b8a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:51.364411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd4101e-36b4-4bfa-805c-ef529f2c5b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:51.383932 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4bd4101e-36b4-4bfa-805c-ef529f2c5b8a None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:51.385409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4bd4101e-36b4-4bfa-805c-ef529f2c5b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:51.464956 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac97cd7-560e-43ff-b0f6-732cfb668491 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:51.474917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 368/770] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:52:51.475862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4101e-36b4-4bfa-805c-ef529f2c5b8a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:51.488180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:51.514576 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0a280-d9db-4b52-b062-abf6062ca093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:51.515284 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0a280-d9db-4b52-b062-abf6062ca093 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:51.515571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0a280-d9db-4b52-b062-abf6062ca093 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:51.516114 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0a280-d9db-4b52-b062-abf6062ca093 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:51.516534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0a280-d9db-4b52-b062-abf6062ca093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:51.517950 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0a280-d9db-4b52-b062-abf6062ca093 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:51.530880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 403/771] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 15:52:51 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:51.530880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0a280-d9db-4b52-b062-abf6062ca093 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:51.640272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:51.694341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd4101e-36b4-4bfa-805c-ef529f2c5b8a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:51.711987 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0a280-d9db-4b52-b062-abf6062ca093 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:51.751872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf3bc2-e003-48a8-81b3-c8b00c254efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:51.752556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3bc2-e003-48a8-81b3-c8b00c254efe None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:51.752881 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3bc2-e003-48a8-81b3-c8b00c254efe None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:51.753159 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3bc2-e003-48a8-81b3-c8b00c254efe None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:51.753898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf3bc2-e003-48a8-81b3-c8b00c254efe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:51.754208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf3bc2-e003-48a8-81b3-c8b00c254efe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:51.756141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf3bc2-e003-48a8-81b3-c8b00c254efe None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:51.758421 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e307b5-e3e8-4a54-9237-04f5c9d97040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:51.759710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e307b5-e3e8-4a54-9237-04f5c9d97040 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:51.760229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e307b5-e3e8-4a54-9237-04f5c9d97040 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:51.760750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e307b5-e3e8-4a54-9237-04f5c9d97040 None admin] PATH_INFO: `/v3/services/network` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:51.761612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e307b5-e3e8-4a54-9237-04f5c9d97040 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:51.763334 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e307b5-e3e8-4a54-9237-04f5c9d97040 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:51.768521 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 369/772] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:51.774750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf3bc2-e003-48a8-81b3-c8b00c254efe None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-18e307b5-e3e8-4a54-9237-04f5c9d97040 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:51.776549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:51.777548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:51.778392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:51.778392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:51.778392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:51.778392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:51.778392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:51.778392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:51.778392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:51.778392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:51.778392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:51.778392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:51.778392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:52:51.778392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:51.778392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 15:52:51.778392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:51.781444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 404/773] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:51 2022] GET /identity/v3/services/network => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:51.787167 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e307b5-e3e8-4a54-9237-04f5c9d97040 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:51.847976 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:51.889695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf3bc2-e003-48a8-81b3-c8b00c254efe None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:51.910793 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e307b5-e3e8-4a54-9237-04f5c9d97040 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:51.942144 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:51.953345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ff91c-303f-42eb-b72f-0d18b19de4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:51.954501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ff91c-303f-42eb-b72f-0d18b19de4db None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:51.955023 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ff91c-303f-42eb-b72f-0d18b19de4db None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:51.955508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ff91c-303f-42eb-b72f-0d18b19de4db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:51.957024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d3064-ed56-4c63-aad6-046804edd999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:51.957718 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d3064-ed56-4c63-aad6-046804edd999 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:51.958004 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d3064-ed56-4c63-aad6-046804edd999 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:51.958280 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d3064-ed56-4c63-aad6-046804edd999 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:51.959034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d3064-ed56-4c63-aad6-046804edd999 None admin] RBAC: Adding query filter params (name=network) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:51.959346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d3064-ed56-4c63-aad6-046804edd999 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:51.960742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d3064-ed56-4c63-aad6-046804edd999 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:51.965536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ff91c-303f-42eb-b72f-0d18b19de4db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:51.967305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ff91c-303f-42eb-b72f-0d18b19de4db None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:51.976421 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 405/774] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 15:52:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:51.982053 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d3064-ed56-4c63-aad6-046804edd999 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:51.997550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ba0ff91c-303f-42eb-b72f-0d18b19de4db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:51.997550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:51.997550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:51.997550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:51.997550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:51.997550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:51.997550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:51.997550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:51.997550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:51.997550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:51.997550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:51.997550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:51.997550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:51.997550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:51.997550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:51.998714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:51.999642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:51.999642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:51.999642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:51.999642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:51.999642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:51.999642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:51.999642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:51.999642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:52.005170 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 370/775] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:52.010876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ff91c-303f-42eb-b72f-0d18b19de4db None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:52.192395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ff91c-303f-42eb-b72f-0d18b19de4db None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:52.197329 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d3064-ed56-4c63-aad6-046804edd999 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:52.246854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:52.264199 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c146181-ce53-40a9-a92b-08b7b8294c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:52.265702 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c146181-ce53-40a9-a92b-08b7b8294c0f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:52.266637 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c146181-ce53-40a9-a92b-08b7b8294c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:52.267582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c146181-ce53-40a9-a92b-08b7b8294c0f None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:52.268962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c146181-ce53-40a9-a92b-08b7b8294c0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:52.270000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c146181-ce53-40a9-a92b-08b7b8294c0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:52.270849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c17187-7f9a-4507-87eb-c92bfb61b261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:52.271742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c17187-7f9a-4507-87eb-c92bfb61b261 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:52.273410 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c146181-ce53-40a9-a92b-08b7b8294c0f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:52.273912 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c17187-7f9a-4507-87eb-c92bfb61b261 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:52.274392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c17187-7f9a-4507-87eb-c92bfb61b261 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:52.275366 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c17187-7f9a-4507-87eb-c92bfb61b261 None admin] RBAC: Adding query filter params (type=network) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:52.277659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c17187-7f9a-4507-87eb-c92bfb61b261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:52.279297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c17187-7f9a-4507-87eb-c92bfb61b261 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:52.290643 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 406/776] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 15:52:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:52.296515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c17187-7f9a-4507-87eb-c92bfb61b261 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:52.297793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 371/777] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:52.308353 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c146181-ce53-40a9-a92b-08b7b8294c0f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:52.438371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:52.457057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c146181-ce53-40a9-a92b-08b7b8294c0f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:52.499186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c17187-7f9a-4507-87eb-c92bfb61b261 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:52.500932 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a72f88-f08f-49c3-8a9a-686bbf944619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:52.501782 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a72f88-f08f-49c3-8a9a-686bbf944619 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:52.502063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a72f88-f08f-49c3-8a9a-686bbf944619 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:52.502338 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a72f88-f08f-49c3-8a9a-686bbf944619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:52.504105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a72f88-f08f-49c3-8a9a-686bbf944619 None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=dcee349bdb2640609cc71fb1c65794f1) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:52.504425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a72f88-f08f-49c3-8a9a-686bbf944619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:52.505897 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a72f88-f08f-49c3-8a9a-686bbf944619 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:52.513483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 372/778] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:52:52 2022] GET /identity/v3/role_assignments?user.id=dcee349bdb2640609cc71fb1c65794f1&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:52.515327 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b346f-7a62-49a7-b5e0-002f4b88b00f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:52.515640 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b346f-7a62-49a7-b5e0-002f4b88b00f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:52.515886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b346f-7a62-49a7-b5e0-002f4b88b00f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:52.521922 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 373/779] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:52.524289 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f1554-43ab-428d-ad6d-af7af351c299 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:52.524597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f1554-43ab-428d-ad6d-af7af351c299 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:52.524996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f1554-43ab-428d-ad6d-af7af351c299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:52.544690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04bd3e-cf52-47db-9469-2e102cf3abff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:52.545901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-953f1554-43ab-428d-ad6d-af7af351c299 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:52.546374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04bd3e-cf52-47db-9469-2e102cf3abff None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:52.546912 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04bd3e-cf52-47db-9469-2e102cf3abff None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:52.547277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-953f1554-43ab-428d-ad6d-af7af351c299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:52.547623 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04bd3e-cf52-47db-9469-2e102cf3abff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:52.548743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04bd3e-cf52-47db-9469-2e102cf3abff None admin] RBAC: Adding query filter params (interface=public, service_id=6ba76e786541438f85637fe711b9249d, region_id=RegionOne) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:52.549323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04bd3e-cf52-47db-9469-2e102cf3abff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:52.552429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04bd3e-cf52-47db-9469-2e102cf3abff None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:52.560524 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 407/780] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 15:52:52 2022] GET /identity/v3/endpoints?service_id=6ba76e786541438f85637fe711b9249d&interface=public®ion_id=RegionOne => generated 194 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:52.568303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04bd3e-cf52-47db-9469-2e102cf3abff None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:52.646072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:52.671667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 374/781] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:52:52.673279 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d739c6-9ffb-4736-83c6-e08d3e8583f8 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:52.673669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d739c6-9ffb-4736-83c6-e08d3e8583f8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:52.674043 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d739c6-9ffb-4736-83c6-e08d3e8583f8 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:52.679835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 375/782] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:52.681224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7c103-fa3e-477b-9573-02f0e0d75e8b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:52.681613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7c103-fa3e-477b-9573-02f0e0d75e8b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:52.681991 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7c103-fa3e-477b-9573-02f0e0d75e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:52.699545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b5e7c103-fa3e-477b-9573-02f0e0d75e8b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:52.700919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b5e7c103-fa3e-477b-9573-02f0e0d75e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:52.706538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04bd3e-cf52-47db-9469-2e102cf3abff None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:52.745477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:52.751135 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ff20-f03a-41e1-8f31-dda0aaa1283a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:52.752396 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ff20-f03a-41e1-8f31-dda0aaa1283a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:52.752855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ff20-f03a-41e1-8f31-dda0aaa1283a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:52.753188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ff20-f03a-41e1-8f31-dda0aaa1283a None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:52.754179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673ff20-f03a-41e1-8f31-dda0aaa1283a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:52.755814 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673ff20-f03a-41e1-8f31-dda0aaa1283a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:52.766856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 408/783] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 15:52:52 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:52.766856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ff20-f03a-41e1-8f31-dda0aaa1283a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:52.848618 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 376/784] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:52:52.879924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ff20-f03a-41e1-8f31-dda0aaa1283a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:52.885456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7c103-fa3e-477b-9573-02f0e0d75e8b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:52.917493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854fb87-29bf-4c08-8b15-b28b4235b077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:52.918332 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854fb87-29bf-4c08-8b15-b28b4235b077 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:52.918616 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854fb87-29bf-4c08-8b15-b28b4235b077 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:52.918976 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854fb87-29bf-4c08-8b15-b28b4235b077 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:52.931614 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854fb87-29bf-4c08-8b15-b28b4235b077 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-b854fb87-29bf-4c08-8b15-b28b4235b077 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:52.940050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:52.941163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:52.942007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:52.942007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:52.942007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:52.942007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:52.942007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:52.942007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:52.942007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:52.942007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:52.942007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:52.942007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:52.942007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:52.942007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:52.942007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 409/785] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:52.950842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854fb87-29bf-4c08-8b15-b28b4235b077 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:53.035117 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:53.077034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7c103-fa3e-477b-9573-02f0e0d75e8b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:53.087894 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854fb87-29bf-4c08-8b15-b28b4235b077 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:53.091786 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:53.128689 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33321c35-19d1-4d33-a9e4-e9249064c4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:53.129569 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33321c35-19d1-4d33-a9e4-e9249064c4de None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:53.129847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33321c35-19d1-4d33-a9e4-e9249064c4de None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:53.130118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33321c35-19d1-4d33-a9e4-e9249064c4de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:53.137103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb7cf2-a73b-47bf-84bd-6b7d99cbc0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:53.138161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb7cf2-a73b-47bf-84bd-6b7d99cbc0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:53.138661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb7cf2-a73b-47bf-84bd-6b7d99cbc0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:53.139163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb7cf2-a73b-47bf-84bd-6b7d99cbc0b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:53.140547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb7cf2-a73b-47bf-84bd-6b7d99cbc0b1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:53.141059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb7cf2-a73b-47bf-84bd-6b7d99cbc0b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:53.143035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33321c35-19d1-4d33-a9e4-e9249064c4de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:53.143150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb7cf2-a73b-47bf-84bd-6b7d99cbc0b1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-33321c35-19d1-4d33-a9e4-e9249064c4de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:53.152450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:53.153460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:53.154351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:53.154351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:53.154351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:53.154351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:53.154351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:53.154351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:53.154351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:53.154351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:53.154351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:53.154351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:53.154351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:53.154351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:53.154351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 377/786] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:52:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:53.166887 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33321c35-19d1-4d33-a9e4-e9249064c4de None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:53.167088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 410/787] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:53.169353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb7cf2-a73b-47bf-84bd-6b7d99cbc0b1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:53.276539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb7cf2-a73b-47bf-84bd-6b7d99cbc0b1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:53.288032 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:53.313167 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cd6a5-209b-4a1c-8fc0-5884b11dd742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:53.314077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cd6a5-209b-4a1c-8fc0-5884b11dd742 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:53.314360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cd6a5-209b-4a1c-8fc0-5884b11dd742 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:53.314630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cd6a5-209b-4a1c-8fc0-5884b11dd742 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:53.326361 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cd6a5-209b-4a1c-8fc0-5884b11dd742 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:53.327919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381cd6a5-209b-4a1c-8fc0-5884b11dd742 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:53.347274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-381cd6a5-209b-4a1c-8fc0-5884b11dd742 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:53.347274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:53.347274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:53.347274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:53.347274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:53.347274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:53.347274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:53.347274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:53.347274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:53.347274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:53.347274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:53.347274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:53.347274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:53.347274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:53.347274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:53.348267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:53.349149 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:53.349149 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:53.349149 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:53.349149 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:53.349149 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 411/788] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:53.354961 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cd6a5-209b-4a1c-8fc0-5884b11dd742 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:53.459068 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cd6a5-209b-4a1c-8fc0-5884b11dd742 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:53.462084 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33321c35-19d1-4d33-a9e4-e9249064c4de None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:53.494210 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42b8bb-b416-42d9-859c-bd30f7e123f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:53.495006 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42b8bb-b416-42d9-859c-bd30f7e123f6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:53.495290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42b8bb-b416-42d9-859c-bd30f7e123f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:53.495562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42b8bb-b416-42d9-859c-bd30f7e123f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:53.496303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42b8bb-b416-42d9-859c-bd30f7e123f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:53.496610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42b8bb-b416-42d9-859c-bd30f7e123f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:53.498110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e42b8bb-b416-42d9-859c-bd30f7e123f6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:53.515220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 412/789] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:53.516786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42b8bb-b416-42d9-859c-bd30f7e123f6 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:53.539653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff149c-7d87-4b9d-a764-b664650d2943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:53.540282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff149c-7d87-4b9d-a764-b664650d2943 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:53.540571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff149c-7d87-4b9d-a764-b664650d2943 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:53.540855 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff149c-7d87-4b9d-a764-b664650d2943 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:53.541653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff149c-7d87-4b9d-a764-b664650d2943 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:53.541956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff149c-7d87-4b9d-a764-b664650d2943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:53.543161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:53.543400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff149c-7d87-4b9d-a764-b664650d2943 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:53.556845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 378/790] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:53.567919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff149c-7d87-4b9d-a764-b664650d2943 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:53.622554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:53.628446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42b8bb-b416-42d9-859c-bd30f7e123f6 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:53.669600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693c576-4a49-46ee-ad0f-eca1fee365d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:53.670441 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693c576-4a49-46ee-ad0f-eca1fee365d1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:53.670716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693c576-4a49-46ee-ad0f-eca1fee365d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:53.671030 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d693c576-4a49-46ee-ad0f-eca1fee365d1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:53.687377 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693c576-4a49-46ee-ad0f-eca1fee365d1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:53.688846 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d693c576-4a49-46ee-ad0f-eca1fee365d1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d693c576-4a49-46ee-ad0f-eca1fee365d1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:53.719937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:53.721969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:53.723606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:53.723606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:53.723606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:53.723606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:53.723606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:53.723606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:53.723606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:53.723606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:53.723606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 15:52:53.723606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:53.726846 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 413/791] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 15:52:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:53.736636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693c576-4a49-46ee-ad0f-eca1fee365d1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:53.761407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff149c-7d87-4b9d-a764-b664650d2943 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:53.835277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d4fa8-bf77-4abe-a7c3-f037b6caf981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:53.836081 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d4fa8-bf77-4abe-a7c3-f037b6caf981 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:53.836359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d4fa8-bf77-4abe-a7c3-f037b6caf981 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:53.836627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d4fa8-bf77-4abe-a7c3-f037b6caf981 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:53.856914 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d4fa8-bf77-4abe-a7c3-f037b6caf981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:53.858510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d4fa8-bf77-4abe-a7c3-f037b6caf981 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:53.878732 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:53.896101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-262d4fa8-bf77-4abe-a7c3-f037b6caf981 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:53.896101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:53.896101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:53.896101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:53.896101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:53.896101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:53.896101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:53.896101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:53.896101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:53.896101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:53.896101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:53.896101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:53.896101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:53.896101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:53.896101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:53.897868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:53.898760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:53.898760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:53.898760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:53.898760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:53.899019 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d693c576-4a49-46ee-ad0f-eca1fee365d1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:53.899092 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 379/792] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:53.903249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d4fa8-bf77-4abe-a7c3-f037b6caf981 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:53.939836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc3dbd-c9f2-464f-96f4-9cee7e814fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:53.940650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc3dbd-c9f2-464f-96f4-9cee7e814fdb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:53.940930 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc3dbd-c9f2-464f-96f4-9cee7e814fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:53.941203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc3dbd-c9f2-464f-96f4-9cee7e814fdb None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:53.942056 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc3dbd-c9f2-464f-96f4-9cee7e814fdb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:53.942365 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc3dbd-c9f2-464f-96f4-9cee7e814fdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:53.943942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc3dbd-c9f2-464f-96f4-9cee7e814fdb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:53.963962 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 414/793] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 21 15:52:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:53.969780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc3dbd-c9f2-464f-96f4-9cee7e814fdb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:54.030414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:54.049968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d4fa8-bf77-4abe-a7c3-f037b6caf981 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:54.084417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc3dbd-c9f2-464f-96f4-9cee7e814fdb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:54.095139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a724357-036c-4ddb-b20e-42b8aae33dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:54.096495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a724357-036c-4ddb-b20e-42b8aae33dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:54.096921 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a724357-036c-4ddb-b20e-42b8aae33dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:54.097650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a724357-036c-4ddb-b20e-42b8aae33dc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:54.098560 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a724357-036c-4ddb-b20e-42b8aae33dc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:54.099268 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a724357-036c-4ddb-b20e-42b8aae33dc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:54.101886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a724357-036c-4ddb-b20e-42b8aae33dc9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:54.126918 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 380/794] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:54.128007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2abd14-d967-4f89-a727-846008e8dab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:54.128944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2abd14-d967-4f89-a727-846008e8dab2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:54.129242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f7225-577a-478b-8369-60486c1cbc9d None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:54.129363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2abd14-d967-4f89-a727-846008e8dab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:54.129662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2abd14-d967-4f89-a727-846008e8dab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:54.129973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f7225-577a-478b-8369-60486c1cbc9d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:54.130485 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96f7225-577a-478b-8369-60486c1cbc9d None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:54.132884 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 381/795] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:54.134605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f7225-577a-478b-8369-60486c1cbc9d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:54.140798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:54.144359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2abd14-d967-4f89-a727-846008e8dab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:54.146709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2abd14-d967-4f89-a727-846008e8dab2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:54.167024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-9d2abd14-d967-4f89-a727-846008e8dab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:54.167024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:54.167024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:54.167024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:54.167024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:54.167024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:54.167024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:54.167024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:54.167024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:54.167024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:54.167024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:54.167024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:54.167024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:54.167024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:54.167024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:54.168363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:54.169491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:54.169491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:54.169491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:54.169491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:54.170901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 415/796] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:52:54.176150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82643c4-fef4-47cc-8b31-1b46d50b856b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:54.176150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82643c4-fef4-47cc-8b31-1b46d50b856b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:54.176150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82643c4-fef4-47cc-8b31-1b46d50b856b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:54.198726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c82643c4-fef4-47cc-8b31-1b46d50b856b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:54.200154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c82643c4-fef4-47cc-8b31-1b46d50b856b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:54.271287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 416/797] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:52:54.272375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82643c4-fef4-47cc-8b31-1b46d50b856b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:54.284391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96f7225-577a-478b-8369-60486c1cbc9d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:54.328372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0825c-51f6-4a93-a0ae-974bd0aba60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:54.329992 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0825c-51f6-4a93-a0ae-974bd0aba60b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:54.330474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0825c-51f6-4a93-a0ae-974bd0aba60b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:54.331426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0825c-51f6-4a93-a0ae-974bd0aba60b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:54.341775 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0825c-51f6-4a93-a0ae-974bd0aba60b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:54.343866 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0825c-51f6-4a93-a0ae-974bd0aba60b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9ae0825c-51f6-4a93-a0ae-974bd0aba60b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:54.362718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:54.363737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:54.364804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:54.364804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:54.364804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:54.364804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:54.364804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:54.364804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:54.364804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:54.364804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:54.364804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:52:54.364804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:54.369994 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 382/798] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 15:52:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:54.370238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0825c-51f6-4a93-a0ae-974bd0aba60b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:54.375148 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:54.405104 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82643c4-fef4-47cc-8b31-1b46d50b856b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:54.430542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:54.444506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0f76b-fb43-4d99-b2df-b723c1d971fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:54.445191 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0f76b-fb43-4d99-b2df-b723c1d971fe None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:54.445476 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0f76b-fb43-4d99-b2df-b723c1d971fe None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:54.445756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0f76b-fb43-4d99-b2df-b723c1d971fe None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:54.446554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0f76b-fb43-4d99-b2df-b723c1d971fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:54.446903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0f76b-fb43-4d99-b2df-b723c1d971fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:54.448420 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0f76b-fb43-4d99-b2df-b723c1d971fe None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:54.465291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 417/799] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:54.465291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0f76b-fb43-4d99-b2df-b723c1d971fe None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:54.517787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0825c-51f6-4a93-a0ae-974bd0aba60b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:54.563804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db4d0b-afc2-4361-bc99-e961a331eef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:54.565298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db4d0b-afc2-4361-bc99-e961a331eef5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:54.566181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db4d0b-afc2-4361-bc99-e961a331eef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:54.566913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db4d0b-afc2-4361-bc99-e961a331eef5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:54.567824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db4d0b-afc2-4361-bc99-e961a331eef5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:54.570365 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db4d0b-afc2-4361-bc99-e961a331eef5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:54.572041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0f76b-fb43-4d99-b2df-b723c1d971fe None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c4db4d0b-afc2-4361-bc99-e961a331eef5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:54.586576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:54.587582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:54.588404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 383/800] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Jul 21 15:52:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:54.589253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db4d0b-afc2-4361-bc99-e961a331eef5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:54.617629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df51db-2690-4a97-8b52-4375a5510d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:54.618784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df51db-2690-4a97-8b52-4375a5510d0b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:54.619223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df51db-2690-4a97-8b52-4375a5510d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:54.620043 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df51db-2690-4a97-8b52-4375a5510d0b None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:54.621300 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df51db-2690-4a97-8b52-4375a5510d0b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:54.621760 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df51db-2690-4a97-8b52-4375a5510d0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:54.624181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df51db-2690-4a97-8b52-4375a5510d0b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:54.647634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 418/801] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 15:52:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:54.648687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df51db-2690-4a97-8b52-4375a5510d0b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:54.666482 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:54.695555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:54.711979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db4d0b-afc2-4361-bc99-e961a331eef5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:54.748317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d50f3f-769a-4578-b940-c6d65e780c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:54.749326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d50f3f-769a-4578-b940-c6d65e780c5f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:54.749649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d50f3f-769a-4578-b940-c6d65e780c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:54.750021 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d50f3f-769a-4578-b940-c6d65e780c5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:54.757901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d50f3f-769a-4578-b940-c6d65e780c5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:54.759601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d50f3f-769a-4578-b940-c6d65e780c5f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:54.771714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df51db-2690-4a97-8b52-4375a5510d0b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:54.774968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-b0d50f3f-769a-4578-b940-c6d65e780c5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:54.774968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:54.774968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:54.774968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:54.774968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:54.774968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:54.774968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:54.774968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:54.774968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:54.774968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:54.774968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:54.774968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:54.774968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:54.774968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:54.774968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:54.776113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:54.777223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:54.777223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:54.777223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:54.777223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:54.777223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:54.777223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:54.777223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:54.777223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:54.783329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 384/802] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:54.783329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d50f3f-769a-4578-b940-c6d65e780c5f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:54.896489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d50f3f-769a-4578-b940-c6d65e780c5f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:54.924952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:54.933104 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae61f7a-29cd-4e3c-ab4f-6f4403f3e061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:54.933756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae61f7a-29cd-4e3c-ab4f-6f4403f3e061 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:54.934033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae61f7a-29cd-4e3c-ab4f-6f4403f3e061 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:54.934305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae61f7a-29cd-4e3c-ab4f-6f4403f3e061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:54.938126 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e36e7-8b27-45d1-bf37-822f5c8ca081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:54.938898 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e36e7-8b27-45d1-bf37-822f5c8ca081 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:54.939182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e36e7-8b27-45d1-bf37-822f5c8ca081 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:54.939456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e36e7-8b27-45d1-bf37-822f5c8ca081 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:54.940228 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e36e7-8b27-45d1-bf37-822f5c8ca081 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:54.940560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e36e7-8b27-45d1-bf37-822f5c8ca081 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:54.941959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e36e7-8b27-45d1-bf37-822f5c8ca081 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:54.951571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 419/803] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 21 15:52:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:54.951571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e36e7-8b27-45d1-bf37-822f5c8ca081 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:55.014372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae61f7a-29cd-4e3c-ab4f-6f4403f3e061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:55.015897 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae61f7a-29cd-4e3c-ab4f-6f4403f3e061 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:55.061379 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e36e7-8b27-45d1-bf37-822f5c8ca081 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:55.064745 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:55.100704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9af6b1-0b86-4283-9bfd-b4efdf379648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:55.101386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9af6b1-0b86-4283-9bfd-b4efdf379648 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:55.101667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9af6b1-0b86-4283-9bfd-b4efdf379648 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:55.101944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9af6b1-0b86-4283-9bfd-b4efdf379648 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:55.102747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9af6b1-0b86-4283-9bfd-b4efdf379648 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:55.103092 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9af6b1-0b86-4283-9bfd-b4efdf379648 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:55.104532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9af6b1-0b86-4283-9bfd-b4efdf379648 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:55.117150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 420/804] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:55.118483 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731bbd9-ab89-4959-85de-459937222183 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:55.118776 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731bbd9-ab89-4959-85de-459937222183 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:55.119079 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731bbd9-ab89-4959-85de-459937222183 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:55.124604 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 421/805] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:55.124604 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731bbd9-ab89-4959-85de-459937222183 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:55.133361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 385/806] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:52:55.133361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae61f7a-29cd-4e3c-ab4f-6f4403f3e061 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:55.160581 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:55.246253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae61f7a-29cd-4e3c-ab4f-6f4403f3e061 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:55.249600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6731bbd9-ab89-4959-85de-459937222183 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:55.280940 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f131d-9ca0-4683-a9f4-5dfabc55d703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:55.281854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f131d-9ca0-4683-a9f4-5dfabc55d703 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:55.282131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f131d-9ca0-4683-a9f4-5dfabc55d703 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:55.282404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f131d-9ca0-4683-a9f4-5dfabc55d703 None admin] PATH_INFO: `/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/8d1d0d0f2d544d41a86f1e0dda8d110c/roles/ae7cbb39ab61467ba1976a753ba6693c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:55.285767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72420fda-e85b-40c7-adc0-6c8e3976576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:55.286448 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72420fda-e85b-40c7-adc0-6c8e3976576a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:55.286731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72420fda-e85b-40c7-adc0-6c8e3976576a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:55.287036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72420fda-e85b-40c7-adc0-6c8e3976576a None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:55.287759 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72420fda-e85b-40c7-adc0-6c8e3976576a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:55.288068 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72420fda-e85b-40c7-adc0-6c8e3976576a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:55.289439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72420fda-e85b-40c7-adc0-6c8e3976576a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:55.299656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 422/807] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Jul 21 15:52:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:55.299656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e035f-fc44-4cb0-8ca1-6dea42dc2978 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:55.299656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e035f-fc44-4cb0-8ca1-6dea42dc2978 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:55.299656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e035f-fc44-4cb0-8ca1-6dea42dc2978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:55.302263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f131d-9ca0-4683-a9f4-5dfabc55d703 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d717ed2993d4a3ab21195028a16e747, user_id=8d1d0d0f2d544d41a86f1e0dda8d110c, role_id=ae7cbb39ab61467ba1976a753ba6693c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:55.303744 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f131d-9ca0-4683-a9f4-5dfabc55d703 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:55.313934 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6f3e035f-fc44-4cb0-8ca1-6dea42dc2978 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:55.315301 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6f3e035f-fc44-4cb0-8ca1-6dea42dc2978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:55.318862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 386/808] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:52:55 2022] PUT /identity/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/8d1d0d0f2d544d41a86f1e0dda8d110c/roles/ae7cbb39ab61467ba1976a753ba6693c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:52:55.319598 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f131d-9ca0-4683-a9f4-5dfabc55d703 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:55.355146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:55.418942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 423/809] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:52:55.418942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e035f-fc44-4cb0-8ca1-6dea42dc2978 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:55.422341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:55.451813 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f131d-9ca0-4683-a9f4-5dfabc55d703 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:55.499058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb4e991-da88-4ea2-963f-b930df7e2f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:55.500036 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e991-da88-4ea2-963f-b930df7e2f44 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:55.500325 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e991-da88-4ea2-963f-b930df7e2f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:55.500599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb4e991-da88-4ea2-963f-b930df7e2f44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:55.513533 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4e991-da88-4ea2-963f-b930df7e2f44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:55.515295 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb4e991-da88-4ea2-963f-b930df7e2f44 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:55.533738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-5bb4e991-da88-4ea2-963f-b930df7e2f44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:55.533738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:55.533738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:55.533738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:55.533738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:55.533738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:55.533738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:55.533738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:55.533738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:55.533738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:55.533738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:55.533738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:55.533738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:55.533738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:55.533738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:55.534850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:55.535880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:55.535880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:55.535880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:55.535880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:55.535880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 387/810] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:55.536320 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d2564-a9a7-4bf7-8217-46f4052f4a5b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:55.536985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d2564-a9a7-4bf7-8217-46f4052f4a5b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:55.536985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d2564-a9a7-4bf7-8217-46f4052f4a5b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:55.538308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 388/811] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:55.542076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d2564-a9a7-4bf7-8217-46f4052f4a5b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:55.549036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e035f-fc44-4cb0-8ca1-6dea42dc2978 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:55.587693 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00606d5-b19a-4760-a026-51311098175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:55.588374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00606d5-b19a-4760-a026-51311098175d None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:55.588659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00606d5-b19a-4760-a026-51311098175d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:55.588935 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00606d5-b19a-4760-a026-51311098175d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:55.589716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00606d5-b19a-4760-a026-51311098175d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:55.591182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00606d5-b19a-4760-a026-51311098175d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:55.616610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 424/812] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 15:52:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:52:55.617913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00606d5-b19a-4760-a026-51311098175d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:55.636296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:55.690700 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d2564-a9a7-4bf7-8217-46f4052f4a5b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:55.721914 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:55.733692 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd078c-3f5c-4b77-a390-c26c0023fd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:55.734556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd078c-3f5c-4b77-a390-c26c0023fd53 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:55.734884 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd078c-3f5c-4b77-a390-c26c0023fd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:55.735552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd078c-3f5c-4b77-a390-c26c0023fd53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:55.748559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd078c-3f5c-4b77-a390-c26c0023fd53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:55.757344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00606d5-b19a-4760-a026-51311098175d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-12fd078c-3f5c-4b77-a390-c26c0023fd53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:55.757882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:55.758776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:55.759856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:55.759856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:55.759856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:55.759856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:55.759856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:55.759856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:55.759856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:55.759856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:55.759856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:55.759856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:55.759856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:52:55.759856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:55.759856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 389/813] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:52:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:55.760562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f373b-22e1-4090-b91f-3ae78cb4b80e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:55.760939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f373b-22e1-4090-b91f-3ae78cb4b80e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:55.761169 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f373b-22e1-4090-b91f-3ae78cb4b80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:55.780026 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ec4f373b-22e1-4090-b91f-3ae78cb4b80e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:55.781386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ec4f373b-22e1-4090-b91f-3ae78cb4b80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:55.798545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca00f70-e859-448f-93cb-3dd93c4e377b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:55.799754 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca00f70-e859-448f-93cb-3dd93c4e377b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:55.800262 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca00f70-e859-448f-93cb-3dd93c4e377b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:55.800850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca00f70-e859-448f-93cb-3dd93c4e377b None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:55.801594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca00f70-e859-448f-93cb-3dd93c4e377b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:55.801899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca00f70-e859-448f-93cb-3dd93c4e377b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:55.803455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca00f70-e859-448f-93cb-3dd93c4e377b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:55.816369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 425/814] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:55.817056 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca00f70-e859-448f-93cb-3dd93c4e377b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:55.866879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 390/815] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:52:55.868191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f373b-22e1-4090-b91f-3ae78cb4b80e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:55.917772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:55.948088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca00f70-e859-448f-93cb-3dd93c4e377b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:55.982343 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f373b-22e1-4090-b91f-3ae78cb4b80e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:55.983993 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcadd0f-4ae0-493f-847f-3ae59721600c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:55.985016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcadd0f-4ae0-493f-847f-3ae59721600c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:55.985489 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcadd0f-4ae0-493f-847f-3ae59721600c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:55.985940 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcadd0f-4ae0-493f-847f-3ae59721600c None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:55.986918 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcadd0f-4ae0-493f-847f-3ae59721600c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:55.987455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcadd0f-4ae0-493f-847f-3ae59721600c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:55.989152 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcadd0f-4ae0-493f-847f-3ae59721600c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:56.000325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 426/816] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:52:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:56.001120 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:56.003371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcadd0f-4ae0-493f-847f-3ae59721600c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:56.025062 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335336e5-7e40-44d2-a2b4-71e2d704fc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:56.026113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335336e5-7e40-44d2-a2b4-71e2d704fc9b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:56.026392 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335336e5-7e40-44d2-a2b4-71e2d704fc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:56.026660 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335336e5-7e40-44d2-a2b4-71e2d704fc9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:56.035909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335336e5-7e40-44d2-a2b4-71e2d704fc9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:56.038050 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335336e5-7e40-44d2-a2b4-71e2d704fc9b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:56.056559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-335336e5-7e40-44d2-a2b4-71e2d704fc9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:56.056559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:56.056559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:56.056559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:56.056559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:56.056559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:56.056559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:56.056559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:56.056559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:56.056559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:56.056559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:56.056559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:56.056559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:56.056559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:56.056559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:56.057625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:56.058764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:56.058764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:56.058764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:56.058764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:56.058764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:56.058764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:56.058764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:56.058764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:56.058764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 391/817] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:56.059554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335336e5-7e40-44d2-a2b4-71e2d704fc9b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:56.130792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcadd0f-4ae0-493f-847f-3ae59721600c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:56.167580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335336e5-7e40-44d2-a2b4-71e2d704fc9b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:56.181319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ea29b-3280-493b-b58e-e6c6ca9a3074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:56.182160 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ea29b-3280-493b-b58e-e6c6ca9a3074 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:56.182440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ea29b-3280-493b-b58e-e6c6ca9a3074 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:56.182715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ea29b-3280-493b-b58e-e6c6ca9a3074 None admin] PATH_INFO: `/v3/services/network` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:56.183428 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ea29b-3280-493b-b58e-e6c6ca9a3074 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:56.184974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ea29b-3280-493b-b58e-e6c6ca9a3074 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:56.195199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d41ea29b-3280-493b-b58e-e6c6ca9a3074 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:56.210027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:56.211058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:56.211903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:56.211903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:56.211903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:56.211903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:56.211903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:56.211903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:56.211903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:56.211903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:56.211903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:56.211903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:56.211903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:52:56.211903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:56.211903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 15:52:56.211903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:56.212642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 427/818] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:56 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:56.218532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ea29b-3280-493b-b58e-e6c6ca9a3074 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:56.229272 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c7a7c-c5ff-4162-871a-9a7954d524e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:56.230406 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c7a7c-c5ff-4162-871a-9a7954d524e8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:56.231322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c7a7c-c5ff-4162-871a-9a7954d524e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:56.231819 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c7a7c-c5ff-4162-871a-9a7954d524e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:56.247978 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c7a7c-c5ff-4162-871a-9a7954d524e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:56.250625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c7a7c-c5ff-4162-871a-9a7954d524e8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:56.273913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ca8c7a7c-c5ff-4162-871a-9a7954d524e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:56.273913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:56.273913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:56.273913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:56.273913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:56.273913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:56.273913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:56.273913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:56.273913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:56.273913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:56.273913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:56.273913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:56.273913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:56.273913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:56.273913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:56.274902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:56.275820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:56.275820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:56.275820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:56.275820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:56.278494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 392/819] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:56.279733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c7a7c-c5ff-4162-871a-9a7954d524e8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:56.311587 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:56.344434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ea29b-3280-493b-b58e-e6c6ca9a3074 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:56.385904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fae97-86f3-4f15-96da-1b03355e2e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:56.386783 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fae97-86f3-4f15-96da-1b03355e2e63 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:56.387194 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fae97-86f3-4f15-96da-1b03355e2e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:56.387571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fae97-86f3-4f15-96da-1b03355e2e63 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:56.388673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fae97-86f3-4f15-96da-1b03355e2e63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:56.388890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fae97-86f3-4f15-96da-1b03355e2e63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:56.390440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fae97-86f3-4f15-96da-1b03355e2e63 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:56.399231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c7a7c-c5ff-4162-871a-9a7954d524e8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:56.404347 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 428/820] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:56.405482 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fae97-86f3-4f15-96da-1b03355e2e63 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:56.445734 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58966f9-e838-495e-859e-774a71c3e310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:56.446671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58966f9-e838-495e-859e-774a71c3e310 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:56.447115 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58966f9-e838-495e-859e-774a71c3e310 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:56.447548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58966f9-e838-495e-859e-774a71c3e310 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:56.448879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58966f9-e838-495e-859e-774a71c3e310 None admin] RBAC: Adding query filter params (name=network) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:56.449362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58966f9-e838-495e-859e-774a71c3e310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:56.451316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58966f9-e838-495e-859e-774a71c3e310 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:56.463035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 393/821] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 15:52:56 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:56.463944 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58966f9-e838-495e-859e-774a71c3e310 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:56.476985 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:56.537830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fae97-86f3-4f15-96da-1b03355e2e63 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:56.568722 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:56.578951 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58966f9-e838-495e-859e-774a71c3e310 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:56.580300 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a26aa-fb57-4f1a-ba16-7ce7d7897159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:56.581212 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a26aa-fb57-4f1a-ba16-7ce7d7897159 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:56.581492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a26aa-fb57-4f1a-ba16-7ce7d7897159 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:56.581772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a26aa-fb57-4f1a-ba16-7ce7d7897159 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:56.583309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a26aa-fb57-4f1a-ba16-7ce7d7897159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:56.583622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a26aa-fb57-4f1a-ba16-7ce7d7897159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:56.585031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a26aa-fb57-4f1a-ba16-7ce7d7897159 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:56.604118 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 429/822] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:56.604118 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a26aa-fb57-4f1a-ba16-7ce7d7897159 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:56.621547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef13879-bdac-4858-b114-86b18d1852c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:56.622563 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef13879-bdac-4858-b114-86b18d1852c9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:56.623131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef13879-bdac-4858-b114-86b18d1852c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:56.623547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef13879-bdac-4858-b114-86b18d1852c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:56.624571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef13879-bdac-4858-b114-86b18d1852c9 None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=e9a1ec1f6bb7467dbd63ad1da36d48a9) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:56.625028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef13879-bdac-4858-b114-86b18d1852c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:56.626750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef13879-bdac-4858-b114-86b18d1852c9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:56.639299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 394/823] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:52:56 2022] GET /identity/v3/role_assignments?user.id=e9a1ec1f6bb7467dbd63ad1da36d48a9&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:56.640576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef13879-bdac-4858-b114-86b18d1852c9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:56.724888 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a26aa-fb57-4f1a-ba16-7ce7d7897159 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:56.763866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:56.803579 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7a8e8-8103-445d-8035-681a0759d3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:56.804706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7a8e8-8103-445d-8035-681a0759d3cd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:56.805175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7a8e8-8103-445d-8035-681a0759d3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:56.805639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7a8e8-8103-445d-8035-681a0759d3cd None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:56.806567 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7a8e8-8103-445d-8035-681a0759d3cd None admin] RBAC: Adding query filter params (type=network) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:56.807115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7a8e8-8103-445d-8035-681a0759d3cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:56.808744 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7a8e8-8103-445d-8035-681a0759d3cd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:56.814530 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef13879-bdac-4858-b114-86b18d1852c9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:56.815798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 430/824] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 15:52:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:56.821535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7a8e8-8103-445d-8035-681a0759d3cd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:56.891361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc9759-d3d9-45ba-b85b-ea14d77f4e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:56.892686 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9759-d3d9-45ba-b85b-ea14d77f4e1b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:56.894576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9759-d3d9-45ba-b85b-ea14d77f4e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:56.895720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc9759-d3d9-45ba-b85b-ea14d77f4e1b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:56.907351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc9759-d3d9-45ba-b85b-ea14d77f4e1b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:56.909224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcc9759-d3d9-45ba-b85b-ea14d77f4e1b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-edcc9759-d3d9-45ba-b85b-ea14d77f4e1b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:56.925466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:56.926484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:56.927477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:56.927477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:56.927477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:56.927477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:56.927477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:56.927477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:56.927477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:56.927477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:56.927477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 15:52:56.927477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:56.930302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 395/825] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:52:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:56.936310 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc9759-d3d9-45ba-b85b-ea14d77f4e1b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:56.958847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:56.993763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7a8e8-8103-445d-8035-681a0759d3cd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:57.033480 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304fa43-03a9-4bbc-b774-fd3afa826c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:57.034192 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304fa43-03a9-4bbc-b774-fd3afa826c4f None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:57.034478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304fa43-03a9-4bbc-b774-fd3afa826c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:57.034780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304fa43-03a9-4bbc-b774-fd3afa826c4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:57.035603 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304fa43-03a9-4bbc-b774-fd3afa826c4f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:57.036988 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304fa43-03a9-4bbc-b774-fd3afa826c4f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:57.052156 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc9759-d3d9-45ba-b85b-ea14d77f4e1b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:57.062324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 431/826] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 15:52:56 2022] POST /identity/v3/endpoints => generated 327 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:52:57.127484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3bdbc-4062-4b02-911b-6fcb07d00907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:57.128466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3bdbc-4062-4b02-911b-6fcb07d00907 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:57.128895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3bdbc-4062-4b02-911b-6fcb07d00907 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:57.129340 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3bdbc-4062-4b02-911b-6fcb07d00907 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:57.130404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3bdbc-4062-4b02-911b-6fcb07d00907 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:57.130882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3bdbc-4062-4b02-911b-6fcb07d00907 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:57.132572 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3bdbc-4062-4b02-911b-6fcb07d00907 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:57.155685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 396/827] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 21 15:52:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:57.161864 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304fa43-03a9-4bbc-b774-fd3afa826c4f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:57.243533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:57.332096 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304fa43-03a9-4bbc-b774-fd3afa826c4f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:57.381225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b52e7-d99d-46f5-a529-de02d1223b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:57.382066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b52e7-d99d-46f5-a529-de02d1223b8b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:57.382353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b52e7-d99d-46f5-a529-de02d1223b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:57.382626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b52e7-d99d-46f5-a529-de02d1223b8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:57.394440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b52e7-d99d-46f5-a529-de02d1223b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:57.400149 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32b52e7-d99d-46f5-a529-de02d1223b8b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:57.423020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-b32b52e7-d99d-46f5-a529-de02d1223b8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:57.423020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:57.423020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:57.423020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:57.423020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:57.423020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:57.423020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:57.423020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:57.423020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:57.423020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:57.423020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:57.423020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:57.423020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:57.423020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:57.423020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:57.423982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:57.424914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:57.424914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:57.424914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:57.424914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:57.424914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 432/828] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:57.431532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3bdbc-4062-4b02-911b-6fcb07d00907 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:57.491290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1cc0b-d745-43b0-a67f-be1e49ceedca None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:57.491636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1cc0b-d745-43b0-a67f-be1e49ceedca None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:57.492216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1cc0b-d745-43b0-a67f-be1e49ceedca None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:57.493919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 433/829] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:57.500212 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31169636-21a1-4d22-8301-62baa282e7ce None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:57.500493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31169636-21a1-4d22-8301-62baa282e7ce None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:57.500787 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31169636-21a1-4d22-8301-62baa282e7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:57.520276 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:57.521891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-31169636-21a1-4d22-8301-62baa282e7ce None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:57.524102 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-31169636-21a1-4d22-8301-62baa282e7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:57.557502 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3bdbc-4062-4b02-911b-6fcb07d00907 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:57.603000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d20ea-5d17-4c9a-b87a-9c4574abe467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:57.603815 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d20ea-5d17-4c9a-b87a-9c4574abe467 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:57.604097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d20ea-5d17-4c9a-b87a-9c4574abe467 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:57.604405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d20ea-5d17-4c9a-b87a-9c4574abe467 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:57.605618 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d20ea-5d17-4c9a-b87a-9c4574abe467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:57.606080 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d20ea-5d17-4c9a-b87a-9c4574abe467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:57.607718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d20ea-5d17-4c9a-b87a-9c4574abe467 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:57.612026 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 434/830] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:52:57.621460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 397/831] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:57.627046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31169636-21a1-4d22-8301-62baa282e7ce None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:57.640854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d20ea-5d17-4c9a-b87a-9c4574abe467 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:57.678893 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:57.770570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d20ea-5d17-4c9a-b87a-9c4574abe467 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:57.781626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31169636-21a1-4d22-8301-62baa282e7ce None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:57.802091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:57.809444 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c067d-1838-4644-8690-a015c99412fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:57.810368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c067d-1838-4644-8690-a015c99412fd None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:57.810702 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c067d-1838-4644-8690-a015c99412fd None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:57.811087 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c067d-1838-4644-8690-a015c99412fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:57.822793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c067d-1838-4644-8690-a015c99412fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:52:57.825363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8710f36-70b9-4c94-9e03-5f70c2688865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:57.826175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8710f36-70b9-4c94-9e03-5f70c2688865 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:57.826456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8710f36-70b9-4c94-9e03-5f70c2688865 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:57.826729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8710f36-70b9-4c94-9e03-5f70c2688865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d39c067d-1838-4644-8690-a015c99412fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:52:57.832290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:57.833238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:57.834094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:57.834094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:57.834094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:57.834094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:57.834094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:52:57.834094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:52:57.834094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:52:57.834094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:52:57.834094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:52:57.834094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:52:57.834094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:52:57.834094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:57.834094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 398/832] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:52:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:57.834802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f18ee-6d55-4b88-9c25-a37bdd863981 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:57.835384 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f18ee-6d55-4b88-9c25-a37bdd863981 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:57.835384 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f18ee-6d55-4b88-9c25-a37bdd863981 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:57.838768 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 399/833] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:57.842884 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8710f36-70b9-4c94-9e03-5f70c2688865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:57.842884 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8710f36-70b9-4c94-9e03-5f70c2688865 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:57.843085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f18ee-6d55-4b88-9c25-a37bdd863981 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:57.859188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-b8710f36-70b9-4c94-9e03-5f70c2688865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:57.859188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:57.859188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:57.859188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:57.859188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:57.859188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:57.859188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:57.859188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:57.859188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:57.859188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:57.859188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:57.859188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:57.859188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:52:57.859188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:52:57.859188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:57.860382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:57.861525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:52:57.861525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:52:57.861525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:52:57.861525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:52:57.861525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:52:57.861525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:52:57.861525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:52:57.861525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:57.865884 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 435/834] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:57.867188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d2e19-70ea-4f62-910f-ee259c682687 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:57.867481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d2e19-70ea-4f62-910f-ee259c682687 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:57.867769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d2e19-70ea-4f62-910f-ee259c682687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:57.884953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c90d2e19-70ea-4f62-910f-ee259c682687 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:57.886150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c90d2e19-70ea-4f62-910f-ee259c682687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:57.952034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f18ee-6d55-4b88-9c25-a37bdd863981 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:57.953745 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 436/835] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:52:57.954582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d2e19-70ea-4f62-910f-ee259c682687 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:57.972539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:58.002405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5321-e2d7-46af-8796-799928a850ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:58.003167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5321-e2d7-46af-8796-799928a850ca None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:58.003445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5321-e2d7-46af-8796-799928a850ca None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:58.003730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5321-e2d7-46af-8796-799928a850ca None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:58.004464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c5321-e2d7-46af-8796-799928a850ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:58.004798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c5321-e2d7-46af-8796-799928a850ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:58.006588 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c5321-e2d7-46af-8796-799928a850ca None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:58.015576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 400/836] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:52:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:58.021094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5321-e2d7-46af-8796-799928a850ca None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:58.068870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d2e19-70ea-4f62-910f-ee259c682687 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:58.078850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:58.104718 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd268b-e8fc-410b-b066-4ee8623f21c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:58.105390 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd268b-e8fc-410b-b066-4ee8623f21c9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:58.105664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd268b-e8fc-410b-b066-4ee8623f21c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:58.105941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd268b-e8fc-410b-b066-4ee8623f21c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:58.106727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd268b-e8fc-410b-b066-4ee8623f21c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:58.107059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd268b-e8fc-410b-b066-4ee8623f21c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:58.108486 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd268b-e8fc-410b-b066-4ee8623f21c9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:58.125274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 437/837] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:52:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:58.125274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd268b-e8fc-410b-b066-4ee8623f21c9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:58.130669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5321-e2d7-46af-8796-799928a850ca None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:58.165930 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735f0f4-7e2e-403d-96b2-81bc5958ee7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:58.166794 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735f0f4-7e2e-403d-96b2-81bc5958ee7d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:58.167099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735f0f4-7e2e-403d-96b2-81bc5958ee7d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:58.167368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735f0f4-7e2e-403d-96b2-81bc5958ee7d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:58.168020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735f0f4-7e2e-403d-96b2-81bc5958ee7d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:58.169439 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735f0f4-7e2e-403d-96b2-81bc5958ee7d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3735f0f4-7e2e-403d-96b2-81bc5958ee7d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:58.184742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:58.185861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:58.186703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:58.186703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:58.186703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:58.186703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:58.186703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:58.186703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:58.186703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:58.186703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:58.186703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:58.186703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:58.186703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:52:58.186703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:58.186703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 15:52:58.186703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:58.193648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 401/838] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:52:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:58.193648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735f0f4-7e2e-403d-96b2-81bc5958ee7d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:58.214148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:58.247057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd268b-e8fc-410b-b066-4ee8623f21c9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:58.281194 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edd9ea-e7dd-46dd-865c-800a32d71abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:58.282355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edd9ea-e7dd-46dd-865c-800a32d71abe None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:58.282871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edd9ea-e7dd-46dd-865c-800a32d71abe None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:58.283379 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9edd9ea-e7dd-46dd-865c-800a32d71abe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:58.294758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edd9ea-e7dd-46dd-865c-800a32d71abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:58.296410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9edd9ea-e7dd-46dd-865c-800a32d71abe None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:58.298526 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735f0f4-7e2e-403d-96b2-81bc5958ee7d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:58.313679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e9edd9ea-e7dd-46dd-865c-800a32d71abe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:58.313679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:58.313679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:58.313679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:58.313679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:58.313679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:58.313679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:58.313679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:58.313679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:58.313679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:58.313679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:58.313679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:58.313679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:58.313679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:58.313679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:58.314619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:58.315661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:58.315661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:58.315661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:58.315661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:58.315661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 438/839] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:58.315935 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edd9ea-e7dd-46dd-865c-800a32d71abe None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:58.316959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:58.339191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a50395-fde7-4161-8ed6-850889b34301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:58.340865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a50395-fde7-4161-8ed6-850889b34301 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:58.341301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a50395-fde7-4161-8ed6-850889b34301 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:58.341576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a50395-fde7-4161-8ed6-850889b34301 None admin] PATH_INFO: `/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/dcee349bdb2640609cc71fb1c65794f1/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:58.343550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a50395-fde7-4161-8ed6-850889b34301 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d717ed2993d4a3ab21195028a16e747, user_id=dcee349bdb2640609cc71fb1c65794f1, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:58.344987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a50395-fde7-4161-8ed6-850889b34301 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:58.358797 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 402/840] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:52:58 2022] PUT /identity/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/dcee349bdb2640609cc71fb1c65794f1/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:52:58.359700 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a50395-fde7-4161-8ed6-850889b34301 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:58.454786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9edd9ea-e7dd-46dd-865c-800a32d71abe None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:58.489786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:58.506234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98769b4a-2ba7-4bca-ba24-c56a93158c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:58.507640 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98769b4a-2ba7-4bca-ba24-c56a93158c54 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:58.508447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98769b4a-2ba7-4bca-ba24-c56a93158c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:58.508943 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98769b4a-2ba7-4bca-ba24-c56a93158c54 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:58.509881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98769b4a-2ba7-4bca-ba24-c56a93158c54 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:58.510411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98769b4a-2ba7-4bca-ba24-c56a93158c54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:58.512568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98769b4a-2ba7-4bca-ba24-c56a93158c54 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:58.520505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 439/841] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:52:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:58.526211 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98769b4a-2ba7-4bca-ba24-c56a93158c54 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:58.534218 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a50395-fde7-4161-8ed6-850889b34301 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:58.576317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542687f-7e3c-4ee4-9731-093954df1527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:58.577154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542687f-7e3c-4ee4-9731-093954df1527 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:58.577506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542687f-7e3c-4ee4-9731-093954df1527 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:58.577861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542687f-7e3c-4ee4-9731-093954df1527 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:58.578689 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542687f-7e3c-4ee4-9731-093954df1527 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:58.579125 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542687f-7e3c-4ee4-9731-093954df1527 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:58.580762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542687f-7e3c-4ee4-9731-093954df1527 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:58.598907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 403/842] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:58.600363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542687f-7e3c-4ee4-9731-093954df1527 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:58.639734 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:58.658598 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98769b4a-2ba7-4bca-ba24-c56a93158c54 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:58.695426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2a8ba-e5b8-4b21-9fac-8b745676f59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:58.696212 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2a8ba-e5b8-4b21-9fac-8b745676f59e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:58.696577 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2a8ba-e5b8-4b21-9fac-8b745676f59e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:58.697238 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2a8ba-e5b8-4b21-9fac-8b745676f59e None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:58.697710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2a8ba-e5b8-4b21-9fac-8b745676f59e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:58.698088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2a8ba-e5b8-4b21-9fac-8b745676f59e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:58.699739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2a8ba-e5b8-4b21-9fac-8b745676f59e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:58.711059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 440/843] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:52:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:58.719867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542687f-7e3c-4ee4-9731-093954df1527 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:58.763847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3664b-b8d2-4d67-b0f4-9f2eaa33f5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:58.765096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3664b-b8d2-4d67-b0f4-9f2eaa33f5da None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:58.765566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3664b-b8d2-4d67-b0f4-9f2eaa33f5da None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:58.766023 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3664b-b8d2-4d67-b0f4-9f2eaa33f5da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:58.775769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3664b-b8d2-4d67-b0f4-9f2eaa33f5da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:58.777622 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3664b-b8d2-4d67-b0f4-9f2eaa33f5da None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-11f3664b-b8d2-4d67-b0f4-9f2eaa33f5da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:52:58.795332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:58.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:58.797318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:58.797318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:58.797318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:52:58.797318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:52:58.797318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:52:58.797318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:52:58.797318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:52:58.797318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:52:58.797318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 15:52:58.797318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:58.799997 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 404/844] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 15:52:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:58.811417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2a8ba-e5b8-4b21-9fac-8b745676f59e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:58.871182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:58.924040 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2a8ba-e5b8-4b21-9fac-8b745676f59e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:58.959224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8c5e9-666c-448f-a81c-32f35db173ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:58.959921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8c5e9-666c-448f-a81c-32f35db173ea None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:58.960195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8c5e9-666c-448f-a81c-32f35db173ea None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:58.960469 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8c5e9-666c-448f-a81c-32f35db173ea None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:58.961375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8c5e9-666c-448f-a81c-32f35db173ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:58.961626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8c5e9-666c-448f-a81c-32f35db173ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:58.963094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8c5e9-666c-448f-a81c-32f35db173ea None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:58.987257 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 441/845] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 21 15:52:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:58.993856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3664b-b8d2-4d67-b0f4-9f2eaa33f5da None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:59.090916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:59.098611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3664b-b8d2-4d67-b0f4-9f2eaa33f5da None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:59.109832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227839f0-5de3-4fd2-b769-8781d92da440 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:59.110128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227839f0-5de3-4fd2-b769-8781d92da440 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:59.110400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227839f0-5de3-4fd2-b769-8781d92da440 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:59.112051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 442/846] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:52:59.117438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2de4fc-eb2d-48c9-918b-2c9aa9ab96a6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:59.117725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2de4fc-eb2d-48c9-918b-2c9aa9ab96a6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:59.118002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2de4fc-eb2d-48c9-918b-2c9aa9ab96a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:59.138091 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3c2de4fc-eb2d-48c9-918b-2c9aa9ab96a6 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:52:59.138716 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dafb50-d4b2-49fa-99d3-bbee17734051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:59.139431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dafb50-d4b2-49fa-99d3-bbee17734051 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:59.139714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dafb50-d4b2-49fa-99d3-bbee17734051 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:59.139992 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dafb50-d4b2-49fa-99d3-bbee17734051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:59.140691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3c2de4fc-eb2d-48c9-918b-2c9aa9ab96a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:52:59.221106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dafb50-d4b2-49fa-99d3-bbee17734051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:59.223012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dafb50-d4b2-49fa-99d3-bbee17734051 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:59.227660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 443/847] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:52:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:52:59.256037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2de4fc-eb2d-48c9-918b-2c9aa9ab96a6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:59.310346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:59.351403 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:59.361287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 405/848] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:52:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:52:59.367793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dafb50-d4b2-49fa-99d3-bbee17734051 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:59.373403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2de4fc-eb2d-48c9-918b-2c9aa9ab96a6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:59.408476 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80e5fd-040c-4deb-9f68-0a4d32cb354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:59.409438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80e5fd-040c-4deb-9f68-0a4d32cb354d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:59.409800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80e5fd-040c-4deb-9f68-0a4d32cb354d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:59.410144 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80e5fd-040c-4deb-9f68-0a4d32cb354d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:59.410961 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80e5fd-040c-4deb-9f68-0a4d32cb354d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:59.412527 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80e5fd-040c-4deb-9f68-0a4d32cb354d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-8f80e5fd-040c-4deb-9f68-0a4d32cb354d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:59.425568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:59.426802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:59.427890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:59.427890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:59.427890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:59.427890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:59.427890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:59.427890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:59.427890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:59.427890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:59.427890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:59.427890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:59.427890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:59.427890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:52:59.427890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:52:59.427890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 15:52:59.427890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:52:59.434771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 444/849] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Jul 21 15:52:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:59.436370 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80e5fd-040c-4deb-9f68-0a4d32cb354d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:59.559232 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80e5fd-040c-4deb-9f68-0a4d32cb354d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:59.563163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:59.610100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b780727-9eeb-4da1-8fe7-b4c7abf6389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:59.611456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b780727-9eeb-4da1-8fe7-b4c7abf6389b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:59.612405 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b780727-9eeb-4da1-8fe7-b4c7abf6389b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:59.613023 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b780727-9eeb-4da1-8fe7-b4c7abf6389b None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:59.614056 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b780727-9eeb-4da1-8fe7-b4c7abf6389b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:59.614795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b780727-9eeb-4da1-8fe7-b4c7abf6389b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:59.617477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b780727-9eeb-4da1-8fe7-b4c7abf6389b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:59.618799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dafb50-d4b2-49fa-99d3-bbee17734051 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:59.629237 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 445/850] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 15:52:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:59.629813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b780727-9eeb-4da1-8fe7-b4c7abf6389b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:59.658010 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234a6a1-ab22-4739-80db-2689d72fd5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:59.658827 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234a6a1-ab22-4739-80db-2689d72fd5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:59.659245 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234a6a1-ab22-4739-80db-2689d72fd5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:59.659514 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234a6a1-ab22-4739-80db-2689d72fd5b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:59.670122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234a6a1-ab22-4739-80db-2689d72fd5b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:59.671612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234a6a1-ab22-4739-80db-2689d72fd5b9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:59.689028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-2234a6a1-ab22-4739-80db-2689d72fd5b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:59.689028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:52:59.689028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:52:59.689028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:52:59.689028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:52:59.689028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:52:59.689028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:52:59.689028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:52:59.689028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:52:59.689028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:52:59.689028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:52:59.689028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:52:59.689028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:52:59.689028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:52:59.689028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:52:59.689947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:52:59.690935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:52:59.690935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:52:59.690935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:52:59.690935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:52:59.690935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 406/851] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:52:59.695952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234a6a1-ab22-4739-80db-2689d72fd5b9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:59.754580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b780727-9eeb-4da1-8fe7-b4c7abf6389b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:59.764307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:52:59.791061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73bcca-4b0e-455f-b8c2-8d4db6129fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:59.791730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73bcca-4b0e-455f-b8c2-8d4db6129fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:59.792291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73bcca-4b0e-455f-b8c2-8d4db6129fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:59.792542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73bcca-4b0e-455f-b8c2-8d4db6129fb7 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:59.793257 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73bcca-4b0e-455f-b8c2-8d4db6129fb7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:59.794286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73bcca-4b0e-455f-b8c2-8d4db6129fb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:59.795042 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73bcca-4b0e-455f-b8c2-8d4db6129fb7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:59.800015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 446/852] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 15:52:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:52:59.833410 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234a6a1-ab22-4739-80db-2689d72fd5b9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:52:59.874865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5a622-35c6-42be-8293-fadfeb6d72e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:52:59.875887 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5a622-35c6-42be-8293-fadfeb6d72e8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:52:59.876394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5a622-35c6-42be-8293-fadfeb6d72e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:52:59.876837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5a622-35c6-42be-8293-fadfeb6d72e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:52:59.877909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5a622-35c6-42be-8293-fadfeb6d72e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:52:59.878413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5a622-35c6-42be-8293-fadfeb6d72e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:52:59.880052 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d5a622-35c6-42be-8293-fadfeb6d72e8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:52:59.899198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 407/853] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:52:59.901768 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73bcca-4b0e-455f-b8c2-8d4db6129fb7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:52:59.941718 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:00.019960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73bcca-4b0e-455f-b8c2-8d4db6129fb7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:00.054408 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b2ef7-5795-4d14-af3e-f040a849b172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:00.055304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b2ef7-5795-4d14-af3e-f040a849b172 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:00.055726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b2ef7-5795-4d14-af3e-f040a849b172 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:00.056002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b2ef7-5795-4d14-af3e-f040a849b172 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:00.062925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b2ef7-5795-4d14-af3e-f040a849b172 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:00.064387 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b2ef7-5795-4d14-af3e-f040a849b172 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:00.078862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-424b2ef7-5795-4d14-af3e-f040a849b172 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:00.078862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:00.078862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:00.078862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:00.078862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:00.078862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:00.078862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:00.078862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:00.078862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:00.078862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:00.078862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:00.078862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:00.078862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:53:00.078862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:53:00.078862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:00.079817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:00.081037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:53:00.081037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:53:00.081037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:53:00.081037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:53:00.081037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:53:00.081037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:53:00.081037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:00.081037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:00.081037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 447/854] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:52:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:00.088192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5a622-35c6-42be-8293-fadfeb6d72e8 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:00.193872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5a622-35c6-42be-8293-fadfeb6d72e8 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:00.205444 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:00.231751 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009c1d8f-3a90-4ddd-8e25-a5c4cbbee94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:00.232425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c1d8f-3a90-4ddd-8e25-a5c4cbbee94d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:00.232708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c1d8f-3a90-4ddd-8e25-a5c4cbbee94d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:00.233001 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009c1d8f-3a90-4ddd-8e25-a5c4cbbee94d None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:00.233811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c1d8f-3a90-4ddd-8e25-a5c4cbbee94d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:00.234132 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c1d8f-3a90-4ddd-8e25-a5c4cbbee94d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:00.235654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009c1d8f-3a90-4ddd-8e25-a5c4cbbee94d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:00.252718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 408/855] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:53:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:00.255950 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b2ef7-5795-4d14-af3e-f040a849b172 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:00.351135 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:00.366092 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b2ef7-5795-4d14-af3e-f040a849b172 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:00.402660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cee65a-9735-4aa4-a880-5e9d7ac7e904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:00.403767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cee65a-9735-4aa4-a880-5e9d7ac7e904 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:00.404254 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cee65a-9735-4aa4-a880-5e9d7ac7e904 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:00.404747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cee65a-9735-4aa4-a880-5e9d7ac7e904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:00.405801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cee65a-9735-4aa4-a880-5e9d7ac7e904 None admin] RBAC: Adding query filter params (role.id=ae7cbb39ab61467ba1976a753ba6693c, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=8d1d0d0f2d544d41a86f1e0dda8d110c) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:00.406334 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cee65a-9735-4aa4-a880-5e9d7ac7e904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:00.408039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cee65a-9735-4aa4-a880-5e9d7ac7e904 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:00.415254 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 448/856] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:53:00 2022] GET /identity/v3/role_assignments?user.id=8d1d0d0f2d544d41a86f1e0dda8d110c&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=ae7cbb39ab61467ba1976a753ba6693c => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:00.507989 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2348ac-9fc8-429a-a2af-e683cc937dd0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:00.508323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2348ac-9fc8-429a-a2af-e683cc937dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:00.508584 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2348ac-9fc8-429a-a2af-e683cc937dd0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:00.510296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 409/857] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:00.516054 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a5133-1d73-44ea-aee4-47edb516c339 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:00.516346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a5133-1d73-44ea-aee4-47edb516c339 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:00.516608 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a5133-1d73-44ea-aee4-47edb516c339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:00.534357 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-282a5133-1d73-44ea-aee4-47edb516c339 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:00.535611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-282a5133-1d73-44ea-aee4-47edb516c339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:00.614033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 449/858] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:00.637486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2348ac-9fc8-429a-a2af-e683cc937dd0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:00.755122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2348ac-9fc8-429a-a2af-e683cc937dd0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:00.790255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844f8a6-02de-4865-917d-724ccec894f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:00.791100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844f8a6-02de-4865-917d-724ccec894f6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:00.791383 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844f8a6-02de-4865-917d-724ccec894f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:00.791660 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844f8a6-02de-4865-917d-724ccec894f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:00.803468 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844f8a6-02de-4865-917d-724ccec894f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-3844f8a6-02de-4865-917d-724ccec894f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:53:00.811349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:00.812303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:00.813154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:00.813154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:00.813154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:00.813154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:00.813154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:53:00.813154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:53:00.813154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:53:00.813154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:53:00.813154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:53:00.813154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:53:00.813154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:53:00.813154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:00.816448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 410/859] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:53:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:00.819220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a5133-1d73-44ea-aee4-47edb516c339 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:00.881414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb183a3-5ec6-409d-8ae9-e98d880ed34f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:00.881726 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb183a3-5ec6-409d-8ae9-e98d880ed34f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:00.881940 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb183a3-5ec6-409d-8ae9-e98d880ed34f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:00.883775 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 411/860] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:53:00.888847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06022e8d-ad79-4741-bf11-128964f3c6b3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:00.889128 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06022e8d-ad79-4741-bf11-128964f3c6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:00.889402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06022e8d-ad79-4741-bf11-128964f3c6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:00.906495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-06022e8d-ad79-4741-bf11-128964f3c6b3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:00.907767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-06022e8d-ad79-4741-bf11-128964f3c6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:00.914018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:00.934274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:00.935501 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a5133-1d73-44ea-aee4-47edb516c339 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:00.974231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c1af4-2e78-4653-9af6-26d71386b264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:00.975057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c1af4-2e78-4653-9af6-26d71386b264 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:00.975440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c1af4-2e78-4653-9af6-26d71386b264 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:00.975726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c1af4-2e78-4653-9af6-26d71386b264 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:00.976524 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c1af4-2e78-4653-9af6-26d71386b264 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:00.976830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c1af4-2e78-4653-9af6-26d71386b264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:00.978397 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c1af4-2e78-4653-9af6-26d71386b264 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:00.991723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 412/862] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:53:00.992022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 450/862] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:53:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:00.994209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06022e8d-ad79-4741-bf11-128964f3c6b3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:01.014405 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c1af4-2e78-4653-9af6-26d71386b264 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:01.120077 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06022e8d-ad79-4741-bf11-128964f3c6b3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:01.138676 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c1af4-2e78-4653-9af6-26d71386b264 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:01.162304 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa099c7c-9ae7-4d93-a3bf-0a8c259032c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:01.163262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa099c7c-9ae7-4d93-a3bf-0a8c259032c7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:01.163614 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa099c7c-9ae7-4d93-a3bf-0a8c259032c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:01.163960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa099c7c-9ae7-4d93-a3bf-0a8c259032c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:01.177511 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa099c7c-9ae7-4d93-a3bf-0a8c259032c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:01.179037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa099c7c-9ae7-4d93-a3bf-0a8c259032c7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:01.185022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0f82b-055f-41b1-802b-5a92e8e7070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:01.185694 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0f82b-055f-41b1-802b-5a92e8e7070e None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:01.185973 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0f82b-055f-41b1-802b-5a92e8e7070e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:01.186243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0f82b-055f-41b1-802b-5a92e8e7070e None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:01.187010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0f82b-055f-41b1-802b-5a92e8e7070e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:01.188357 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0f82b-055f-41b1-802b-5a92e8e7070e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:01.209456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-fa099c7c-9ae7-4d93-a3bf-0a8c259032c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:01.209456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:01.209456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:01.209456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:01.209456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:01.209456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:01.209456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:01.209456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:01.209456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:01.209456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:01.209456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:01.209456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:01.209456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:53:01.209456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:53:01.209456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:01.210799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:01.211829 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:53:01.211829 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:53:01.211829 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:01.211829 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:01.218504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 451/864] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 15:53:01 2022] POST /identity/v3/services => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 15:53:01.219038 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 413/864] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:01.220758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0f82b-055f-41b1-802b-5a92e8e7070e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:01.243221 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:01.350343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0f82b-055f-41b1-802b-5a92e8e7070e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:01.388281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67925b06-e887-40d9-af13-11c74810325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:01.389020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67925b06-e887-40d9-af13-11c74810325c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:01.389249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67925b06-e887-40d9-af13-11c74810325c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:01.389521 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67925b06-e887-40d9-af13-11c74810325c None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:01.390261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67925b06-e887-40d9-af13-11c74810325c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:01.390566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67925b06-e887-40d9-af13-11c74810325c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:01.391994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67925b06-e887-40d9-af13-11c74810325c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:01.404453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 452/865] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:01.410057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa099c7c-9ae7-4d93-a3bf-0a8c259032c7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:01.422714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:01.514349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa099c7c-9ae7-4d93-a3bf-0a8c259032c7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:01.549999 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0337d1-aa9a-46ce-973d-319aab315bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:01.550875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0337d1-aa9a-46ce-973d-319aab315bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:01.551170 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0337d1-aa9a-46ce-973d-319aab315bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:01.551447 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0337d1-aa9a-46ce-973d-319aab315bb6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:01.559632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0337d1-aa9a-46ce-973d-319aab315bb6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:01.561222 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0337d1-aa9a-46ce-973d-319aab315bb6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0e0337d1-aa9a-46ce-973d-319aab315bb6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:53:01.576579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:01.577555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:01.578492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:01.578492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:01.578492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:53:01.578492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:53:01.578492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:53:01.578492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:53:01.578492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:53:01.578492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:53:01.578492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 15:53:01.578492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:01.582717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 414/866] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:53:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:01.584125 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67925b06-e887-40d9-af13-11c74810325c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:01.652195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:01.692729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67925b06-e887-40d9-af13-11c74810325c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:01.728357 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d531e-8f6e-4cce-b413-71697083bbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:01.729039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d531e-8f6e-4cce-b413-71697083bbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:01.729317 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d531e-8f6e-4cce-b413-71697083bbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:01.729591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d531e-8f6e-4cce-b413-71697083bbd6 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:01.730435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d531e-8f6e-4cce-b413-71697083bbd6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:01.730745 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d531e-8f6e-4cce-b413-71697083bbd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:01.732223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681d531e-8f6e-4cce-b413-71697083bbd6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:01.754959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 453/867] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Jul 21 15:53:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:01.757717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0337d1-aa9a-46ce-973d-319aab315bb6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:01.828650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:01.861197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0337d1-aa9a-46ce-973d-319aab315bb6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:01.897049 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef43454-0ae1-4c30-9eab-d11ef34a38a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:01.897741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef43454-0ae1-4c30-9eab-d11ef34a38a7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:01.898021 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef43454-0ae1-4c30-9eab-d11ef34a38a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:01.898298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef43454-0ae1-4c30-9eab-d11ef34a38a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:01.962575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73be65c-8c57-499a-bd51-738f56344aa9 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:01.963166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73be65c-8c57-499a-bd51-738f56344aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:01.963166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73be65c-8c57-499a-bd51-738f56344aa9 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:01.964875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 454/868] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:01.969224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef43454-0ae1-4c30-9eab-d11ef34a38a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:01.971021 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef43454-0ae1-4c30-9eab-d11ef34a38a7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:01.972741 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfd747-7b0a-485d-a58d-ac113b1dbe92 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:01.973177 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfd747-7b0a-485d-a58d-ac113b1dbe92 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:01.973601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfd747-7b0a-485d-a58d-ac113b1dbe92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:01.997335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f2cfd747-7b0a-485d-a58d-ac113b1dbe92 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:01.999158 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f2cfd747-7b0a-485d-a58d-ac113b1dbe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:02.050197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:02.095513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 415/870] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:53:01 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:53:02.097682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef43454-0ae1-4c30-9eab-d11ef34a38a7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:02.099037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 455/870] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:53:02.124062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfd747-7b0a-485d-a58d-ac113b1dbe92 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:02.203825 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef43454-0ae1-4c30-9eab-d11ef34a38a7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:02.215790 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:02.240288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfd747-7b0a-485d-a58d-ac113b1dbe92 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:02.240972 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8853e2f-351d-4307-9082-dc0b2d1eed23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:02.241786 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8853e2f-351d-4307-9082-dc0b2d1eed23 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:02.242065 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8853e2f-351d-4307-9082-dc0b2d1eed23 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:02.242446 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8853e2f-351d-4307-9082-dc0b2d1eed23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:02.253968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8853e2f-351d-4307-9082-dc0b2d1eed23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:02.255736 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8853e2f-351d-4307-9082-dc0b2d1eed23 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:02.274460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d8853e2f-351d-4307-9082-dc0b2d1eed23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:02.274460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:02.274460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:02.274460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:02.274460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:02.274460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:02.274460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:02.274460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:02.274460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:02.274460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:02.274460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:02.274460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:02.274460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:53:02.274460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:53:02.274460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:02.275488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:02.276382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:53:02.276382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:53:02.276382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:02.276382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:02.276382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 416/871] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:02.279887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7dfe8-49e0-4897-b583-19b3cc0d6dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:02.279887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7dfe8-49e0-4897-b583-19b3cc0d6dac None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:02.279887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7dfe8-49e0-4897-b583-19b3cc0d6dac None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:02.279887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7dfe8-49e0-4897-b583-19b3cc0d6dac None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:02.280589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7dfe8-49e0-4897-b583-19b3cc0d6dac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:02.281128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7dfe8-49e0-4897-b583-19b3cc0d6dac None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:02.281809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8853e2f-351d-4307-9082-dc0b2d1eed23 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:02.298770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 456/872] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 15:53:02 2022] POST /identity/v3/services => generated 269 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:53:02.327133 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:02.442385 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8853e2f-351d-4307-9082-dc0b2d1eed23 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:02.495986 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc718a-fb52-406b-8c47-28cdbf4011c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:02.496597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc718a-fb52-406b-8c47-28cdbf4011c9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:02.496875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc718a-fb52-406b-8c47-28cdbf4011c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:02.497149 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc718a-fb52-406b-8c47-28cdbf4011c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:02.497898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc718a-fb52-406b-8c47-28cdbf4011c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:02.498208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc718a-fb52-406b-8c47-28cdbf4011c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:02.499676 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc718a-fb52-406b-8c47-28cdbf4011c9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:02.513333 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 417/873] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:02.519380 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7dfe8-49e0-4897-b583-19b3cc0d6dac None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:02.533149 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989f307-b534-4e06-a153-e07f89b08a75 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:02.533519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989f307-b534-4e06-a153-e07f89b08a75 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:02.533700 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989f307-b534-4e06-a153-e07f89b08a75 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:02.535402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 418/874] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:53:02.540625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaee24e-6f23-4e07-b2d3-890318b458ce None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:02.540913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaee24e-6f23-4e07-b2d3-890318b458ce None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:02.541200 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaee24e-6f23-4e07-b2d3-890318b458ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:02.560731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ebaee24e-6f23-4e07-b2d3-890318b458ce None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:02.561995 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ebaee24e-6f23-4e07-b2d3-890318b458ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:02.635056 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7dfe8-49e0-4897-b583-19b3cc0d6dac None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:02.648980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:02.651056 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 419/875] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:53:02.676235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaee24e-6f23-4e07-b2d3-890318b458ce None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:02.680144 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d83930-8949-4f2c-9e1d-fcdadff17f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:02.681231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d83930-8949-4f2c-9e1d-fcdadff17f80 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:02.681716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d83930-8949-4f2c-9e1d-fcdadff17f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:02.682200 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d83930-8949-4f2c-9e1d-fcdadff17f80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:02.686962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:02.691362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d83930-8949-4f2c-9e1d-fcdadff17f80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:02.693080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d83930-8949-4f2c-9e1d-fcdadff17f80 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:02.709895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d4d83930-8949-4f2c-9e1d-fcdadff17f80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:02.709895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:02.709895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:02.709895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:02.709895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:02.709895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:02.709895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:02.709895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:02.709895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:02.709895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:02.709895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:02.709895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:02.709895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:53:02.709895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:53:02.709895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:02.710853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:02.711873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:53:02.711873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:53:02.711873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:53:02.711873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:53:02.711873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:53:02.711873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:53:02.711873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:02.711873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:02.714519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 457/876] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:53:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:02.720879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d83930-8949-4f2c-9e1d-fcdadff17f80 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:02.799526 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaee24e-6f23-4e07-b2d3-890318b458ce None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:02.830644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d83930-8949-4f2c-9e1d-fcdadff17f80 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:02.841617 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1615a-d808-4bb5-a68a-d2327ca9e727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:02.842462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1615a-d808-4bb5-a68a-d2327ca9e727 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:02.843079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1615a-d808-4bb5-a68a-d2327ca9e727 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:02.843360 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1615a-d808-4bb5-a68a-d2327ca9e727 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:02.857139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1615a-d808-4bb5-a68a-d2327ca9e727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-21c1615a-d808-4bb5-a68a-d2327ca9e727 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:53:02.868662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:02.869627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:02.870473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:02.870473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:02.870473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:02.870473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:02.870473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:53:02.870473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:53:02.870473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:53:02.870473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:53:02.870473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:53:02.870473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:53:02.870473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 15:53:02.870473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:02.870473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 420/877] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 21 15:53:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:02.875890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a3e3c-81c9-4b63-9b27-3198d82f9845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:02.875890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a3e3c-81c9-4b63-9b27-3198d82f9845 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:02.875890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a3e3c-81c9-4b63-9b27-3198d82f9845 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:02.875890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a3e3c-81c9-4b63-9b27-3198d82f9845 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:02.876168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a3e3c-81c9-4b63-9b27-3198d82f9845 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:02.876168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a3e3c-81c9-4b63-9b27-3198d82f9845 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:02.876168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a3e3c-81c9-4b63-9b27-3198d82f9845 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:02.878734 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1615a-d808-4bb5-a68a-d2327ca9e727 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:02.889664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 458/878] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:53:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:02.895569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a3e3c-81c9-4b63-9b27-3198d82f9845 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:02.935620 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:02.972841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:03.020820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1615a-d808-4bb5-a68a-d2327ca9e727 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:03.024860 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a3e3c-81c9-4b63-9b27-3198d82f9845 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:03.066146 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13d75b-5f1f-4fb2-9315-195db17a3531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:03.066747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13d75b-5f1f-4fb2-9315-195db17a3531 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:03.067058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13d75b-5f1f-4fb2-9315-195db17a3531 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:03.067336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13d75b-5f1f-4fb2-9315-195db17a3531 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:03.068127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13d75b-5f1f-4fb2-9315-195db17a3531 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:03.068436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13d75b-5f1f-4fb2-9315-195db17a3531 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:03.069871 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13d75b-5f1f-4fb2-9315-195db17a3531 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:03.074522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df17dde-3dd5-4643-bf3b-5b81749d07aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:03.075590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df17dde-3dd5-4643-bf3b-5b81749d07aa None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:03.076156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df17dde-3dd5-4643-bf3b-5b81749d07aa None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:03.076640 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df17dde-3dd5-4643-bf3b-5b81749d07aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:03.077697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df17dde-3dd5-4643-bf3b-5b81749d07aa None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=dcee349bdb2640609cc71fb1c65794f1) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:03.078224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df17dde-3dd5-4643-bf3b-5b81749d07aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:03.084043 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 421/879] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 21 15:53:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:03.084222 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df17dde-3dd5-4643-bf3b-5b81749d07aa None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:03.086525 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13d75b-5f1f-4fb2-9315-195db17a3531 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:03.092422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 459/880] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:53:02 2022] GET /identity/v3/role_assignments?user.id=dcee349bdb2640609cc71fb1c65794f1&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:03.228880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13d75b-5f1f-4fb2-9315-195db17a3531 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:03.260678 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:03.268991 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cdede-6550-4639-bb7a-b2d81c0d0b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:03.269826 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cdede-6550-4639-bb7a-b2d81c0d0b59 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:03.270113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cdede-6550-4639-bb7a-b2d81c0d0b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:03.270389 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cdede-6550-4639-bb7a-b2d81c0d0b59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:03.282007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cdede-6550-4639-bb7a-b2d81c0d0b59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:03.283509 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cdede-6550-4639-bb7a-b2d81c0d0b59 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:03.301862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-960cdede-6550-4639-bb7a-b2d81c0d0b59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:03.301862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:03.301862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:03.301862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:03.301862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:03.301862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:03.301862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:03.301862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:03.301862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:03.301862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:03.301862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:03.301862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:03.301862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:53:03.301862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:53:03.301862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:03.302858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:03.303828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:53:03.303828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:53:03.303828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:03.303828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:03.303828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 422/881] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:03.310393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df17dde-3dd5-4643-bf3b-5b81749d07aa None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:03.409672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:03.417111 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df17dde-3dd5-4643-bf3b-5b81749d07aa None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:03.452061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a98b-8304-403e-8938-9377e5e00f03 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:03.452382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a98b-8304-403e-8938-9377e5e00f03 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:03.452615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a98b-8304-403e-8938-9377e5e00f03 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:03.453058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2856b6-b581-4bf7-83be-5729edc0dd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:03.453948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2856b6-b581-4bf7-83be-5729edc0dd74 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:03.454189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 423/882] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:03.454635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2856b6-b581-4bf7-83be-5729edc0dd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:03.455135 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2856b6-b581-4bf7-83be-5729edc0dd74 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:03.456279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2856b6-b581-4bf7-83be-5729edc0dd74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:03.456800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2856b6-b581-4bf7-83be-5729edc0dd74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:03.458373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2856b6-b581-4bf7-83be-5729edc0dd74 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:03.459209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fd7fd-eec7-47ff-8247-16de8e1e661f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:03.459490 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fd7fd-eec7-47ff-8247-16de8e1e661f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:03.459763 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fd7fd-eec7-47ff-8247-16de8e1e661f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:03.472456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 460/883] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:03.477920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8b3fd7fd-eec7-47ff-8247-16de8e1e661f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:03.478632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2856b6-b581-4bf7-83be-5729edc0dd74 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:03.479138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8b3fd7fd-eec7-47ff-8247-16de8e1e661f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:03.566911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 424/884] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:53:03.593140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fd7fd-eec7-47ff-8247-16de8e1e661f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:03.595068 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2856b6-b581-4bf7-83be-5729edc0dd74 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:03.641542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12623edb-12cb-4fac-b270-f3735c3f5857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:03.642531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12623edb-12cb-4fac-b270-f3735c3f5857 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:03.642830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12623edb-12cb-4fac-b270-f3735c3f5857 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:03.643128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12623edb-12cb-4fac-b270-f3735c3f5857 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:03.652620 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12623edb-12cb-4fac-b270-f3735c3f5857 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:03.654348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12623edb-12cb-4fac-b270-f3735c3f5857 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-12623edb-12cb-4fac-b270-f3735c3f5857 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:53:03.674575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:03.675600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:03.681634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:03.681634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:03.681634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:53:03.681634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:53:03.681634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:53:03.681634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:53:03.681634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:53:03.681634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:53:03.681634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 15:53:03.681634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:03.681634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 461/885] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 15:53:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:03.682228 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12623edb-12cb-4fac-b270-f3735c3f5857 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:03.706802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:03.708001 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fd7fd-eec7-47ff-8247-16de8e1e661f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:03.723685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:03.750140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de9f2e-ec56-4fec-9388-1ecb6023f51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:03.751204 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de9f2e-ec56-4fec-9388-1ecb6023f51b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:03.751482 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de9f2e-ec56-4fec-9388-1ecb6023f51b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:03.751753 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79de9f2e-ec56-4fec-9388-1ecb6023f51b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:03.752814 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de9f2e-ec56-4fec-9388-1ecb6023f51b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:03.754196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79de9f2e-ec56-4fec-9388-1ecb6023f51b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-79de9f2e-ec56-4fec-9388-1ecb6023f51b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:03.771284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:03.772322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:03.773153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:03.773153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:03.773153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:03.773153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:03.773153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:03.773153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:03.773153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:03.773153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:03.773153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:03.773153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:03.773153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:53:03.773153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:03.773153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 15:53:03.773153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:03.777631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 425/886] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:53:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:03.778597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de9f2e-ec56-4fec-9388-1ecb6023f51b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:03.812472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12623edb-12cb-4fac-b270-f3735c3f5857 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:03.850304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd00a7-491a-4c27-8e69-1a030656a28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:03.851795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd00a7-491a-4c27-8e69-1a030656a28d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:03.852343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd00a7-491a-4c27-8e69-1a030656a28d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:03.852818 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbd00a7-491a-4c27-8e69-1a030656a28d None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:03.853908 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd00a7-491a-4c27-8e69-1a030656a28d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:03.854419 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd00a7-491a-4c27-8e69-1a030656a28d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:03.856299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbd00a7-491a-4c27-8e69-1a030656a28d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:03.882263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 462/887] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 21 15:53:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:03.883643 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd00a7-491a-4c27-8e69-1a030656a28d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:03.910435 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79de9f2e-ec56-4fec-9388-1ecb6023f51b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:03.959400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c144cdb-1714-466c-ac23-7531ac897e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:03.959999 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c144cdb-1714-466c-ac23-7531ac897e77 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:03.960284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c144cdb-1714-466c-ac23-7531ac897e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:03.960558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c144cdb-1714-466c-ac23-7531ac897e77 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:03.961274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c144cdb-1714-466c-ac23-7531ac897e77 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:03.961827 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c144cdb-1714-466c-ac23-7531ac897e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:03.963595 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c144cdb-1714-466c-ac23-7531ac897e77 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:03.969680 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:03.978214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 426/888] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:53:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:03.978919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c144cdb-1714-466c-ac23-7531ac897e77 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:04.007917 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbd00a7-491a-4c27-8e69-1a030656a28d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:04.030042 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:04.051993 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5158b0f-7f62-4be6-b276-8999c43d81a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:04.052655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5158b0f-7f62-4be6-b276-8999c43d81a7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:04.053175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5158b0f-7f62-4be6-b276-8999c43d81a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:04.053519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5158b0f-7f62-4be6-b276-8999c43d81a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:04.111986 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c144cdb-1714-466c-ac23-7531ac897e77 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:04.136276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5158b0f-7f62-4be6-b276-8999c43d81a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:04.139200 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5158b0f-7f62-4be6-b276-8999c43d81a7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:04.151484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f5800-7fec-49aa-815d-c510c153a5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:04.152281 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f5800-7fec-49aa-815d-c510c153a5eb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:04.152627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f5800-7fec-49aa-815d-c510c153a5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:04.152971 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f5800-7fec-49aa-815d-c510c153a5eb None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:04.153819 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f5800-7fec-49aa-815d-c510c153a5eb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:04.154133 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f5800-7fec-49aa-815d-c510c153a5eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:04.155841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f5800-7fec-49aa-815d-c510c153a5eb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:04.166938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 427/889] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:53:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:04.169350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f5800-7fec-49aa-815d-c510c153a5eb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:04.236184 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:04.268674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 463/890] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:53:03 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:53:04.269587 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5158b0f-7f62-4be6-b276-8999c43d81a7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:04.290704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f5800-7fec-49aa-815d-c510c153a5eb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:04.295219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:04.332559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f018f3-ecbe-4773-ab13-acfe8d2d17d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:04.333838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f018f3-ecbe-4773-ab13-acfe8d2d17d4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:04.334426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f018f3-ecbe-4773-ab13-acfe8d2d17d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:04.334981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f018f3-ecbe-4773-ab13-acfe8d2d17d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:04.336384 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f018f3-ecbe-4773-ab13-acfe8d2d17d4 None admin] RBAC: Adding query filter params (interface=public, service_id=a2adf96a19a14655820a2ced1bda17fd, region_id=RegionOne) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:04.337012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f018f3-ecbe-4773-ab13-acfe8d2d17d4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:04.338667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f018f3-ecbe-4773-ab13-acfe8d2d17d4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:04.352020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 428/891] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 15:53:04 2022] GET /identity/v3/endpoints?service_id=a2adf96a19a14655820a2ced1bda17fd&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:04.353298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f018f3-ecbe-4773-ab13-acfe8d2d17d4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:04.375290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5158b0f-7f62-4be6-b276-8999c43d81a7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:04.410264 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d71a58-ce82-4002-8336-1cfb97017044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:04.411110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d71a58-ce82-4002-8336-1cfb97017044 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:04.411395 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d71a58-ce82-4002-8336-1cfb97017044 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:04.411680 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d71a58-ce82-4002-8336-1cfb97017044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:04.422490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d71a58-ce82-4002-8336-1cfb97017044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:04.424012 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d71a58-ce82-4002-8336-1cfb97017044 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:04.442532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a0d71a58-ce82-4002-8336-1cfb97017044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:04.442532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:04.442532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:04.442532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:04.442532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:04.442532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:04.442532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:04.442532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:04.442532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:04.442532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:04.442532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:04.442532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:04.442532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:53:04.442532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:53:04.442532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:04.443542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:04.444453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:53:04.444453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:53:04.444453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:04.444453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:04.448824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 464/892] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:04.449857 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d71a58-ce82-4002-8336-1cfb97017044 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:04.466057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f018f3-ecbe-4773-ab13-acfe8d2d17d4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:04.477662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:04.504802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaacc23-0917-4d33-9d41-20953102f24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:04.505837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaacc23-0917-4d33-9d41-20953102f24d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:04.506341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaacc23-0917-4d33-9d41-20953102f24d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:04.506756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaacc23-0917-4d33-9d41-20953102f24d None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:04.507714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaacc23-0917-4d33-9d41-20953102f24d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:04.509351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaacc23-0917-4d33-9d41-20953102f24d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:04.515622 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 429/893] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 15:53:04 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 15:53:04.517131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56419e-7259-4645-ab8c-f167c94b45d5 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:04.517554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56419e-7259-4645-ab8c-f167c94b45d5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:04.517830 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56419e-7259-4645-ab8c-f167c94b45d5 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:04.519521 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 430/894] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:04.525658 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23551586-80ff-4444-b68d-7d1cd9375600 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:04.525931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23551586-80ff-4444-b68d-7d1cd9375600 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:04.526275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23551586-80ff-4444-b68d-7d1cd9375600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:04.546153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-23551586-80ff-4444-b68d-7d1cd9375600 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:04.547401 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-23551586-80ff-4444-b68d-7d1cd9375600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:04.562738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d71a58-ce82-4002-8336-1cfb97017044 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:04.584332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:04.602643 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe591111-d6e0-488a-a1d3-cae227adccdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:04.603382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe591111-d6e0-488a-a1d3-cae227adccdb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:04.603671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe591111-d6e0-488a-a1d3-cae227adccdb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:04.603947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe591111-d6e0-488a-a1d3-cae227adccdb None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:04.604699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe591111-d6e0-488a-a1d3-cae227adccdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:04.605013 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe591111-d6e0-488a-a1d3-cae227adccdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:04.606523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe591111-d6e0-488a-a1d3-cae227adccdb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:04.621105 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 465/895] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:04.627442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe591111-d6e0-488a-a1d3-cae227adccdb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:04.653114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 431/896] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:53:04.676200 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23551586-80ff-4444-b68d-7d1cd9375600 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:04.741757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:04.758886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe591111-d6e0-488a-a1d3-cae227adccdb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:04.803543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0b9de-08c0-4e76-b579-702de960c274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:04.804318 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0b9de-08c0-4e76-b579-702de960c274 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:04.804603 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0b9de-08c0-4e76-b579-702de960c274 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:04.804880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0b9de-08c0-4e76-b579-702de960c274 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:04.806289 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23551586-80ff-4444-b68d-7d1cd9375600 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:04.813342 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0b9de-08c0-4e76-b579-702de960c274 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:04.815286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0b9de-08c0-4e76-b579-702de960c274 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:04.832048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-8ca0b9de-08c0-4e76-b579-702de960c274 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:04.832048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:04.832048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:04.832048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:04.832048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:04.832048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:04.832048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:04.832048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:04.832048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:04.832048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:04.832048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:04.832048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:04.832048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:53:04.832048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:53:04.832048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:04.833193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:04.834367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:53:04.834367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:53:04.834367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:53:04.834367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:53:04.834367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:53:04.834367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:53:04.834367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:04.834367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:04.834367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 466/897] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:04.840838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0b9de-08c0-4e76-b579-702de960c274 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:04.856565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4a1b4-00b3-4b3e-aca1-56c230e57d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:04.857633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4a1b4-00b3-4b3e-aca1-56c230e57d56 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:04.858058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4a1b4-00b3-4b3e-aca1-56c230e57d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:04.858954 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac4a1b4-00b3-4b3e-aca1-56c230e57d56 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:04.859942 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4a1b4-00b3-4b3e-aca1-56c230e57d56 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:04.861579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac4a1b4-00b3-4b3e-aca1-56c230e57d56 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-5ac4a1b4-00b3-4b3e-aca1-56c230e57d56 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:04.880012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:04.881252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:04.882293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:04.882293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:04.882293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:04.882293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:04.882293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:04.882293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:04.882293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:04.882293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:04.882293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:04.882293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:04.882293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:04.882293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:53:04.882293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:04.882293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 15:53:04.882293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:04.886902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 432/898] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Jul 21 15:53:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:04.892072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4a1b4-00b3-4b3e-aca1-56c230e57d56 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:04.931655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:04.985981 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0b9de-08c0-4e76-b579-702de960c274 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:05.030415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac4a1b4-00b3-4b3e-aca1-56c230e57d56 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:05.034414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f1619-ba97-425a-9f5a-0db2051102b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:05.035255 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1619-ba97-425a-9f5a-0db2051102b2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:05.035635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1619-ba97-425a-9f5a-0db2051102b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:05.036005 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f1619-ba97-425a-9f5a-0db2051102b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:05.036910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f1619-ba97-425a-9f5a-0db2051102b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:05.037317 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f1619-ba97-425a-9f5a-0db2051102b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:05.038868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f1619-ba97-425a-9f5a-0db2051102b2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:05.057408 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 467/899] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:05.058573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f1619-ba97-425a-9f5a-0db2051102b2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:05.069836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:05.078915 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e28067-1cad-49b5-9c61-cbc80701816a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:05.080139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e28067-1cad-49b5-9c61-cbc80701816a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:05.080635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e28067-1cad-49b5-9c61-cbc80701816a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:05.081219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e28067-1cad-49b5-9c61-cbc80701816a None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:05.082420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e28067-1cad-49b5-9c61-cbc80701816a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:05.082985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e28067-1cad-49b5-9c61-cbc80701816a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:05.084613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e28067-1cad-49b5-9c61-cbc80701816a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:05.092334 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 433/900] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 15:53:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:05.097953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e28067-1cad-49b5-9c61-cbc80701816a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:05.191291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f1619-ba97-425a-9f5a-0db2051102b2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:05.209767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:05.223884 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e28067-1cad-49b5-9c61-cbc80701816a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:05.233972 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99177e9-2dd4-46ab-8d48-af8b1f92900d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:05.235046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99177e9-2dd4-46ab-8d48-af8b1f92900d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:05.235573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99177e9-2dd4-46ab-8d48-af8b1f92900d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:05.236038 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99177e9-2dd4-46ab-8d48-af8b1f92900d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:05.237343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99177e9-2dd4-46ab-8d48-af8b1f92900d None admin] RBAC: Adding query filter params (role.id=e9d9c03727a34b14af8c89c7839193cc, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=8d1d0d0f2d544d41a86f1e0dda8d110c) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:05.237857 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99177e9-2dd4-46ab-8d48-af8b1f92900d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:05.239552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99177e9-2dd4-46ab-8d48-af8b1f92900d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:05.246428 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 468/901] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:53:05 2022] GET /identity/v3/role_assignments?user.id=8d1d0d0f2d544d41a86f1e0dda8d110c&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=e9d9c03727a34b14af8c89c7839193cc => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:05.248103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29b65f-19d9-4660-b177-8f3cdce13636 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:05.248597 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29b65f-19d9-4660-b177-8f3cdce13636 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:05.249067 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c29b65f-19d9-4660-b177-8f3cdce13636 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:05.250963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 469/902] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:05.260207 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9e2c-89ac-44d9-b240-9f2737feff5b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:05.260536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9e2c-89ac-44d9-b240-9f2737feff5b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:05.260769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9e2c-89ac-44d9-b240-9f2737feff5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:05.267963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02be063-a8e6-437d-8a5f-ddfdab01d15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:05.269209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02be063-a8e6-437d-8a5f-ddfdab01d15f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:05.269720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02be063-a8e6-437d-8a5f-ddfdab01d15f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:05.270191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02be063-a8e6-437d-8a5f-ddfdab01d15f None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:05.271177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02be063-a8e6-437d-8a5f-ddfdab01d15f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:05.271728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02be063-a8e6-437d-8a5f-ddfdab01d15f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:05.273401 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02be063-a8e6-437d-8a5f-ddfdab01d15f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:05.279897 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 434/903] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 15:53:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:05.285170 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4dde9e2c-89ac-44d9-b240-9f2737feff5b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:05.285170 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4dde9e2c-89ac-44d9-b240-9f2737feff5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:05.287221 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02be063-a8e6-437d-8a5f-ddfdab01d15f None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:05.355554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:05.367266 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 470/904] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:53:05.384484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde9e2c-89ac-44d9-b240-9f2737feff5b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:05.411125 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02be063-a8e6-437d-8a5f-ddfdab01d15f None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:05.458083 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5016b-0246-4d71-9535-ea800ff06949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:05.459822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5016b-0246-4d71-9535-ea800ff06949 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:05.460308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5016b-0246-4d71-9535-ea800ff06949 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:05.460800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5016b-0246-4d71-9535-ea800ff06949 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:05.462036 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5016b-0246-4d71-9535-ea800ff06949 None admin] RBAC: Adding query filter params (interface=public, service_id=91778c5a6f3b4a6db2bdcf7e1faf2b9a, region_id=RegionOne) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:05.462560 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5016b-0246-4d71-9535-ea800ff06949 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:05.465031 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5016b-0246-4d71-9535-ea800ff06949 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:05.477412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 435/905] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 15:53:05 2022] GET /identity/v3/endpoints?service_id=91778c5a6f3b4a6db2bdcf7e1faf2b9a&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:05.480339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5016b-0246-4d71-9535-ea800ff06949 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:05.503573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde9e2c-89ac-44d9-b240-9f2737feff5b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:05.509343 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:05.542847 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa0b0b-a468-4aa7-824f-25ace8219c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:05.543771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa0b0b-a468-4aa7-824f-25ace8219c72 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:05.544156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa0b0b-a468-4aa7-824f-25ace8219c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:05.544570 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa0b0b-a468-4aa7-824f-25ace8219c72 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:05.545593 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa0b0b-a468-4aa7-824f-25ace8219c72 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:05.546924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa0b0b-a468-4aa7-824f-25ace8219c72 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-69aa0b0b-a468-4aa7-824f-25ace8219c72 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:05.560130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:05.561279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:05.562131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:05.562131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:05.562131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:05.562131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:05.562131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:05.562131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:05.562131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:05.562131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:05.562131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:05.562131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:05.562131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:53:05.562131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:05.562131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 15:53:05.562131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:05.562920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 471/906] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 15:53:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:05.568042 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa0b0b-a468-4aa7-824f-25ace8219c72 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:05.620889 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5016b-0246-4d71-9535-ea800ff06949 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:05.654265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:05.668350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867ed6d-5f91-491c-9984-6f5b506a0cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:05.669326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867ed6d-5f91-491c-9984-6f5b506a0cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:05.669777 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867ed6d-5f91-491c-9984-6f5b506a0cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:05.670218 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1867ed6d-5f91-491c-9984-6f5b506a0cf6 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:05.671152 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867ed6d-5f91-491c-9984-6f5b506a0cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:05.673359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1867ed6d-5f91-491c-9984-6f5b506a0cf6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:05.691137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 436/907] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 15:53:05 2022] GET /identity/v3/services => generated 1268 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 15:53:05.715861 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa0b0b-a468-4aa7-824f-25ace8219c72 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:05.759864 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff10513-f7c3-4af4-8604-a968803c9e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:05.760588 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff10513-f7c3-4af4-8604-a968803c9e13 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:05.760921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff10513-f7c3-4af4-8604-a968803c9e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:05.761215 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff10513-f7c3-4af4-8604-a968803c9e13 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:05.762001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff10513-f7c3-4af4-8604-a968803c9e13 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:05.762328 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff10513-f7c3-4af4-8604-a968803c9e13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:05.763916 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff10513-f7c3-4af4-8604-a968803c9e13 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:05.770420 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 472/908] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 15:53:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:05.776370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867ed6d-5f91-491c-9984-6f5b506a0cf6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:05.885731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:05.907725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1867ed6d-5f91-491c-9984-6f5b506a0cf6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:05.946364 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf64353-b11c-4757-b50a-ae19866cbd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:05.947338 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf64353-b11c-4757-b50a-ae19866cbd93 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:05.947759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf64353-b11c-4757-b50a-ae19866cbd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:05.948191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf64353-b11c-4757-b50a-ae19866cbd93 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:05.949048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf64353-b11c-4757-b50a-ae19866cbd93 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:05.949593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf64353-b11c-4757-b50a-ae19866cbd93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:05.951153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf64353-b11c-4757-b50a-ae19866cbd93 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:05.956985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 437/909] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 15:53:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:06.692878 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed465d68-d2eb-4d6c-bc5d-85826c3c22b0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:06.693453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed465d68-d2eb-4d6c-bc5d-85826c3c22b0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:06.693453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed465d68-d2eb-4d6c-bc5d-85826c3c22b0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:06.695115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 473/910] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:06.704566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667e5c8-6bf5-4e22-9492-036b5f42348c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:06.705055 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667e5c8-6bf5-4e22-9492-036b5f42348c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:06.705130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667e5c8-6bf5-4e22-9492-036b5f42348c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:06.726133 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9667e5c8-6bf5-4e22-9492-036b5f42348c None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:06.727441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9667e5c8-6bf5-4e22-9492-036b5f42348c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:06.809040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 438/911] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:06.831741 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed465d68-d2eb-4d6c-bc5d-85826c3c22b0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:06.946270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed465d68-d2eb-4d6c-bc5d-85826c3c22b0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:06.974328 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:06.983939 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998888d8-d708-4bfe-8077-587cdb1c8273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:06.984828 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998888d8-d708-4bfe-8077-587cdb1c8273 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:06.985109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998888d8-d708-4bfe-8077-587cdb1c8273 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:06.985386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998888d8-d708-4bfe-8077-587cdb1c8273 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:06.986059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998888d8-d708-4bfe-8077-587cdb1c8273 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:06.987566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998888d8-d708-4bfe-8077-587cdb1c8273 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-998888d8-d708-4bfe-8077-587cdb1c8273 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:07.000832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:07.001901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:07.002795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:07.002795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:07.002795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:07.002795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:07.002795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:07.002795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:07.002795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:07.002795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:07.002795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:07.002795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:07.002795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:53:07.002795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:07.002795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 15:53:07.002795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:07.002795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 474/912] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:53:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:07.008408 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667e5c8-6bf5-4e22-9492-036b5f42348c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:07.107306 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:07.136469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667e5c8-6bf5-4e22-9492-036b5f42348c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:07.172962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081abc-3dff-4156-88d0-752626bde7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:07.173654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081abc-3dff-4156-88d0-752626bde7de None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:07.173937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081abc-3dff-4156-88d0-752626bde7de None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:07.174211 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7081abc-3dff-4156-88d0-752626bde7de None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:07.175015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7081abc-3dff-4156-88d0-752626bde7de None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:07.175325 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7081abc-3dff-4156-88d0-752626bde7de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:07.176892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7081abc-3dff-4156-88d0-752626bde7de None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:07.186964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 439/913] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:53:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:07.191694 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998888d8-d708-4bfe-8077-587cdb1c8273 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:07.300924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998888d8-d708-4bfe-8077-587cdb1c8273 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:07.337362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afa0e2-c5b1-46cb-b3ce-cee15983eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:07.338409 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afa0e2-c5b1-46cb-b3ce-cee15983eac7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:07.338939 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afa0e2-c5b1-46cb-b3ce-cee15983eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:07.339419 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afa0e2-c5b1-46cb-b3ce-cee15983eac7 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:07.340341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afa0e2-c5b1-46cb-b3ce-cee15983eac7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:07.340871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afa0e2-c5b1-46cb-b3ce-cee15983eac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:07.342543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afa0e2-c5b1-46cb-b3ce-cee15983eac7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:07.348726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 475/914] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Jul 21 15:53:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:07.355519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081abc-3dff-4156-88d0-752626bde7de None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:07.421282 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8d4fe-ed4c-472c-b94d-229e67795d25 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:07.421653 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8d4fe-ed4c-472c-b94d-229e67795d25 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:07.421855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8d4fe-ed4c-472c-b94d-229e67795d25 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:07.423582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 476/915] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:53:07.429118 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9354268-7a98-46c0-8c4c-699986bb0821 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:07.429402 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9354268-7a98-46c0-8c4c-699986bb0821 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:07.429677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9354268-7a98-46c0-8c4c-699986bb0821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:07.463937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a9354268-7a98-46c0-8c4c-699986bb0821 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:07.465790 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a9354268-7a98-46c0-8c4c-699986bb0821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:07.466421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7081abc-3dff-4156-88d0-752626bde7de None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:07.518985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291b2f7-20e5-445a-b214-5d5ed1a6f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:07.519806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291b2f7-20e5-445a-b214-5d5ed1a6f0af None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:07.520236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291b2f7-20e5-445a-b214-5d5ed1a6f0af None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:07.520605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291b2f7-20e5-445a-b214-5d5ed1a6f0af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:07.521639 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291b2f7-20e5-445a-b214-5d5ed1a6f0af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:07.523353 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291b2f7-20e5-445a-b214-5d5ed1a6f0af None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:07.533402 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:07.536940 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:07.559140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 440/916] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 15:53:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:53:07.566077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 477/917] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:53:07.588766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291b2f7-20e5-445a-b214-5d5ed1a6f0af None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:07.711254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291b2f7-20e5-445a-b214-5d5ed1a6f0af None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:07.749493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18fa8b-d606-4a4a-9c5e-75efd936d9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:07.750341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18fa8b-d606-4a4a-9c5e-75efd936d9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:07.750625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18fa8b-d606-4a4a-9c5e-75efd936d9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:07.750931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18fa8b-d606-4a4a-9c5e-75efd936d9e2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:07.767177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18fa8b-d606-4a4a-9c5e-75efd936d9e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ac18fa8b-d606-4a4a-9c5e-75efd936d9e2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:53:07.775955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:07.776931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:07.777779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:07.777779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:07.777779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:07.777779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:07.777779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:53:07.777779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:53:07.777779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:53:07.777779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:53:07.777779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:53:07.777779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:53:07.777779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 15:53:07.777779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:07.777779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 441/918] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 21 15:53:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:07.787188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9354268-7a98-46c0-8c4c-699986bb0821 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:07.893799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9354268-7a98-46c0-8c4c-699986bb0821 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:07.918307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c1a02-f0f0-4361-b83e-3a8f52bd71fa None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:07.918641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c1a02-f0f0-4361-b83e-3a8f52bd71fa None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:07.918931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704c1a02-f0f0-4361-b83e-3a8f52bd71fa None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:07.924573 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 442/919] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:07.926707 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8841646-7449-4d5d-b862-5ca18c814011 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:07.927046 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8841646-7449-4d5d-b862-5ca18c814011 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:07.927323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8841646-7449-4d5d-b862-5ca18c814011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:07.941624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e04e4-163f-4682-bf24-5f36d155ad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:07.942361 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e04e4-163f-4682-bf24-5f36d155ad12 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:07.942640 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e04e4-163f-4682-bf24-5f36d155ad12 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:07.942948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e04e4-163f-4682-bf24-5f36d155ad12 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:07.943945 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e04e4-163f-4682-bf24-5f36d155ad12 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:07.944263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e04e4-163f-4682-bf24-5f36d155ad12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:07.945675 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e04e4-163f-4682-bf24-5f36d155ad12 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:07.949900 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b8841646-7449-4d5d-b862-5ca18c814011 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:07.951948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b8841646-7449-4d5d-b862-5ca18c814011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:07.956801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 478/920] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 21 15:53:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:07.962752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e04e4-163f-4682-bf24-5f36d155ad12 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:08.016330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:08.022686 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:08.042495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 443/921] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:08.069368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8841646-7449-4d5d-b862-5ca18c814011 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:08.089173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e04e4-163f-4682-bf24-5f36d155ad12 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:08.145230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0130bb-ba89-46e7-8440-b6e9b7c76d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:08.146109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0130bb-ba89-46e7-8440-b6e9b7c76d77 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:08.146400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0130bb-ba89-46e7-8440-b6e9b7c76d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:08.146675 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0130bb-ba89-46e7-8440-b6e9b7c76d77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:08.162237 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0130bb-ba89-46e7-8440-b6e9b7c76d77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:08.163755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0130bb-ba89-46e7-8440-b6e9b7c76d77 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:08.184526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-cc0130bb-ba89-46e7-8440-b6e9b7c76d77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:08.184526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:08.184526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:08.184526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:08.184526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:08.184526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:08.184526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:08.184526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:08.184526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:08.184526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:08.184526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:08.184526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:08.184526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:53:08.184526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:53:08.184526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:08.194707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:08.195765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:53:08.195765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:53:08.195765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:08.195765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:08.195765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 479/922] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:08.195765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44f5c-95ce-4d04-99e9-86fad63221bc None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:08.195765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44f5c-95ce-4d04-99e9-86fad63221bc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:08.195765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef44f5c-95ce-4d04-99e9-86fad63221bc None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:08.195765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 480/923] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:08.196295 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef44f5c-95ce-4d04-99e9-86fad63221bc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:08.209631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8841646-7449-4d5d-b862-5ca18c814011 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:08.260517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6ba20-30ef-47a2-9710-c8edb4486887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:08.261454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6ba20-30ef-47a2-9710-c8edb4486887 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:08.261801 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6ba20-30ef-47a2-9710-c8edb4486887 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:08.262080 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6ba20-30ef-47a2-9710-c8edb4486887 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:08.262747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6ba20-30ef-47a2-9710-c8edb4486887 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:08.264222 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e6ba20-30ef-47a2-9710-c8edb4486887 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-97e6ba20-30ef-47a2-9710-c8edb4486887 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:08.277280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:08.278297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:08.279197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 444/924] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Jul 21 15:53:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:08.280047 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21226bf-ad8b-4a0e-8366-8c79cbd8cb93 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:08.280047 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21226bf-ad8b-4a0e-8366-8c79cbd8cb93 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:08.280450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21226bf-ad8b-4a0e-8366-8c79cbd8cb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:08.304892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b21226bf-ad8b-4a0e-8366-8c79cbd8cb93 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:08.306097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b21226bf-ad8b-4a0e-8366-8c79cbd8cb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:08.327968 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:08.340304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef44f5c-95ce-4d04-99e9-86fad63221bc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:08.369457 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:08.380025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51a0d9-ee33-436a-b85e-9cf7e8728957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:08.380729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51a0d9-ee33-436a-b85e-9cf7e8728957 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:08.381199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51a0d9-ee33-436a-b85e-9cf7e8728957 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:08.381453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51a0d9-ee33-436a-b85e-9cf7e8728957 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:08.382208 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51a0d9-ee33-436a-b85e-9cf7e8728957 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:08.382556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51a0d9-ee33-436a-b85e-9cf7e8728957 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:08.383990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51a0d9-ee33-436a-b85e-9cf7e8728957 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:08.397152 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 445/925] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:08.397711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21226bf-ad8b-4a0e-8366-8c79cbd8cb93 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:08.408481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 481/926] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:08.414045 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51a0d9-ee33-436a-b85e-9cf7e8728957 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:08.534913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21226bf-ad8b-4a0e-8366-8c79cbd8cb93 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:08.551012 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51a0d9-ee33-436a-b85e-9cf7e8728957 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:08.577732 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0752e-b42b-4732-9912-c2f041a41b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:08.578521 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0752e-b42b-4732-9912-c2f041a41b23 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:08.578921 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0752e-b42b-4732-9912-c2f041a41b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:08.579804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0752e-b42b-4732-9912-c2f041a41b23 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:08.580709 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0752e-b42b-4732-9912-c2f041a41b23 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:08.581174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0752e-b42b-4732-9912-c2f041a41b23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:08.582615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd0752e-b42b-4732-9912-c2f041a41b23 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:08.590867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 446/927] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 15:53:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:08.590867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0752e-b42b-4732-9912-c2f041a41b23 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:08.600055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8b393-a90f-478c-be35-c6df649dbf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:08.600902 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8b393-a90f-478c-be35-c6df649dbf97 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:08.601190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8b393-a90f-478c-be35-c6df649dbf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:08.601466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8b393-a90f-478c-be35-c6df649dbf97 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:08.610310 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8b393-a90f-478c-be35-c6df649dbf97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:08.611812 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8b393-a90f-478c-be35-c6df649dbf97 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-19d8b393-a90f-478c-be35-c6df649dbf97 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:53:08.627270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:08.628641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:08.631011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:08.631011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:08.631011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:53:08.631011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:53:08.631011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:53:08.631011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:53:08.631011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:53:08.631011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:53:08.631011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 15:53:08.631011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:08.631011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 482/928] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 15:53:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:08.631011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8b393-a90f-478c-be35-c6df649dbf97 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:08.648063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:08.651189 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:08.714158 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0752e-b42b-4732-9912-c2f041a41b23 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:08.754355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d08263-a484-48c1-b780-4fb0dcddcb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:08.755085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d08263-a484-48c1-b780-4fb0dcddcb3d None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:08.755371 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d08263-a484-48c1-b780-4fb0dcddcb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:08.755788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d08263-a484-48c1-b780-4fb0dcddcb3d None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:08.756550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d08263-a484-48c1-b780-4fb0dcddcb3d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:08.757971 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d08263-a484-48c1-b780-4fb0dcddcb3d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:08.762847 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8b393-a90f-478c-be35-c6df649dbf97 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:08.786861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 447/929] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 15:53:08 2022] POST /identity/v3/services => generated 241 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:53:08.786861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d08263-a484-48c1-b780-4fb0dcddcb3d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:08.809071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73119b-14c3-4c78-9728-119248dc650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:08.809837 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73119b-14c3-4c78-9728-119248dc650f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:08.810099 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73119b-14c3-4c78-9728-119248dc650f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:08.810381 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73119b-14c3-4c78-9728-119248dc650f None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:08.811219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73119b-14c3-4c78-9728-119248dc650f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:08.811533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73119b-14c3-4c78-9728-119248dc650f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:08.813078 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73119b-14c3-4c78-9728-119248dc650f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:08.824341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 483/930] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 15:53:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:08.825727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73119b-14c3-4c78-9728-119248dc650f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:08.933590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:08.962471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73119b-14c3-4c78-9728-119248dc650f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:08.964212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d08263-a484-48c1-b780-4fb0dcddcb3d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:08.968584 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:09.007260 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8057596-af47-4615-bd86-e25aca32f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:09.008348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8057596-af47-4615-bd86-e25aca32f6d7 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:09.008779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8057596-af47-4615-bd86-e25aca32f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:09.009067 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8057596-af47-4615-bd86-e25aca32f6d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:09.009827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8057596-af47-4615-bd86-e25aca32f6d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:09.011251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8057596-af47-4615-bd86-e25aca32f6d7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:09.013230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390cbac-6aa2-4fbc-a4d2-59947418c7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:09.014082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390cbac-6aa2-4fbc-a4d2-59947418c7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:09.014369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390cbac-6aa2-4fbc-a4d2-59947418c7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:09.014644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390cbac-6aa2-4fbc-a4d2-59947418c7b2 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:09.015528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390cbac-6aa2-4fbc-a4d2-59947418c7b2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:09.016253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390cbac-6aa2-4fbc-a4d2-59947418c7b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:09.017797 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390cbac-6aa2-4fbc-a4d2-59947418c7b2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:09.040933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 448/931] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 21 15:53:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:09.041307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 484/932] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 15:53:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:53:09.046889 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390cbac-6aa2-4fbc-a4d2-59947418c7b2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:09.173806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390cbac-6aa2-4fbc-a4d2-59947418c7b2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:09.222125 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9dfb5-b4bc-484a-90e8-cd1c45f130a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:09.223033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9dfb5-b4bc-484a-90e8-cd1c45f130a6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:09.223326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9dfb5-b4bc-484a-90e8-cd1c45f130a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:09.223603 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9dfb5-b4bc-484a-90e8-cd1c45f130a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:09.235812 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9dfb5-b4bc-484a-90e8-cd1c45f130a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:09.237472 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9dfb5-b4bc-484a-90e8-cd1c45f130a6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:09.256762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f3f9dfb5-b4bc-484a-90e8-cd1c45f130a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:09.256762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:09.256762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:09.256762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:09.256762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:09.256762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:09.256762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:09.256762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:09.256762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:09.256762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:09.256762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:09.256762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:09.256762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:53:09.256762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:53:09.256762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:09.257737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:09.259000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:53:09.259000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:53:09.259000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:09.259000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:09.259000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 449/933] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:09.264241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8057596-af47-4615-bd86-e25aca32f6d7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:09.375264 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8057596-af47-4615-bd86-e25aca32f6d7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:09.407672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:09.414157 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72dec7-94b9-4bbe-aa5c-7ad21e7664d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:09.415267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72dec7-94b9-4bbe-aa5c-7ad21e7664d4 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:09.415737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72dec7-94b9-4bbe-aa5c-7ad21e7664d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:09.416122 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72dec7-94b9-4bbe-aa5c-7ad21e7664d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:09.416880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72dec7-94b9-4bbe-aa5c-7ad21e7664d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:09.417196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72dec7-94b9-4bbe-aa5c-7ad21e7664d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:09.418605 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72dec7-94b9-4bbe-aa5c-7ad21e7664d4 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:09.432506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 485/934] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:09.437987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9dfb5-b4bc-484a-90e8-cd1c45f130a6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:09.451591 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:09.550642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9dfb5-b4bc-484a-90e8-cd1c45f130a6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:09.587973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f28414-64d5-4efc-9a62-397897be289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:09.588804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f28414-64d5-4efc-9a62-397897be289f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:09.589085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f28414-64d5-4efc-9a62-397897be289f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:09.589358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f28414-64d5-4efc-9a62-397897be289f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:09.597467 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f28414-64d5-4efc-9a62-397897be289f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:09.598984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f28414-64d5-4efc-9a62-397897be289f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:09.613867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-58f28414-64d5-4efc-9a62-397897be289f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:09.613867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:09.613867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:09.613867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:09.613867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:09.613867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:09.613867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:09.613867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:09.613867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:09.613867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:09.613867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:09.613867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:09.613867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:53:09.613867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:53:09.613867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:09.615592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:09.617962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:53:09.617962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:53:09.617962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:53:09.617962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:53:09.617962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:53:09.617962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:53:09.617962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:09.617962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:09.617962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 450/935] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:09.622349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72dec7-94b9-4bbe-aa5c-7ad21e7664d4 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:09.729050 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d80f5-879d-451c-b1f5-3deeae112608 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:09.729699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d80f5-879d-451c-b1f5-3deeae112608 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:09.729699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35d80f5-879d-451c-b1f5-3deeae112608 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:09.731129 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 451/936] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:09.738783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c30ce-72d1-4b09-afbf-af1da7feb926 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:09.739145 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c30ce-72d1-4b09-afbf-af1da7feb926 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:09.739542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c30ce-72d1-4b09-afbf-af1da7feb926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:09.759182 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-300c30ce-72d1-4b09-afbf-af1da7feb926 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:09.760425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-300c30ce-72d1-4b09-afbf-af1da7feb926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:09.765830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72dec7-94b9-4bbe-aa5c-7ad21e7664d4 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:09.810554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b40612-e733-47c2-894c-c2b25e5fe0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:09.812282 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b40612-e733-47c2-894c-c2b25e5fe0d1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:09.812746 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b40612-e733-47c2-894c-c2b25e5fe0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:09.813198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b40612-e733-47c2-894c-c2b25e5fe0d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:09.814205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b40612-e733-47c2-894c-c2b25e5fe0d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:09.815129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b40612-e733-47c2-894c-c2b25e5fe0d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:09.817113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b40612-e733-47c2-894c-c2b25e5fe0d1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:09.834896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 452/937] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:09.834896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:09.841601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 486/938] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:53:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:09.849785 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c30ce-72d1-4b09-afbf-af1da7feb926 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:09.864142 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b40612-e733-47c2-894c-c2b25e5fe0d1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:09.936714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:09.964487 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c30ce-72d1-4b09-afbf-af1da7feb926 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:10.006847 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b40612-e733-47c2-894c-c2b25e5fe0d1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:10.008927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20afcc2-ba9c-40a7-9169-bdd11603c80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:10.011511 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20afcc2-ba9c-40a7-9169-bdd11603c80a None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:10.012039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20afcc2-ba9c-40a7-9169-bdd11603c80a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:10.012519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20afcc2-ba9c-40a7-9169-bdd11603c80a None admin] PATH_INFO: `/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/8d1d0d0f2d544d41a86f1e0dda8d110c/roles/e9d9c03727a34b14af8c89c7839193cc` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:10.015297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20afcc2-ba9c-40a7-9169-bdd11603c80a None admin] RBAC: Authorizing `identity:create_grant(project_id=0d717ed2993d4a3ab21195028a16e747, user_id=8d1d0d0f2d544d41a86f1e0dda8d110c, role_id=e9d9c03727a34b14af8c89c7839193cc)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:10.017720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20afcc2-ba9c-40a7-9169-bdd11603c80a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:10.038866 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 453/939] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:53:09 2022] PUT /identity/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/8d1d0d0f2d544d41a86f1e0dda8d110c/roles/e9d9c03727a34b14af8c89c7839193cc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:53:10.070338 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb55f53-1e5d-459e-a80f-e3f12ce9d5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:10.071476 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb55f53-1e5d-459e-a80f-e3f12ce9d5c3 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:10.072036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb55f53-1e5d-459e-a80f-e3f12ce9d5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:10.072585 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb55f53-1e5d-459e-a80f-e3f12ce9d5c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:10.073564 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb55f53-1e5d-459e-a80f-e3f12ce9d5c3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:10.075466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb55f53-1e5d-459e-a80f-e3f12ce9d5c3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:10.077279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: WARNING keystone.server.flask.common [None req-8cb55f53-1e5d-459e-a80f-e3f12ce9d5c3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 15:53:10.102613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.sql.core [None req-8cb55f53-1e5d-459e-a80f-e3f12ce9d5c3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 15:53:10.102613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 15:53:10.102613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [parameters: {'id': '2323746db9614212af92ecd20539510c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 15:53:10.102613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80252) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 15:53:10.122990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-8cb55f53-1e5d-459e-a80f-e3f12ce9d5c3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2323746db9614212af92ecd20539510c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2323746db9614212af92ecd20539510c. Jul 21 15:53:10.122990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:10.122990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 15:53:10.122990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 15:53:10.122990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 15:53:10.122990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 15:53:10.122990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 15:53:10.122990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 15:53:10.122990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 15:53:10.122990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application conn.query(q) Jul 21 15:53:10.122990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 15:53:10.122990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 15:53:10.122990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result.read() Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 15:53:10.123938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application next(self.gen) Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application yield resource Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application next(self.gen) Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise self.value Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application session.commit() Jul 21 15:53:10.124932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.session.flush() Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application compat.raise_( Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 15:53:10.125866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 15:53:10.127639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 15:53:10.127639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 15:53:10.127639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 15:53:10.127639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 15:53:10.127639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 15:53:10.127639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 15:53:10.127639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 15:53:10.127639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 15:53:10.127639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 15:53:10.127639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 15:53:10.127639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 15:53:10.127639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 15:53:10.127639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 15:53:10.127639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 15:53:10.127639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application conn.query(q) Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result.read() Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 15:53:10.128505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 15:53:10.129356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 15:53:10.129356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 15:53:10.129356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 15:53:10.129356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 15:53:10.129356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 15:53:10.129356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 15:53:10.129356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 15:53:10.129356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 15:53:10.129356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [parameters: {'id': '2323746db9614212af92ecd20539510c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 15:53:10.129356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 15:53:10.129356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:10.129356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:10.129356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:10.129356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:10.129356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:10.130874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:10.133094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:10.133094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 15:53:10.133094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 15:53:10.133094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:10.133094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:10.133094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 15:53:10.133094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 15:53:10.133094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2323746db9614212af92ecd20539510c. Jul 21 15:53:10.133094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:10.136305 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 487/940] 10.222.0.64 () {60 vars in 1140 bytes} [Thu Jul 21 15:53:09 2022] POST /identity/v3/projects => generated 262 bytes in 273 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:10.142874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20afcc2-ba9c-40a7-9169-bdd11603c80a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:10.221380 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:10.277550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20afcc2-ba9c-40a7-9169-bdd11603c80a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:10.318510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364d7e9-df16-4c0b-a514-6a031ce38c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:10.319606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364d7e9-df16-4c0b-a514-6a031ce38c30 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:10.319995 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364d7e9-df16-4c0b-a514-6a031ce38c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:10.320361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364d7e9-df16-4c0b-a514-6a031ce38c30 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:10.328333 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364d7e9-df16-4c0b-a514-6a031ce38c30 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:10.329983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364d7e9-df16-4c0b-a514-6a031ce38c30 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:10.345987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-6364d7e9-df16-4c0b-a514-6a031ce38c30 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:10.345987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:10.345987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:10.345987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:10.345987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:10.345987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:10.345987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:10.345987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:10.345987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:10.345987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:10.345987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:10.345987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:10.345987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:53:10.345987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:53:10.345987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:10.347547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:10.348638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:53:10.348638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:53:10.348638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:53:10.348638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:53:10.348638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:53:10.348638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:53:10.348638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:10.348638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:10.350409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 454/941] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:53:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:10.357409 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb55f53-1e5d-459e-a80f-e3f12ce9d5c3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:10.481090 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb55f53-1e5d-459e-a80f-e3f12ce9d5c3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:10.492747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:10.521552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646b430-4e74-49dd-98a0-83d951a4b479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:10.522224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646b430-4e74-49dd-98a0-83d951a4b479 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:10.522506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646b430-4e74-49dd-98a0-83d951a4b479 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:10.522781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646b430-4e74-49dd-98a0-83d951a4b479 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:10.523578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646b430-4e74-49dd-98a0-83d951a4b479 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:10.523885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646b430-4e74-49dd-98a0-83d951a4b479 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:10.525519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646b430-4e74-49dd-98a0-83d951a4b479 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:10.548387 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 488/942] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 15:53:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:11.001067 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8507-f287-45b1-851d-34624274b08c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:11.001807 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8507-f287-45b1-851d-34624274b08c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:11.001807 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8507-f287-45b1-851d-34624274b08c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:11.003337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 455/943] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:11.008855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eec258-845b-4b1c-af0c-b9be17244971 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:11.009450 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eec258-845b-4b1c-af0c-b9be17244971 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:11.009450 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eec258-845b-4b1c-af0c-b9be17244971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:11.027135 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e2eec258-845b-4b1c-af0c-b9be17244971 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:11.028661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e2eec258-845b-4b1c-af0c-b9be17244971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:11.104441 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 489/944] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:11.133458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a8507-f287-45b1-851d-34624274b08c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:11.189551 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e34302-e3af-4597-b962-3840c1aebb94 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:11.189981 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e34302-e3af-4597-b962-3840c1aebb94 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:11.190193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e34302-e3af-4597-b962-3840c1aebb94 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:11.191968 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 490/945] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:11.197223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89ae22-9dbd-4c4f-b8db-4474f33da32f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:11.202865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89ae22-9dbd-4c4f-b8db-4474f33da32f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:11.202865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89ae22-9dbd-4c4f-b8db-4474f33da32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:11.216751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7e89ae22-9dbd-4c4f-b8db-4474f33da32f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:11.219101 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7e89ae22-9dbd-4c4f-b8db-4474f33da32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:11.256772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7a8507-f287-45b1-851d-34624274b08c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:11.286312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:11.306901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603771ca-dbeb-4db3-9c3d-fc0aa19b76b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:11.307740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603771ca-dbeb-4db3-9c3d-fc0aa19b76b1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:11.308022 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603771ca-dbeb-4db3-9c3d-fc0aa19b76b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:11.308296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603771ca-dbeb-4db3-9c3d-fc0aa19b76b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:11.308962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603771ca-dbeb-4db3-9c3d-fc0aa19b76b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:11.309559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 491/946] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:53:11.310349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603771ca-dbeb-4db3-9c3d-fc0aa19b76b1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-603771ca-dbeb-4db3-9c3d-fc0aa19b76b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:11.327840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:11.329002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:11.329924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:11.329924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:11.329924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:11.329924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:11.329924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:11.329924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:11.329924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:11.329924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:11.329924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:11.329924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:11.329924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:53:11.329924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:11.329924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 15:53:11.329924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:11.329924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 456/947] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 15:53:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:11.332674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89ae22-9dbd-4c4f-b8db-4474f33da32f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:11.335916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603771ca-dbeb-4db3-9c3d-fc0aa19b76b1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:11.365472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:11.457065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89ae22-9dbd-4c4f-b8db-4474f33da32f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:11.479753 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603771ca-dbeb-4db3-9c3d-fc0aa19b76b1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:11.492439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143cf35-0c15-4837-983a-00aaae4bf249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:11.493216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143cf35-0c15-4837-983a-00aaae4bf249 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:11.493496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143cf35-0c15-4837-983a-00aaae4bf249 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:11.493769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143cf35-0c15-4837-983a-00aaae4bf249 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:11.494427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143cf35-0c15-4837-983a-00aaae4bf249 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:11.496041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4143cf35-0c15-4837-983a-00aaae4bf249 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-4143cf35-0c15-4837-983a-00aaae4bf249 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:11.507971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:11.508960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:11.509781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:11.509781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:11.509781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:11.509781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:11.509781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:11.509781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:11.509781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:11.509781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:11.509781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:11.509781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:11.509781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:53:11.509781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:11.509781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 15:53:11.509781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:11.509781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 492/948] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:53:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:11.514768 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143cf35-0c15-4837-983a-00aaae4bf249 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:11.524598 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbe323-ea30-4b15-b0a5-5a6061fc85d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:11.525263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbe323-ea30-4b15-b0a5-5a6061fc85d6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:11.525542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbe323-ea30-4b15-b0a5-5a6061fc85d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:11.525814 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbe323-ea30-4b15-b0a5-5a6061fc85d6 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:11.526522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbe323-ea30-4b15-b0a5-5a6061fc85d6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:11.526838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbe323-ea30-4b15-b0a5-5a6061fc85d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:11.528240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbe323-ea30-4b15-b0a5-5a6061fc85d6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:11.538058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 457/949] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 15:53:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:11.539254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbe323-ea30-4b15-b0a5-5a6061fc85d6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:11.589428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:11.638851 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:11.651047 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbe323-ea30-4b15-b0a5-5a6061fc85d6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:11.651777 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4143cf35-0c15-4837-983a-00aaae4bf249 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:11.693032 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d5ede-55f2-45c1-a8f8-5380697759af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:11.693744 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d5ede-55f2-45c1-a8f8-5380697759af None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:11.693992 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d5ede-55f2-45c1-a8f8-5380697759af None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:11.694265 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45d5ede-55f2-45c1-a8f8-5380697759af None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:11.695039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d5ede-55f2-45c1-a8f8-5380697759af None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:11.695312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d5ede-55f2-45c1-a8f8-5380697759af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:11.696703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45d5ede-55f2-45c1-a8f8-5380697759af None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:11.699742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63acb2-466e-49d5-b847-a557c7b2d9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:11.700721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63acb2-466e-49d5-b847-a557c7b2d9ad None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:11.701221 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63acb2-466e-49d5-b847-a557c7b2d9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:11.701752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63acb2-466e-49d5-b847-a557c7b2d9ad None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:11.702714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63acb2-466e-49d5-b847-a557c7b2d9ad None admin] RBAC: Adding query filter params (name=compute) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:11.703348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63acb2-466e-49d5-b847-a557c7b2d9ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:11.704954 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63acb2-466e-49d5-b847-a557c7b2d9ad None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:11.707349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 458/950] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 15:53:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:11.708641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d5ede-55f2-45c1-a8f8-5380697759af None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:11.711808 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 493/951] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 15:53:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:11.717629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63acb2-466e-49d5-b847-a557c7b2d9ad None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:11.817863 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45d5ede-55f2-45c1-a8f8-5380697759af None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:11.831792 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:11.833523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63acb2-466e-49d5-b847-a557c7b2d9ad None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:11.858737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973480f-8759-481e-86dc-15f1d4d5096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:11.859571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973480f-8759-481e-86dc-15f1d4d5096d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:11.859887 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973480f-8759-481e-86dc-15f1d4d5096d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:11.860172 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973480f-8759-481e-86dc-15f1d4d5096d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:11.861149 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973480f-8759-481e-86dc-15f1d4d5096d None admin] RBAC: Adding query filter params (interface=public, service_id=341c6deb3a1d4a9996c3a71dfaf8673d, region_id=RegionOne) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:11.861471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973480f-8759-481e-86dc-15f1d4d5096d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:11.863067 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973480f-8759-481e-86dc-15f1d4d5096d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:11.873947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 459/952] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 15:53:11 2022] GET /identity/v3/endpoints?service_id=341c6deb3a1d4a9996c3a71dfaf8673d&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:11.875608 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973480f-8759-481e-86dc-15f1d4d5096d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:11.879432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee63b05-bde9-4a5b-92c7-4a64128d6d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:11.880265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee63b05-bde9-4a5b-92c7-4a64128d6d97 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:11.880381 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee63b05-bde9-4a5b-92c7-4a64128d6d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:11.880665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee63b05-bde9-4a5b-92c7-4a64128d6d97 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:11.881391 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee63b05-bde9-4a5b-92c7-4a64128d6d97 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:11.881699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee63b05-bde9-4a5b-92c7-4a64128d6d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:11.883116 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee63b05-bde9-4a5b-92c7-4a64128d6d97 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:11.888575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 494/953] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 15:53:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:11.996262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973480f-8759-481e-86dc-15f1d4d5096d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:12.035065 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ab51e-3c83-4800-a52c-136efade7c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:12.036655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ab51e-3c83-4800-a52c-136efade7c54 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:12.037149 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ab51e-3c83-4800-a52c-136efade7c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:12.037638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ab51e-3c83-4800-a52c-136efade7c54 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:12.038537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ab51e-3c83-4800-a52c-136efade7c54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:12.040273 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ab51e-3c83-4800-a52c-136efade7c54 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:12.052236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 460/954] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 15:53:11 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 15:53:12.306705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a42317-3de9-4490-8711-1b75ebabc63d None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:12.307290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a42317-3de9-4490-8711-1b75ebabc63d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:12.307290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a42317-3de9-4490-8711-1b75ebabc63d None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:12.308983 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 495/955] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:53:12.314552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c11a32-ab6c-4ef3-b5f2-f343972fc38f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:12.314910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c11a32-ab6c-4ef3-b5f2-f343972fc38f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:12.315203 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c11a32-ab6c-4ef3-b5f2-f343972fc38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:12.332716 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b1c11a32-ab6c-4ef3-b5f2-f343972fc38f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:12.333908 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b1c11a32-ab6c-4ef3-b5f2-f343972fc38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:12.370542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:12.407042 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 461/956] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:12.431897 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a42317-3de9-4490-8711-1b75ebabc63d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:12.455575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:12.541122 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a42317-3de9-4490-8711-1b75ebabc63d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:12.575798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970604fa-ede3-449f-92fd-a9ebffed01fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:12.576625 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970604fa-ede3-449f-92fd-a9ebffed01fd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:12.576906 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970604fa-ede3-449f-92fd-a9ebffed01fd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:12.577180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970604fa-ede3-449f-92fd-a9ebffed01fd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:12.588729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970604fa-ede3-449f-92fd-a9ebffed01fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-970604fa-ede3-449f-92fd-a9ebffed01fd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:53:12.596921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:12.598229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:12.599363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:12.599363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:12.599363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:12.599363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:12.599363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:53:12.599363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:53:12.599363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:53:12.599363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:53:12.599363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:53:12.599363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:53:12.599363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 15:53:12.599363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:12.599363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 496/957] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 21 15:53:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:12.604530 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c11a32-ab6c-4ef3-b5f2-f343972fc38f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:12.707176 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c11a32-ab6c-4ef3-b5f2-f343972fc38f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:12.731262 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021002-6c53-436e-a879-8d3197dda647 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:12.731620 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021002-6c53-436e-a879-8d3197dda647 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:12.731816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021002-6c53-436e-a879-8d3197dda647 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:12.733425 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 497/958] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:53:12.738675 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243d11a-4dad-4311-83eb-5f5ebb784907 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:12.738991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243d11a-4dad-4311-83eb-5f5ebb784907 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:12.739274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0243d11a-4dad-4311-83eb-5f5ebb784907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:12.746876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa8ce4-0c2e-4421-8633-0c914d3dd67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:12.747905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa8ce4-0c2e-4421-8633-0c914d3dd67e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:12.748381 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa8ce4-0c2e-4421-8633-0c914d3dd67e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:12.748867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa8ce4-0c2e-4421-8633-0c914d3dd67e None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:12.749825 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa8ce4-0c2e-4421-8633-0c914d3dd67e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:12.750345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa8ce4-0c2e-4421-8633-0c914d3dd67e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:12.753099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa8ce4-0c2e-4421-8633-0c914d3dd67e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:12.757176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0243d11a-4dad-4311-83eb-5f5ebb784907 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:12.758386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0243d11a-4dad-4311-83eb-5f5ebb784907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:12.764306 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 462/959] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 21 15:53:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:12.771952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa8ce4-0c2e-4421-8633-0c914d3dd67e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:12.823229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:12.847414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 498/960] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:53:12.862675 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243d11a-4dad-4311-83eb-5f5ebb784907 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:12.876936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:12.908441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa8ce4-0c2e-4421-8633-0c914d3dd67e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:12.944184 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706d4db-eb59-4aae-8ed2-81b0784171fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:12.944691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706d4db-eb59-4aae-8ed2-81b0784171fa None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:12.944971 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706d4db-eb59-4aae-8ed2-81b0784171fa None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:12.945246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706d4db-eb59-4aae-8ed2-81b0784171fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:12.956623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706d4db-eb59-4aae-8ed2-81b0784171fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:12.958290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706d4db-eb59-4aae-8ed2-81b0784171fa None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:12.971648 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0243d11a-4dad-4311-83eb-5f5ebb784907 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:12.976073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-9706d4db-eb59-4aae-8ed2-81b0784171fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:12.976073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:12.976073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:12.976073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:12.976073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:12.976073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:12.976073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:12.976073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:12.976073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:12.976073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:12.976073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:12.976073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:12.976073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:53:12.976073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:53:12.976073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:12.977015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:12.977905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:53:12.977905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:53:12.977905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:12.977905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:12.977905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 463/961] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:12.983426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706d4db-eb59-4aae-8ed2-81b0784171fa None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:13.012797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a822c2-3364-4406-b0e9-25e7809adf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:13.013874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a822c2-3364-4406-b0e9-25e7809adf4f None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:13.014386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a822c2-3364-4406-b0e9-25e7809adf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:13.014889 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a822c2-3364-4406-b0e9-25e7809adf4f None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:13.015810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a822c2-3364-4406-b0e9-25e7809adf4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:13.017449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a822c2-3364-4406-b0e9-25e7809adf4f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:13.032302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.sql.core [None req-d3a822c2-3364-4406-b0e9-25e7809adf4f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 15:53:13.032302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 15:53:13.032302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [parameters: {'user_id': 'ba67d4c6ea144675a5396dfbd7cd72be', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 15:53:13.032302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80252) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 15:53:13.042571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d3a822c2-3364-4406-b0e9-25e7809adf4f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 15:53:13.042571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:13.042571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 15:53:13.042571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 15:53:13.042571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 15:53:13.042571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 15:53:13.042571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 15:53:13.042571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 15:53:13.042571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 15:53:13.042571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application conn.query(q) Jul 21 15:53:13.042571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 15:53:13.042571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 15:53:13.042571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 15:53:13.042571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result.read() Jul 21 15:53:13.042571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 15:53:13.043569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application next(self.gen) Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application yield resource Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application next(self.gen) Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise self.value Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application session.commit() Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 15:53:13.044547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.session.flush() Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application compat.raise_( Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 15:53:13.045444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 15:53:13.046382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application conn.query(q) Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application result.read() Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 15:53:13.052879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 15:53:13.053736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 15:53:13.053736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 15:53:13.053736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 15:53:13.053736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 15:53:13.053736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 15:53:13.053736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 15:53:13.053736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ba67d4c6ea144675a5396dfbd7cd72be', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 15:53:13.053736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 15:53:13.053736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:13.053736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:13.053736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:13.053736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:13.053736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:13.053736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:13.053736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 15:53:13.054560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 15:53:13.055610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 15:53:13.055610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 15:53:13.055610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 15:53:13.055610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 15:53:13.055610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 15:53:13.055610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:13.055610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 499/962] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Jul 21 15:53:12 2022] POST /identity/v3/users => generated 160 bytes in 186 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:13.058559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a822c2-3364-4406-b0e9-25e7809adf4f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:13.098068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:13.117260 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706d4db-eb59-4aae-8ed2-81b0784171fa None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:13.143522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:13.156515 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426cce0-2315-40e6-8037-7d81d44fcf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:13.157708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426cce0-2315-40e6-8037-7d81d44fcf0a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:13.158219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426cce0-2315-40e6-8037-7d81d44fcf0a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:13.158774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426cce0-2315-40e6-8037-7d81d44fcf0a None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:13.159818 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426cce0-2315-40e6-8037-7d81d44fcf0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:13.160337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426cce0-2315-40e6-8037-7d81d44fcf0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:13.162000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426cce0-2315-40e6-8037-7d81d44fcf0a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:13.178598 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 464/963] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:13.184938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426cce0-2315-40e6-8037-7d81d44fcf0a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:13.190970 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a822c2-3364-4406-b0e9-25e7809adf4f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:13.230148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141b91b-fb47-4a53-9cf4-4d246108cffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:13.230920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141b91b-fb47-4a53-9cf4-4d246108cffc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:13.231202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141b91b-fb47-4a53-9cf4-4d246108cffc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:13.231477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141b91b-fb47-4a53-9cf4-4d246108cffc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:13.240500 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141b91b-fb47-4a53-9cf4-4d246108cffc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:13.242172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141b91b-fb47-4a53-9cf4-4d246108cffc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-6141b91b-fb47-4a53-9cf4-4d246108cffc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:53:13.257467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:13.258502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:13.259499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:13.259499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:13.259499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:53:13.259499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:53:13.259499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:53:13.259499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:53:13.259499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:53:13.259499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:53:13.259499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 15:53:13.259499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:13.263631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 500/964] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:53:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:13.264784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141b91b-fb47-4a53-9cf4-4d246108cffc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:13.311049 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426cce0-2315-40e6-8037-7d81d44fcf0a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:13.349196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c925ff-0ef6-4f85-8e51-68584c7be8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:13.350426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c925ff-0ef6-4f85-8e51-68584c7be8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:13.350964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c925ff-0ef6-4f85-8e51-68584c7be8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:13.351463 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c925ff-0ef6-4f85-8e51-68584c7be8f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:13.360400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c925ff-0ef6-4f85-8e51-68584c7be8f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:13.362324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c925ff-0ef6-4f85-8e51-68584c7be8f5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:13.368949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141b91b-fb47-4a53-9cf4-4d246108cffc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a0c925ff-0ef6-4f85-8e51-68584c7be8f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:53:13.380180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:13.381189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:13.382140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:13.382140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:13.382140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:53:13.382140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:53:13.382140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:53:13.382140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:53:13.382140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:53:13.382140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:53:13.382140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 15:53:13.382140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:13.389580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 465/965] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 15:53:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:13.390870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c925ff-0ef6-4f85-8e51-68584c7be8f5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:13.395196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:13.400912 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:13.409966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df32ae-9778-40af-9331-74462b0bc501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:13.410662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df32ae-9778-40af-9331-74462b0bc501 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:13.411041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df32ae-9778-40af-9331-74462b0bc501 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:13.411569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df32ae-9778-40af-9331-74462b0bc501 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:13.412911 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df32ae-9778-40af-9331-74462b0bc501 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:13.413361 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df32ae-9778-40af-9331-74462b0bc501 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:13.414825 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df32ae-9778-40af-9331-74462b0bc501 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:13.463237 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 501/966] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Jul 21 15:53:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:13.508158 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c925ff-0ef6-4f85-8e51-68584c7be8f5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:13.551159 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bbed9-67cc-47b1-af79-0fb08ed08d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:13.552298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bbed9-67cc-47b1-af79-0fb08ed08d0b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:13.552802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bbed9-67cc-47b1-af79-0fb08ed08d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:13.553299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bbed9-67cc-47b1-af79-0fb08ed08d0b None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:13.554404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bbed9-67cc-47b1-af79-0fb08ed08d0b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:13.554977 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bbed9-67cc-47b1-af79-0fb08ed08d0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:13.556796 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bbed9-67cc-47b1-af79-0fb08ed08d0b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:13.581349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 466/967] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Jul 21 15:53:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:13.587859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df32ae-9778-40af-9331-74462b0bc501 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:13.712150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df32ae-9778-40af-9331-74462b0bc501 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:13.752866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d0465-5999-4416-b3b3-31e429ef3da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:13.753934 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d0465-5999-4416-b3b3-31e429ef3da6 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:13.754358 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d0465-5999-4416-b3b3-31e429ef3da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:13.754780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d0465-5999-4416-b3b3-31e429ef3da6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:13.829445 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:13.843334 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d0465-5999-4416-b3b3-31e429ef3da6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:13.845530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d0465-5999-4416-b3b3-31e429ef3da6 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:13.960426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 502/968] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:53:13 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:53:13.965984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bbed9-67cc-47b1-af79-0fb08ed08d0b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:14.037643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:14.066203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513607f7-c404-4c01-9302-33dfe9f4796e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:14.066203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513607f7-c404-4c01-9302-33dfe9f4796e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:14.066203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513607f7-c404-4c01-9302-33dfe9f4796e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:14.066679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 503/969] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:14.072180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ca13b-a935-41ba-8de9-561ae692f7ba None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:14.072453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ca13b-a935-41ba-8de9-561ae692f7ba None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:14.072737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ca13b-a935-41ba-8de9-561ae692f7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:14.083293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bbed9-67cc-47b1-af79-0fb08ed08d0b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:14.093802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-224ca13b-a935-41ba-8de9-561ae692f7ba None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:14.095561 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-224ca13b-a935-41ba-8de9-561ae692f7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:14.124855 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb288f-6bfa-4829-a733-3fed0c3735ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:14.125660 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb288f-6bfa-4829-a733-3fed0c3735ca None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:14.125912 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb288f-6bfa-4829-a733-3fed0c3735ca None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:14.126211 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb288f-6bfa-4829-a733-3fed0c3735ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:14.140000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb288f-6bfa-4829-a733-3fed0c3735ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:14.141794 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb288f-6bfa-4829-a733-3fed0c3735ca None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:14.163167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4ddb288f-6bfa-4829-a733-3fed0c3735ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:14.163167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:14.163167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:14.163167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:14.163167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:14.163167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:14.163167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:14.163167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:14.163167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:14.163167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:14.163167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:14.163167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:14.163167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:53:14.163167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:53:14.163167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:14.164174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:14.165053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:53:14.165053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:53:14.165053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:14.165053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:14.165053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 467/970] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:14.165821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b332f0-adbf-4905-b755-581da7243693 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:14.165926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b332f0-adbf-4905-b755-581da7243693 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:14.166197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b332f0-adbf-4905-b755-581da7243693 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:14.167641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 468/971] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:14.170301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b332f0-adbf-4905-b755-581da7243693 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:14.185053 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 504/972] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:14.186515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b9c7a-8bbc-4f19-a45b-4cbacc12a3e7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:14.186801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b9c7a-8bbc-4f19-a45b-4cbacc12a3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:14.187127 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b9c7a-8bbc-4f19-a45b-4cbacc12a3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:14.209076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c55b9c7a-8bbc-4f19-a45b-4cbacc12a3e7 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:14.210298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c55b9c7a-8bbc-4f19-a45b-4cbacc12a3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:14.227192 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:14.291070 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b332f0-adbf-4905-b755-581da7243693 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:14.297397 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 505/973] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:14.298250 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b9c7a-8bbc-4f19-a45b-4cbacc12a3e7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:14.307269 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:14.333173 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43529b49-f0c0-4f5c-bc20-334a759dc5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:14.333895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43529b49-f0c0-4f5c-bc20-334a759dc5ef None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:14.334120 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43529b49-f0c0-4f5c-bc20-334a759dc5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:14.334393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43529b49-f0c0-4f5c-bc20-334a759dc5ef None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:14.335158 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43529b49-f0c0-4f5c-bc20-334a759dc5ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:14.335474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43529b49-f0c0-4f5c-bc20-334a759dc5ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:14.337039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43529b49-f0c0-4f5c-bc20-334a759dc5ef None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:14.349030 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 469/974] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:14.351756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43529b49-f0c0-4f5c-bc20-334a759dc5ef None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:14.411681 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b9c7a-8bbc-4f19-a45b-4cbacc12a3e7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:14.458333 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c48e9-e90d-48ce-af39-79d931964283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:14.459039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c48e9-e90d-48ce-af39-79d931964283 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:14.459308 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c48e9-e90d-48ce-af39-79d931964283 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:14.459583 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c48e9-e90d-48ce-af39-79d931964283 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:14.460314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c48e9-e90d-48ce-af39-79d931964283 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:14.461686 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c48e9-e90d-48ce-af39-79d931964283 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:14.464919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43529b49-f0c0-4f5c-bc20-334a759dc5ef None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:14.478496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 506/975] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 15:53:14 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:53:14.479385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c48e9-e90d-48ce-af39-79d931964283 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:14.495252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:14.526247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc68b62-fd1c-4506-b88a-acee7a564903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:14.527014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc68b62-fd1c-4506-b88a-acee7a564903 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:14.527291 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc68b62-fd1c-4506-b88a-acee7a564903 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:14.527557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc68b62-fd1c-4506-b88a-acee7a564903 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:14.528238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc68b62-fd1c-4506-b88a-acee7a564903 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:14.529670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc68b62-fd1c-4506-b88a-acee7a564903 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-cfc68b62-fd1c-4506-b88a-acee7a564903 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:14.543704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:14.546258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:14.547210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:14.547210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:14.547210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:14.547210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:14.547210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:14.547210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:14.547210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:14.547210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:14.547210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:14.547210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:14.547210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:53:14.547210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:14.547210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 15:53:14.547210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:14.547210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 470/976] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 15:53:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:14.551542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc68b62-fd1c-4506-b88a-acee7a564903 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:14.594937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:14.627345 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c48e9-e90d-48ce-af39-79d931964283 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:14.672027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc2339-dec7-480a-ba07-8072f622c7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:14.672841 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc2339-dec7-480a-ba07-8072f622c7bb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:14.673124 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc2339-dec7-480a-ba07-8072f622c7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:14.673404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc2339-dec7-480a-ba07-8072f622c7bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:14.680813 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc68b62-fd1c-4506-b88a-acee7a564903 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:14.681886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc2339-dec7-480a-ba07-8072f622c7bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:14.683424 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc2339-dec7-480a-ba07-8072f622c7bb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:14.699375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d6bc2339-dec7-480a-ba07-8072f622c7bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:14.699375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:14.699375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:14.699375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:14.699375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:14.699375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:14.699375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:14.699375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:14.699375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:14.699375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:14.699375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:14.699375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:14.699375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:53:14.699375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:53:14.699375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:14.700400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:14.701688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:53:14.701688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:53:14.701688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:53:14.701688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:53:14.701688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:53:14.701688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:53:14.701688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:14.701688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:14.701688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 507/977] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:53:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:14.706498 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc2339-dec7-480a-ba07-8072f622c7bb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:14.722015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567864dd-75a1-4cf6-aebe-45100cc7f8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:14.723060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567864dd-75a1-4cf6-aebe-45100cc7f8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:14.723390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567864dd-75a1-4cf6-aebe-45100cc7f8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:14.723719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567864dd-75a1-4cf6-aebe-45100cc7f8f5 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:14.724378 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567864dd-75a1-4cf6-aebe-45100cc7f8f5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:14.724719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567864dd-75a1-4cf6-aebe-45100cc7f8f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:14.726100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567864dd-75a1-4cf6-aebe-45100cc7f8f5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:14.731439 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 471/978] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 15:53:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:14.737396 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567864dd-75a1-4cf6-aebe-45100cc7f8f5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:14.786831 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:14.822787 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc2339-dec7-480a-ba07-8072f622c7bb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:14.859122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:14.865479 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567864dd-75a1-4cf6-aebe-45100cc7f8f5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:14.867888 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a65a5-610a-4a8c-baf2-1c6ae820226f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:14.868531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a65a5-610a-4a8c-baf2-1c6ae820226f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:14.868895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a65a5-610a-4a8c-baf2-1c6ae820226f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:14.869238 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a65a5-610a-4a8c-baf2-1c6ae820226f None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:14.870053 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a65a5-610a-4a8c-baf2-1c6ae820226f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:14.870362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a65a5-610a-4a8c-baf2-1c6ae820226f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:14.871938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a65a5-610a-4a8c-baf2-1c6ae820226f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:14.884988 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 508/979] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:14.891179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a65a5-610a-4a8c-baf2-1c6ae820226f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:14.915872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea579f-0bfa-4aa5-9f60-ee8192d38169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:14.916542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea579f-0bfa-4aa5-9f60-ee8192d38169 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:14.916815 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea579f-0bfa-4aa5-9f60-ee8192d38169 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:14.917101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea579f-0bfa-4aa5-9f60-ee8192d38169 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:14.917819 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea579f-0bfa-4aa5-9f60-ee8192d38169 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:14.918124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea579f-0bfa-4aa5-9f60-ee8192d38169 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:14.919608 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea579f-0bfa-4aa5-9f60-ee8192d38169 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:14.929405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 472/980] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 15:53:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:14.935118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea579f-0bfa-4aa5-9f60-ee8192d38169 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:15.011263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a65a5-610a-4a8c-baf2-1c6ae820226f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:15.045267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:15.053466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea579f-0bfa-4aa5-9f60-ee8192d38169 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:15.053643 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80ba40-d244-4fda-9f70-0233f77f7021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:15.054187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80ba40-d244-4fda-9f70-0233f77f7021 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:15.054474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80ba40-d244-4fda-9f70-0233f77f7021 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:15.054904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80ba40-d244-4fda-9f70-0233f77f7021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:15.055770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80ba40-d244-4fda-9f70-0233f77f7021 None admin] RBAC: Adding query filter params (role.id=e9d9c03727a34b14af8c89c7839193cc, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=8d1d0d0f2d544d41a86f1e0dda8d110c) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:15.056091 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80ba40-d244-4fda-9f70-0233f77f7021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:15.057542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80ba40-d244-4fda-9f70-0233f77f7021 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:15.074861 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 509/981] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:53:14 2022] GET /identity/v3/role_assignments?user.id=8d1d0d0f2d544d41a86f1e0dda8d110c&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=e9d9c03727a34b14af8c89c7839193cc => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:15.090462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91aa3ba-3fdf-4c45-9c6c-7e54b21ef53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:15.091177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91aa3ba-3fdf-4c45-9c6c-7e54b21ef53e None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:15.091461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91aa3ba-3fdf-4c45-9c6c-7e54b21ef53e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:15.091739 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91aa3ba-3fdf-4c45-9c6c-7e54b21ef53e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:15.092493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91aa3ba-3fdf-4c45-9c6c-7e54b21ef53e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:15.093912 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91aa3ba-3fdf-4c45-9c6c-7e54b21ef53e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:15.115113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 473/982] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 15:53:14 2022] POST /identity/v3/endpoints => generated 349 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:53:16.533242 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8842b8d-72c2-43ce-964a-16ba74e91811 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:16.533792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8842b8d-72c2-43ce-964a-16ba74e91811 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:16.533792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8842b8d-72c2-43ce-964a-16ba74e91811 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:16.535155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 510/983] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:16.540571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb8838-534c-481c-a4f8-cab8ea382877 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:16.541014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb8838-534c-481c-a4f8-cab8ea382877 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:16.541122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb8838-534c-481c-a4f8-cab8ea382877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:16.559130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-91bb8838-534c-481c-a4f8-cab8ea382877 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:16.560319 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-91bb8838-534c-481c-a4f8-cab8ea382877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:16.574910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:16.655019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 474/984] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:53:16.674322 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8842b8d-72c2-43ce-964a-16ba74e91811 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:16.795170 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8842b8d-72c2-43ce-964a-16ba74e91811 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:16.836729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90317a1a-0edd-4727-8b00-cb929809d259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:16.837542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90317a1a-0edd-4727-8b00-cb929809d259 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:16.837824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90317a1a-0edd-4727-8b00-cb929809d259 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:16.838083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90317a1a-0edd-4727-8b00-cb929809d259 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:16.838750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90317a1a-0edd-4727-8b00-cb929809d259 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:16.840184 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90317a1a-0edd-4727-8b00-cb929809d259 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-90317a1a-0edd-4727-8b00-cb929809d259 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:16.852563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:16.853661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:16.854494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:16.854494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:16.854494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:16.854494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:16.854494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:16.854494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:16.854494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:16.854494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:16.854494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:16.854494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:16.854494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:53:16.854494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:16.854494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 15:53:16.854494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:16.854494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 511/985] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:53:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:16.861530 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb8838-534c-481c-a4f8-cab8ea382877 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:16.977880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb8838-534c-481c-a4f8-cab8ea382877 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:17.013912 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf2c12-ed3d-42b9-8018-99ff8183f48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:17.014582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf2c12-ed3d-42b9-8018-99ff8183f48a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:17.014860 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf2c12-ed3d-42b9-8018-99ff8183f48a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:17.015150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf2c12-ed3d-42b9-8018-99ff8183f48a None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:17.015849 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf2c12-ed3d-42b9-8018-99ff8183f48a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:17.016619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf2c12-ed3d-42b9-8018-99ff8183f48a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:17.017935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf2c12-ed3d-42b9-8018-99ff8183f48a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:17.023000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 475/986] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 15:53:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:17.028606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90317a1a-0edd-4727-8b00-cb929809d259 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:17.090499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:17.138955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90317a1a-0edd-4727-8b00-cb929809d259 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:17.182197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efded3fe-585c-43dc-b63c-92a8a257bd1b None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:17.182495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efded3fe-585c-43dc-b63c-92a8a257bd1b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:17.182752 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efded3fe-585c-43dc-b63c-92a8a257bd1b None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:17.184163 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 476/987] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:53:17.184371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16c7af-8851-4631-9ded-783e409ab676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:17.185349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16c7af-8851-4631-9ded-783e409ab676 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:17.185646 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16c7af-8851-4631-9ded-783e409ab676 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:17.185811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bac0f-5c70-46b5-8ac9-c4900d79bd68 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:17.185916 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16c7af-8851-4631-9ded-783e409ab676 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:17.186271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bac0f-5c70-46b5-8ac9-c4900d79bd68 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:17.186650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16c7af-8851-4631-9ded-783e409ab676 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:17.186757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bac0f-5c70-46b5-8ac9-c4900d79bd68 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:17.186998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16c7af-8851-4631-9ded-783e409ab676 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:17.188557 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16c7af-8851-4631-9ded-783e409ab676 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:17.191100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 477/988] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:17.191100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52113b51-d056-48fe-9a1e-2b51041bfd21 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:17.191100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52113b51-d056-48fe-9a1e-2b51041bfd21 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:17.191100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52113b51-d056-48fe-9a1e-2b51041bfd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:17.196344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 512/989] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 15:53:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:17.197532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd0d93-1a53-49b8-aada-f133520751fd None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:17.197913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd0d93-1a53-49b8-aada-f133520751fd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:17.198095 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd0d93-1a53-49b8-aada-f133520751fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:17.213150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-52113b51-d056-48fe-9a1e-2b51041bfd21 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:17.214355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-52113b51-d056-48fe-9a1e-2b51041bfd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:17.215859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b6bd0d93-1a53-49b8-aada-f133520751fd None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:17.216704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:17.217034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b6bd0d93-1a53-49b8-aada-f133520751fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:17.285732 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 513/990] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:17.286590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd0d93-1a53-49b8-aada-f133520751fd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:17.288868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 478/991] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:17.308377 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52113b51-d056-48fe-9a1e-2b51041bfd21 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:17.342612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:17.396202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd0d93-1a53-49b8-aada-f133520751fd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:17.409255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52113b51-d056-48fe-9a1e-2b51041bfd21 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:17.432966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e75ade-6315-4f0f-b4c6-2bbebcd05c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:17.433640 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e75ade-6315-4f0f-b4c6-2bbebcd05c13 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:17.433922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e75ade-6315-4f0f-b4c6-2bbebcd05c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:17.434203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e75ade-6315-4f0f-b4c6-2bbebcd05c13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:17.435036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e75ade-6315-4f0f-b4c6-2bbebcd05c13 None admin] RBAC: Adding query filter params (interface=public, service_id=b071fab3b28e47c388b698f653ac6c08, region_id=RegionOne) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:17.435335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e75ade-6315-4f0f-b4c6-2bbebcd05c13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:17.436729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e75ade-6315-4f0f-b4c6-2bbebcd05c13 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:17.442296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 514/992] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 15:53:17 2022] GET /identity/v3/endpoints?service_id=b071fab3b28e47c388b698f653ac6c08&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:17.443124 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e75ade-6315-4f0f-b4c6-2bbebcd05c13 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:17.449520 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5e383-912b-435c-b4dd-ab36d7b8cd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:17.450347 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e383-912b-435c-b4dd-ab36d7b8cd83 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:17.450627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e383-912b-435c-b4dd-ab36d7b8cd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:17.450926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e383-912b-435c-b4dd-ab36d7b8cd83 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:17.451570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5e383-912b-435c-b4dd-ab36d7b8cd83 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:17.452973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5e383-912b-435c-b4dd-ab36d7b8cd83 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-c2b5e383-912b-435c-b4dd-ab36d7b8cd83 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:17.465298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:17.466723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:17.467882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:17.467882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:17.467882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:17.467882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:17.467882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:17.467882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:17.467882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:17.467882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:17.467882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:17.467882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:17.467882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:53:17.467882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:17.467882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 15:53:17.467882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:17.467882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 479/993] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 15:53:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:17.468678 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5e383-912b-435c-b4dd-ab36d7b8cd83 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:17.472206 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:17.555658 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e75ade-6315-4f0f-b4c6-2bbebcd05c13 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:17.572147 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:17.572969 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5e383-912b-435c-b4dd-ab36d7b8cd83 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:17.590849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbf073-5032-4e98-ac9c-1e39400918b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:17.591651 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbf073-5032-4e98-ac9c-1e39400918b7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:17.592026 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbf073-5032-4e98-ac9c-1e39400918b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:17.592300 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbf073-5032-4e98-ac9c-1e39400918b7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:17.593012 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbf073-5032-4e98-ac9c-1e39400918b7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:17.594337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cbf073-5032-4e98-ac9c-1e39400918b7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-f0cbf073-5032-4e98-ac9c-1e39400918b7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:17.606340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:17.607515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:17.608511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:17.608511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:17.608511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:17.608511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:17.608511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:17.608511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:17.608511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:17.608511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:17.608511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:17.608511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:17.608511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:53:17.608511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:17.608511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 15:53:17.608511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:17.608511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 515/994] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Jul 21 15:53:17 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:17.609734 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbf073-5032-4e98-ac9c-1e39400918b7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:17.614028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d53aa1-e1ac-4222-b818-9947553293b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:17.615015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d53aa1-e1ac-4222-b818-9947553293b6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:17.615325 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d53aa1-e1ac-4222-b818-9947553293b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:17.615596 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d53aa1-e1ac-4222-b818-9947553293b6 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:17.616260 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d53aa1-e1ac-4222-b818-9947553293b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:17.617649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d53aa1-e1ac-4222-b818-9947553293b6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:17.624826 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 480/995] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 15:53:17 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 15:53:17.625175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d53aa1-e1ac-4222-b818-9947553293b6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:17.712845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:17.748046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cbf073-5032-4e98-ac9c-1e39400918b7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:17.759691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d53aa1-e1ac-4222-b818-9947553293b6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:17.790360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27abc5-3bf9-4d30-9cc2-b6324f6cafb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:17.791385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27abc5-3bf9-4d30-9cc2-b6324f6cafb0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:17.791667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27abc5-3bf9-4d30-9cc2-b6324f6cafb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:17.791941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27abc5-3bf9-4d30-9cc2-b6324f6cafb0 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:17.792666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27abc5-3bf9-4d30-9cc2-b6324f6cafb0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:17.792977 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27abc5-3bf9-4d30-9cc2-b6324f6cafb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:17.794484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27abc5-3bf9-4d30-9cc2-b6324f6cafb0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:17.797465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f160bf-ae09-430a-968a-cf7ec58f2d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:17.798150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f160bf-ae09-430a-968a-cf7ec58f2d4c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:17.798721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f160bf-ae09-430a-968a-cf7ec58f2d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:17.798721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f160bf-ae09-430a-968a-cf7ec58f2d4c None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:17.799904 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f160bf-ae09-430a-968a-cf7ec58f2d4c None admin] RBAC: Adding query filter params (name=image) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:17.799904 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f160bf-ae09-430a-968a-cf7ec58f2d4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:17.801204 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f160bf-ae09-430a-968a-cf7ec58f2d4c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:17.805624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 516/996] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 15:53:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:17.808577 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 481/997] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:17.810926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27abc5-3bf9-4d30-9cc2-b6324f6cafb0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:17.814916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f160bf-ae09-430a-968a-cf7ec58f2d4c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:17.862569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:17.931182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27abc5-3bf9-4d30-9cc2-b6324f6cafb0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:17.937723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f160bf-ae09-430a-968a-cf7ec58f2d4c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:17.970083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39642d0f-9c3b-446d-957b-78d4cebc6c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:17.970554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39642d0f-9c3b-446d-957b-78d4cebc6c48 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:17.971098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39642d0f-9c3b-446d-957b-78d4cebc6c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:17.971098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39642d0f-9c3b-446d-957b-78d4cebc6c48 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:17.972320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39642d0f-9c3b-446d-957b-78d4cebc6c48 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:17.972320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39642d0f-9c3b-446d-957b-78d4cebc6c48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:17.973743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39642d0f-9c3b-446d-957b-78d4cebc6c48 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:17.976323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:17.983995 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 517/998] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 15:53:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:17.984207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85549d-7b67-4ab0-a2c7-1973e1e3660c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:17.984207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85549d-7b67-4ab0-a2c7-1973e1e3660c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:17.984207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85549d-7b67-4ab0-a2c7-1973e1e3660c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:17.984207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85549d-7b67-4ab0-a2c7-1973e1e3660c None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:17.984673 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85549d-7b67-4ab0-a2c7-1973e1e3660c None admin] RBAC: Adding query filter params (type=image) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:17.984987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85549d-7b67-4ab0-a2c7-1973e1e3660c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:17.986458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85549d-7b67-4ab0-a2c7-1973e1e3660c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:17.986753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39642d0f-9c3b-446d-957b-78d4cebc6c48 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:17.992813 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 482/999] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:18.106026 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39642d0f-9c3b-446d-957b-78d4cebc6c48 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:18.118508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:18.151404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114e5fb-9a9a-445c-96a5-484917f3ddcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:18.152081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114e5fb-9a9a-445c-96a5-484917f3ddcd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:18.152383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114e5fb-9a9a-445c-96a5-484917f3ddcd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:18.152674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114e5fb-9a9a-445c-96a5-484917f3ddcd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:18.153484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114e5fb-9a9a-445c-96a5-484917f3ddcd None admin] RBAC: Adding query filter params (interface=admin, service_id=341c6deb3a1d4a9996c3a71dfaf8673d, region_id=RegionOne) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:18.153834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114e5fb-9a9a-445c-96a5-484917f3ddcd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:18.155245 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114e5fb-9a9a-445c-96a5-484917f3ddcd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:18.162881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 518/1000] 10.222.0.64 () {56 vars in 1249 bytes} [Thu Jul 21 15:53:17 2022] GET /identity/v3/endpoints?service_id=341c6deb3a1d4a9996c3a71dfaf8673d&interface=admin®ion_id=RegionOne => generated 193 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:18.167977 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85549d-7b67-4ab0-a2c7-1973e1e3660c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:18.304795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85549d-7b67-4ab0-a2c7-1973e1e3660c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:18.343368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b0acb-1d59-4ab5-a570-955474524cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:18.344047 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b0acb-1d59-4ab5-a570-955474524cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:18.344328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b0acb-1d59-4ab5-a570-955474524cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:18.344601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b0acb-1d59-4ab5-a570-955474524cd8 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:18.345297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b0acb-1d59-4ab5-a570-955474524cd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:18.346734 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b0acb-1d59-4ab5-a570-955474524cd8 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:18.356990 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 483/1001] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 15:53:18 2022] GET /identity/v3/services => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 15:53:19.709711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee39ab-f8c8-408f-8957-d155c2b928ee None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:19.710261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee39ab-f8c8-408f-8957-d155c2b928ee None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:19.710261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ee39ab-f8c8-408f-8957-d155c2b928ee None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:19.711845 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 519/1002] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:19.717064 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f138e-72b1-4524-8061-48a1fb0476e9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:19.717518 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f138e-72b1-4524-8061-48a1fb0476e9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:19.717594 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f138e-72b1-4524-8061-48a1fb0476e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:19.734621 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e68f138e-72b1-4524-8061-48a1fb0476e9 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:19.735833 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e68f138e-72b1-4524-8061-48a1fb0476e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:19.792392 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:19.807171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 484/1003] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:19.829721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee39ab-f8c8-408f-8957-d155c2b928ee None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:19.935797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ee39ab-f8c8-408f-8957-d155c2b928ee None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:19.971498 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07b814-33a3-48ac-adad-544fce21a70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:19.972217 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07b814-33a3-48ac-adad-544fce21a70d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:19.972498 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07b814-33a3-48ac-adad-544fce21a70d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:19.972770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07b814-33a3-48ac-adad-544fce21a70d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:19.973425 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07b814-33a3-48ac-adad-544fce21a70d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:19.974794 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07b814-33a3-48ac-adad-544fce21a70d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-7d07b814-33a3-48ac-adad-544fce21a70d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:19.986863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:19.987926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:19.988785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:19.988785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:19.988785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:19.988785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:19.988785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:19.988785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:19.988785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:19.988785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:19.988785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:19.988785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:19.988785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:53:19.988785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:19.988785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 15:53:19.988785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:19.991190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 520/1004] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:53:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:19.994398 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f138e-72b1-4524-8061-48a1fb0476e9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:20.040557 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c89aa4-ac81-425d-ba41-44580367056c None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:20.040846 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c89aa4-ac81-425d-ba41-44580367056c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:20.041088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c89aa4-ac81-425d-ba41-44580367056c None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:20.042753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 521/1005] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:53:20.047867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae03e7-a7a7-47d1-9382-68e9e34586ed None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:20.048148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae03e7-a7a7-47d1-9382-68e9e34586ed None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:20.048432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bae03e7-a7a7-47d1-9382-68e9e34586ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:20.065734 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3bae03e7-a7a7-47d1-9382-68e9e34586ed None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:20.067016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3bae03e7-a7a7-47d1-9382-68e9e34586ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:20.099313 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:20.111891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f138e-72b1-4524-8061-48a1fb0476e9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:20.141834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 522/1006] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:53:20.151024 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930403b-72f0-4e16-942a-c3badf5d35e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:20.151024 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930403b-72f0-4e16-942a-c3badf5d35e2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:20.151024 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930403b-72f0-4e16-942a-c3badf5d35e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:20.151024 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930403b-72f0-4e16-942a-c3badf5d35e2 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:20.151363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930403b-72f0-4e16-942a-c3badf5d35e2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:20.151363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930403b-72f0-4e16-942a-c3badf5d35e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:20.151968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930403b-72f0-4e16-942a-c3badf5d35e2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:20.158864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 485/1007] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 15:53:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:20.163054 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae03e7-a7a7-47d1-9382-68e9e34586ed None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:20.165137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930403b-72f0-4e16-942a-c3badf5d35e2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:20.224595 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:20.275881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bae03e7-a7a7-47d1-9382-68e9e34586ed None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:20.280271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930403b-72f0-4e16-942a-c3badf5d35e2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:20.314195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f7e2f-c069-4679-9df2-13895c6e877c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:20.315346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f7e2f-c069-4679-9df2-13895c6e877c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:20.315848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f7e2f-c069-4679-9df2-13895c6e877c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:20.316319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f7e2f-c069-4679-9df2-13895c6e877c None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:20.316424 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475648a8-935d-4944-ae39-420f8a0d6b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:20.317072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475648a8-935d-4944-ae39-420f8a0d6b1a None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:20.317346 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475648a8-935d-4944-ae39-420f8a0d6b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:20.317620 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475648a8-935d-4944-ae39-420f8a0d6b1a None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:20.317895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f7e2f-c069-4679-9df2-13895c6e877c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:20.318346 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475648a8-935d-4944-ae39-420f8a0d6b1a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:20.318539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f7e2f-c069-4679-9df2-13895c6e877c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:20.319762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475648a8-935d-4944-ae39-420f8a0d6b1a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:20.320326 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f7e2f-c069-4679-9df2-13895c6e877c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:20.326522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 523/1008] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Jul 21 15:53:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:20.332620 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f7e2f-c069-4679-9df2-13895c6e877c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:20.337260 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 486/1009] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 15:53:20 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 15:53:20.367944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:20.399947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a946f-5372-4e36-9668-2bb4e9230b95 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:20.400227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a946f-5372-4e36-9668-2bb4e9230b95 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:20.400520 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a946f-5372-4e36-9668-2bb4e9230b95 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:20.402202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 487/1010] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:53:20.407676 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea180d-d406-43b1-93c0-697abc1f82e1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:20.408005 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea180d-d406-43b1-93c0-697abc1f82e1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:20.408324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea180d-d406-43b1-93c0-697abc1f82e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:20.426287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c5ea180d-d406-43b1-93c0-697abc1f82e1 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:20.427563 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c5ea180d-d406-43b1-93c0-697abc1f82e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:20.451591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f7e2f-c069-4679-9df2-13895c6e877c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:20.498912 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ea7e2-3ed0-4557-83f8-c7399d129754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:20.499127 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ea7e2-3ed0-4557-83f8-c7399d129754 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:20.499313 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ea7e2-3ed0-4557-83f8-c7399d129754 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:20.499592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ea7e2-3ed0-4557-83f8-c7399d129754 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:20.500368 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ea7e2-3ed0-4557-83f8-c7399d129754 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:20.501776 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ea7e2-3ed0-4557-83f8-c7399d129754 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:20.510036 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 488/1011] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:20 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:53:20.524095 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 524/1012] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 15:53:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:53:20.534099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea180d-d406-43b1-93c0-697abc1f82e1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:20.584879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:20.652425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea180d-d406-43b1-93c0-697abc1f82e1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:20.700600 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fbceb-f6d1-4d6b-bf9a-255a87ca6691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:20.701462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fbceb-f6d1-4d6b-bf9a-255a87ca6691 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:20.701702 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fbceb-f6d1-4d6b-bf9a-255a87ca6691 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:20.702005 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881fbceb-f6d1-4d6b-bf9a-255a87ca6691 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:20.702635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fbceb-f6d1-4d6b-bf9a-255a87ca6691 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:20.704095 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881fbceb-f6d1-4d6b-bf9a-255a87ca6691 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-881fbceb-f6d1-4d6b-bf9a-255a87ca6691 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:20.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:20.718501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:20.719548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:20.719548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:20.719548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:20.719548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:20.719548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:20.719548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:20.719548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:20.719548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:20.719548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:20.719548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:20.719548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:53:20.719548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:20.719548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 15:53:20.719548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:20.719548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 489/1013] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Jul 21 15:53:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:20.724470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ea7e2-3ed0-4557-83f8-c7399d129754 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:20.816745 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:20.837750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ea7e2-3ed0-4557-83f8-c7399d129754 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:20.875894 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccf20a-457a-4e89-a0f5-830175fec45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:20.876624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccf20a-457a-4e89-a0f5-830175fec45a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:20.876912 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccf20a-457a-4e89-a0f5-830175fec45a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:20.877185 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccf20a-457a-4e89-a0f5-830175fec45a None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:20.878006 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccf20a-457a-4e89-a0f5-830175fec45a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:20.878337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccf20a-457a-4e89-a0f5-830175fec45a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:20.879749 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccf20a-457a-4e89-a0f5-830175fec45a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:20.885657 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 525/1014] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 15:53:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:20.891675 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fbceb-f6d1-4d6b-bf9a-255a87ca6691 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:21.002753 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881fbceb-f6d1-4d6b-bf9a-255a87ca6691 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:21.004691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:21.046859 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ad16c-a78b-4dbe-b915-33cdda21480f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:21.047578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad16c-a78b-4dbe-b915-33cdda21480f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:21.047861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad16c-a78b-4dbe-b915-33cdda21480f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:21.048137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ad16c-a78b-4dbe-b915-33cdda21480f None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:21.048872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ad16c-a78b-4dbe-b915-33cdda21480f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:21.049290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ad16c-a78b-4dbe-b915-33cdda21480f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:21.050696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ad16c-a78b-4dbe-b915-33cdda21480f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:21.062316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 490/1015] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Jul 21 15:53:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:21.063709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccf20a-457a-4e89-a0f5-830175fec45a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:21.181473 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccf20a-457a-4e89-a0f5-830175fec45a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:21.219795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4f10f-c88a-43c1-a216-f8b23fb41737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:21.220479 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4f10f-c88a-43c1-a216-f8b23fb41737 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:21.220763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4f10f-c88a-43c1-a216-f8b23fb41737 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:21.221081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4f10f-c88a-43c1-a216-f8b23fb41737 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:21.221864 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4f10f-c88a-43c1-a216-f8b23fb41737 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:21.223385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4f10f-c88a-43c1-a216-f8b23fb41737 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:21.247085 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 526/1016] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 15:53:21 2022] POST /identity/v3/endpoints => generated 325 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:53:22.464960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f963a7c-52a7-4e7e-ba1e-823f421b792f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:22.465476 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f963a7c-52a7-4e7e-ba1e-823f421b792f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:22.465476 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f963a7c-52a7-4e7e-ba1e-823f421b792f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:22.470358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 491/1017] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:22.472530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18e4bd-4439-4cdb-9af8-0db4d05f5b46 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:22.472957 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18e4bd-4439-4cdb-9af8-0db4d05f5b46 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:22.472957 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18e4bd-4439-4cdb-9af8-0db4d05f5b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:22.485799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:22.492788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9b18e4bd-4439-4cdb-9af8-0db4d05f5b46 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:22.494710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9b18e4bd-4439-4cdb-9af8-0db4d05f5b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:22.578954 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 527/1018] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:22.594484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f963a7c-52a7-4e7e-ba1e-823f421b792f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:22.662439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810b74e-57fa-4702-8ebe-69e57d7b44e2 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:22.662733 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810b74e-57fa-4702-8ebe-69e57d7b44e2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:22.663061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810b74e-57fa-4702-8ebe-69e57d7b44e2 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:22.664563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 528/1019] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:53:22.669312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaad41-d306-40cd-b323-476fdf8d302b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:22.669663 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaad41-d306-40cd-b323-476fdf8d302b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:22.669860 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeaad41-d306-40cd-b323-476fdf8d302b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:22.686460 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4eeaad41-d306-40cd-b323-476fdf8d302b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:22.687667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4eeaad41-d306-40cd-b323-476fdf8d302b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:22.704581 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f963a7c-52a7-4e7e-ba1e-823f421b792f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:22.741946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f62ed-5377-41bb-a9f3-8b55bb14942c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:22.743192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f62ed-5377-41bb-a9f3-8b55bb14942c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:22.743652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f62ed-5377-41bb-a9f3-8b55bb14942c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:22.744126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f62ed-5377-41bb-a9f3-8b55bb14942c None admin] PATH_INFO: `/v3/services/image` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:22.744960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f62ed-5377-41bb-a9f3-8b55bb14942c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:22.746677 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f62ed-5377-41bb-a9f3-8b55bb14942c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:22.756733 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 529/1020] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-443f62ed-5377-41bb-a9f3-8b55bb14942c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:22.759875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:22.760975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:22.761822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:22.761822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:22.761822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:22.761822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:22.761822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:22.761822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:22.761822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:22.761822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:22.761822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:22.761822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:22.761822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:53:22.761822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:22.761822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 15:53:22.761822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:22.766362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 492/1021] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Jul 21 15:53:22 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:22.767594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaad41-d306-40cd-b323-476fdf8d302b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:22.782879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f62ed-5377-41bb-a9f3-8b55bb14942c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:22.815895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:22.831388 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:22.873687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeaad41-d306-40cd-b323-476fdf8d302b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:22.899205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f62ed-5377-41bb-a9f3-8b55bb14942c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:22.908391 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0640a-6bb6-4652-8c63-522347ce04c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:22.909192 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0640a-6bb6-4652-8c63-522347ce04c1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:22.909475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0640a-6bb6-4652-8c63-522347ce04c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:22.909750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0640a-6bb6-4652-8c63-522347ce04c1 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:22.910460 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0640a-6bb6-4652-8c63-522347ce04c1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:22.910788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0640a-6bb6-4652-8c63-522347ce04c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:22.912193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0640a-6bb6-4652-8c63-522347ce04c1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:22.922086 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 530/1022] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:22.923015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0640a-6bb6-4652-8c63-522347ce04c1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:22.941177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997f19a-ed90-45fb-97b9-d4791071ac78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:22.942052 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997f19a-ed90-45fb-97b9-d4791071ac78 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:22.942328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997f19a-ed90-45fb-97b9-d4791071ac78 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:22.942605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997f19a-ed90-45fb-97b9-d4791071ac78 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:22.952999 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997f19a-ed90-45fb-97b9-d4791071ac78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4997f19a-ed90-45fb-97b9-d4791071ac78 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:53:22.961201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:22.962167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:22.963094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:22.963094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:22.963094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:22.963094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:22.963094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:53:22.963094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:53:22.963094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:53:22.963094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:53:22.963094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:53:22.963094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:53:22.963094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 15:53:22.963094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:22.963094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 493/1023] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 21 15:53:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:22.968228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997f19a-ed90-45fb-97b9-d4791071ac78 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:23.029833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0640a-6bb6-4652-8c63-522347ce04c1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:23.056436 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:23.066743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:23.066926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bf17a-9219-43e1-b168-091400568d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:23.067537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bf17a-9219-43e1-b168-091400568d75 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:23.067819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bf17a-9219-43e1-b168-091400568d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:23.068093 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bf17a-9219-43e1-b168-091400568d75 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:23.069102 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bf17a-9219-43e1-b168-091400568d75 None admin] RBAC: Adding query filter params (type=image) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:23.069417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bf17a-9219-43e1-b168-091400568d75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:23.070903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29bf17a-9219-43e1-b168-091400568d75 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:23.076705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 531/1024] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:23.078201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997f19a-ed90-45fb-97b9-d4791071ac78 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:23.082922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bf17a-9219-43e1-b168-091400568d75 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:23.119400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcdd08-d08f-4f64-9548-6bb6d86f7647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:23.120354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcdd08-d08f-4f64-9548-6bb6d86f7647 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:23.120559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcdd08-d08f-4f64-9548-6bb6d86f7647 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:23.120851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dcdd08-d08f-4f64-9548-6bb6d86f7647 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:23.121541 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcdd08-d08f-4f64-9548-6bb6d86f7647 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:23.121839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcdd08-d08f-4f64-9548-6bb6d86f7647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:23.124217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dcdd08-d08f-4f64-9548-6bb6d86f7647 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:23.132570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 494/1025] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 21 15:53:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:23.137904 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcdd08-d08f-4f64-9548-6bb6d86f7647 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:23.192138 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bf17a-9219-43e1-b168-091400568d75 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:23.229728 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e111cf8-6fcc-4a3b-b40c-47f11aff5e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:23.230517 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111cf8-6fcc-4a3b-b40c-47f11aff5e6b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:23.230799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111cf8-6fcc-4a3b-b40c-47f11aff5e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:23.231221 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111cf8-6fcc-4a3b-b40c-47f11aff5e6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:23.232021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e111cf8-6fcc-4a3b-b40c-47f11aff5e6b None admin] RBAC: Adding query filter params (interface=public, service_id=ad0632389c034acb96092ecac160eccd, region_id=RegionOne) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:23.232337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e111cf8-6fcc-4a3b-b40c-47f11aff5e6b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:23.233779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e111cf8-6fcc-4a3b-b40c-47f11aff5e6b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:23.240167 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 532/1026] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 15:53:23 2022] GET /identity/v3/endpoints?service_id=ad0632389c034acb96092ecac160eccd&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:23.245634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e111cf8-6fcc-4a3b-b40c-47f11aff5e6b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:23.246072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dcdd08-d08f-4f64-9548-6bb6d86f7647 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:23.281653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc24e37-e669-42ba-bd1b-f24d71313169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:23.282385 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc24e37-e669-42ba-bd1b-f24d71313169 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:23.282669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc24e37-e669-42ba-bd1b-f24d71313169 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:23.283009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc24e37-e669-42ba-bd1b-f24d71313169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:23.293505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc24e37-e669-42ba-bd1b-f24d71313169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:23.294987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc24e37-e669-42ba-bd1b-f24d71313169 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:23.300546 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:23.312407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-2bc24e37-e669-42ba-bd1b-f24d71313169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:23.312407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:23.312407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:23.312407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:23.312407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:23.312407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:23.312407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:23.312407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:23.312407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:23.312407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:23.312407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:23.312407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:23.312407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:53:23.312407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:53:23.312407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:23.313390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:23.314301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:53:23.314301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:53:23.314301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:23.314301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:23.314301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 495/1027] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:23.315269 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e65367-6c9f-476e-a2e2-69b910685d9f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:23.315587 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e65367-6c9f-476e-a2e2-69b910685d9f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:23.315865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e65367-6c9f-476e-a2e2-69b910685d9f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:23.317281 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 496/1028] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:23.319238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e65367-6c9f-476e-a2e2-69b910685d9f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:23.323045 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:23.349173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e111cf8-6fcc-4a3b-b40c-47f11aff5e6b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:23.384809 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3a8a6-3c72-4648-b4c9-5dd46a672693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:23.385505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a8a6-3c72-4648-b4c9-5dd46a672693 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:23.385790 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a8a6-3c72-4648-b4c9-5dd46a672693 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:23.386066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a8a6-3c72-4648-b4c9-5dd46a672693 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:23.386760 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3a8a6-3c72-4648-b4c9-5dd46a672693 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:23.388193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3a8a6-3c72-4648-b4c9-5dd46a672693 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:23.394799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 533/1029] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 15:53:23 2022] GET /identity/v3/services => generated 1957 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 15:53:23.396068 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62b051-02fc-488a-9056-5cae1cf7f74c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:23.396374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62b051-02fc-488a-9056-5cae1cf7f74c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:23.396657 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62b051-02fc-488a-9056-5cae1cf7f74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:23.414053 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-da62b051-02fc-488a-9056-5cae1cf7f74c None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:23.415332 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-da62b051-02fc-488a-9056-5cae1cf7f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:23.439949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e65367-6c9f-476e-a2e2-69b910685d9f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:23.478589 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d775cc-c702-428f-82ad-e8cebb952b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:23.479418 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d775cc-c702-428f-82ad-e8cebb952b22 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:23.479578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d775cc-c702-428f-82ad-e8cebb952b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:23.479865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d775cc-c702-428f-82ad-e8cebb952b22 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:23.480596 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d775cc-c702-428f-82ad-e8cebb952b22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:23.480902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d775cc-c702-428f-82ad-e8cebb952b22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:23.482344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d775cc-c702-428f-82ad-e8cebb952b22 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:23.496203 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 497/1030] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:23.499221 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 534/1031] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:23.501757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62b051-02fc-488a-9056-5cae1cf7f74c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:23.516462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d775cc-c702-428f-82ad-e8cebb952b22 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:23.557551 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:23.588864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:23.617553 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62b051-02fc-488a-9056-5cae1cf7f74c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:23.631107 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d775cc-c702-428f-82ad-e8cebb952b22 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:23.658040 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64434e94-8410-49b8-a9a9-597e5ee9789b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:23.659159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64434e94-8410-49b8-a9a9-597e5ee9789b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:23.659826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64434e94-8410-49b8-a9a9-597e5ee9789b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:23.660113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64434e94-8410-49b8-a9a9-597e5ee9789b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:23.668270 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c05875-3b71-4a6d-9f08-37084d35b01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:23.668453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64434e94-8410-49b8-a9a9-597e5ee9789b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:23.669078 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c05875-3b71-4a6d-9f08-37084d35b01a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:23.669358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c05875-3b71-4a6d-9f08-37084d35b01a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:23.669631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c05875-3b71-4a6d-9f08-37084d35b01a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:23.669879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64434e94-8410-49b8-a9a9-597e5ee9789b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:23.670973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c05875-3b71-4a6d-9f08-37084d35b01a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:23.672842 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c05875-3b71-4a6d-9f08-37084d35b01a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:23.674263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 498/1032] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:23.679826 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c05875-3b71-4a6d-9f08-37084d35b01a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-64434e94-8410-49b8-a9a9-597e5ee9789b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:53:23.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:23.685785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:23.686796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:23.686796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:23.686796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:53:23.686796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:53:23.686796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:53:23.686796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:53:23.686796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:53:23.686796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:53:23.686796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:53:23.686796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:23.690783 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 535/1033] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 15:53:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:23.691627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64434e94-8410-49b8-a9a9-597e5ee9789b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:23.785935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c05875-3b71-4a6d-9f08-37084d35b01a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:23.799803 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64434e94-8410-49b8-a9a9-597e5ee9789b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:23.813465 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:23.818458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:23.825185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b4719-500d-43c4-8768-797b22fe4e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:23.826019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b4719-500d-43c4-8768-797b22fe4e91 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:23.826301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b4719-500d-43c4-8768-797b22fe4e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:23.826585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b4719-500d-43c4-8768-797b22fe4e91 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:23.827559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b4719-500d-43c4-8768-797b22fe4e91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:23.829454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b4719-500d-43c4-8768-797b22fe4e91 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:23.843265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea20782-6096-4c25-ae20-ee5aa9f88f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:23.843957 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea20782-6096-4c25-ae20-ee5aa9f88f41 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:23.844236 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea20782-6096-4c25-ae20-ee5aa9f88f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:23.844510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea20782-6096-4c25-ae20-ee5aa9f88f41 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:23.845361 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea20782-6096-4c25-ae20-ee5aa9f88f41 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:23.845671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea20782-6096-4c25-ae20-ee5aa9f88f41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:23.847290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea20782-6096-4c25-ae20-ee5aa9f88f41 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:23.864194 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 499/1034] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 15:53:23 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:53:23.870080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 536/1035] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 15:53:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:23.876075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b4719-500d-43c4-8768-797b22fe4e91 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:23.996546 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b4719-500d-43c4-8768-797b22fe4e91 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:24.032733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a299059-24f5-4832-9dbe-6d909e32ce7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:24.033409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a299059-24f5-4832-9dbe-6d909e32ce7d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:24.033850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a299059-24f5-4832-9dbe-6d909e32ce7d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:24.034231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a299059-24f5-4832-9dbe-6d909e32ce7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:24.091371 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:24.109126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a299059-24f5-4832-9dbe-6d909e32ce7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:24.110581 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a299059-24f5-4832-9dbe-6d909e32ce7d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:24.223157 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 500/1036] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:53:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:53:24.225121 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea20782-6096-4c25-ae20-ee5aa9f88f41 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:24.329528 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea20782-6096-4c25-ae20-ee5aa9f88f41 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:24.365592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29149ba9-8cc0-4fca-aa69-583d1ae6c8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:24.366318 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29149ba9-8cc0-4fca-aa69-583d1ae6c8cc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:24.366603 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29149ba9-8cc0-4fca-aa69-583d1ae6c8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:24.366901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29149ba9-8cc0-4fca-aa69-583d1ae6c8cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:24.377349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29149ba9-8cc0-4fca-aa69-583d1ae6c8cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:24.378909 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29149ba9-8cc0-4fca-aa69-583d1ae6c8cc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:24.397535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-29149ba9-8cc0-4fca-aa69-583d1ae6c8cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:24.397535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:24.397535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:24.397535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:24.397535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:24.397535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:24.397535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:24.397535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:24.397535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:24.397535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:24.397535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:24.397535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:24.397535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:53:24.397535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:53:24.397535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:24.404174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:24.405299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:53:24.405299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:53:24.405299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:24.405299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:24.405299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 537/1037] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:24.407231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a299059-24f5-4832-9dbe-6d909e32ce7d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:24.499198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:24.518421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a299059-24f5-4832-9dbe-6d909e32ce7d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:24.555685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b9b8-4bea-4822-8675-dc4fc4dd29ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:24.556347 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b9b8-4bea-4822-8675-dc4fc4dd29ac None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:24.556753 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b9b8-4bea-4822-8675-dc4fc4dd29ac None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:24.556918 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92b9b8-4bea-4822-8675-dc4fc4dd29ac None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:24.557635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b9b8-4bea-4822-8675-dc4fc4dd29ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:24.557945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b9b8-4bea-4822-8675-dc4fc4dd29ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:24.559367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92b9b8-4bea-4822-8675-dc4fc4dd29ac None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:24.576194 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 501/1038] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:24.578115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29149ba9-8cc0-4fca-aa69-583d1ae6c8cc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:24.601682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:24.685170 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29149ba9-8cc0-4fca-aa69-583d1ae6c8cc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:24.718166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc71b2-514f-465e-a0eb-f31b5e27ef55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:24.718983 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc71b2-514f-465e-a0eb-f31b5e27ef55 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:24.719264 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc71b2-514f-465e-a0eb-f31b5e27ef55 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:24.719537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc71b2-514f-465e-a0eb-f31b5e27ef55 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:24.726160 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc71b2-514f-465e-a0eb-f31b5e27ef55 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:24.727624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc71b2-514f-465e-a0eb-f31b5e27ef55 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:24.741414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-2edc71b2-514f-465e-a0eb-f31b5e27ef55 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:24.741414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:24.741414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:24.741414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:24.741414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:24.741414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:24.741414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:24.741414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:24.741414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:24.741414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:24.741414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:24.741414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:24.741414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:53:24.741414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:53:24.741414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:24.742406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:24.743494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:53:24.743494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:53:24.743494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:53:24.743494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:53:24.743494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:53:24.743494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:53:24.743494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:24.743494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:24.746888 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 538/1039] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:53:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:24.748704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b9b8-4bea-4822-8675-dc4fc4dd29ac None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:24.853319 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92b9b8-4bea-4822-8675-dc4fc4dd29ac None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:24.888380 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21e6861-dc47-449f-b0c0-a2ca1fb094fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:24.889048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e6861-dc47-449f-b0c0-a2ca1fb094fe None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:24.889332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e6861-dc47-449f-b0c0-a2ca1fb094fe None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:24.889609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21e6861-dc47-449f-b0c0-a2ca1fb094fe None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:24.890400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e6861-dc47-449f-b0c0-a2ca1fb094fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:24.890712 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e6861-dc47-449f-b0c0-a2ca1fb094fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:24.892182 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21e6861-dc47-449f-b0c0-a2ca1fb094fe None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:24.904689 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 502/1040] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:53:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:24.910697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc71b2-514f-465e-a0eb-f31b5e27ef55 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:24.996413 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:25.021666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc71b2-514f-465e-a0eb-f31b5e27ef55 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:25.057715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d2356-8864-4116-9ddf-99655c4571be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:25.058512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d2356-8864-4116-9ddf-99655c4571be None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:25.058926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d2356-8864-4116-9ddf-99655c4571be None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:25.059302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d2356-8864-4116-9ddf-99655c4571be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:25.060237 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d2356-8864-4116-9ddf-99655c4571be None admin] RBAC: Adding query filter params (role.id=e9d9c03727a34b14af8c89c7839193cc, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=e9a1ec1f6bb7467dbd63ad1da36d48a9) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:25.060665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d2356-8864-4116-9ddf-99655c4571be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:25.062179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d2356-8864-4116-9ddf-99655c4571be None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:25.068325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 539/1041] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:53:24 2022] GET /identity/v3/role_assignments?user.id=e9a1ec1f6bb7467dbd63ad1da36d48a9&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=e9d9c03727a34b14af8c89c7839193cc => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:25.423980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e303a-5893-49f1-8fd6-3ce074e89458 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:25.424379 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e303a-5893-49f1-8fd6-3ce074e89458 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:25.424541 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e303a-5893-49f1-8fd6-3ce074e89458 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:25.426163 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 503/1042] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:25.431588 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063ee99-d43f-43c1-8ba8-973a5daf100f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:25.431882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063ee99-d43f-43c1-8ba8-973a5daf100f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:25.432160 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063ee99-d43f-43c1-8ba8-973a5daf100f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:25.449570 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5063ee99-d43f-43c1-8ba8-973a5daf100f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:25.450761 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5063ee99-d43f-43c1-8ba8-973a5daf100f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:25.520513 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 540/1043] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:25.543291 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e303a-5893-49f1-8fd6-3ce074e89458 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:25.547437 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:25.649275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e303a-5893-49f1-8fd6-3ce074e89458 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:25.684647 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032ecd3-050f-448b-a493-6aef31893135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:25.685364 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032ecd3-050f-448b-a493-6aef31893135 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:25.685643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032ecd3-050f-448b-a493-6aef31893135 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:25.685913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032ecd3-050f-448b-a493-6aef31893135 None admin] PATH_INFO: `/v3/services/image` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:25.686732 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032ecd3-050f-448b-a493-6aef31893135 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:25.688082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032ecd3-050f-448b-a493-6aef31893135 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-7032ecd3-050f-448b-a493-6aef31893135 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:25.699670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:25.700662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:25.701505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:25.701505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:25.701505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:25.701505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:25.701505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:25.701505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:25.701505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:25.701505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:25.701505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:25.701505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:25.701505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:53:25.701505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:53:25.701505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 15:53:25.701505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:25.706096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 504/1044] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Jul 21 15:53:25 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:25.707400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063ee99-d43f-43c1-8ba8-973a5daf100f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:25.783457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:25.814415 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063ee99-d43f-43c1-8ba8-973a5daf100f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:25.850725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa9eef7-13d3-442d-b169-285ef2604ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:25.851416 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9eef7-13d3-442d-b169-285ef2604ada None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:25.851710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9eef7-13d3-442d-b169-285ef2604ada None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:25.851967 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa9eef7-13d3-442d-b169-285ef2604ada None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:25.852673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9eef7-13d3-442d-b169-285ef2604ada None admin] RBAC: Adding query filter params (name=image) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:25.852980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9eef7-13d3-442d-b169-285ef2604ada None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:25.854345 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa9eef7-13d3-442d-b169-285ef2604ada None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:25.861940 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 541/1045] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:25.868837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032ecd3-050f-448b-a493-6aef31893135 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:25.931880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9298c-ccd8-4031-97b5-95557081a97f None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:25.932172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9298c-ccd8-4031-97b5-95557081a97f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:25.932470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9298c-ccd8-4031-97b5-95557081a97f None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:25.933990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 542/1046] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:53:25.938727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77259fd-89bf-4fde-af47-24ad29776399 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:25.938988 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77259fd-89bf-4fde-af47-24ad29776399 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:25.939274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77259fd-89bf-4fde-af47-24ad29776399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:25.943972 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:25.956037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a77259fd-89bf-4fde-af47-24ad29776399 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:25.957245 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a77259fd-89bf-4fde-af47-24ad29776399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:25.987040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032ecd3-050f-448b-a493-6aef31893135 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:26.028143 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 543/1047] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:53:26.031499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57126a-4fb8-43c3-a533-2ceeefc0d776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:26.032502 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57126a-4fb8-43c3-a533-2ceeefc0d776 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:26.033029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57126a-4fb8-43c3-a533-2ceeefc0d776 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:26.033648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e57126a-4fb8-43c3-a533-2ceeefc0d776 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:26.034604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57126a-4fb8-43c3-a533-2ceeefc0d776 None admin] RBAC: Adding query filter params (type=image) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:26.035179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57126a-4fb8-43c3-a533-2ceeefc0d776 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:26.036808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e57126a-4fb8-43c3-a533-2ceeefc0d776 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:26.043118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 505/1048] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:26.048986 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77259fd-89bf-4fde-af47-24ad29776399 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:26.054372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57126a-4fb8-43c3-a533-2ceeefc0d776 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:26.118770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:26.155590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77259fd-89bf-4fde-af47-24ad29776399 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:26.169205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e57126a-4fb8-43c3-a533-2ceeefc0d776 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:26.200758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2eb8c-25d5-4a9c-815e-159aad7950ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:26.201518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2eb8c-25d5-4a9c-815e-159aad7950ce None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:26.201730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2eb8c-25d5-4a9c-815e-159aad7950ce None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:26.201997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2eb8c-25d5-4a9c-815e-159aad7950ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:26.202781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2eb8c-25d5-4a9c-815e-159aad7950ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:26.204235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2eb8c-25d5-4a9c-815e-159aad7950ce None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:26.210162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:26.218051 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27720d15-a4d8-4dc8-b03c-30ebd7b3ccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:26.219370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27720d15-a4d8-4dc8-b03c-30ebd7b3ccd4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:26.219690 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27720d15-a4d8-4dc8-b03c-30ebd7b3ccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:26.219986 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27720d15-a4d8-4dc8-b03c-30ebd7b3ccd4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:26.221338 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27720d15-a4d8-4dc8-b03c-30ebd7b3ccd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:26.222836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27720d15-a4d8-4dc8-b03c-30ebd7b3ccd4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:26.224473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 506/1049] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:26.234865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 544/1050] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 15:53:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:53:26.235079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27720d15-a4d8-4dc8-b03c-30ebd7b3ccd4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:26.342498 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27720d15-a4d8-4dc8-b03c-30ebd7b3ccd4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:26.387167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855c3ef-cb06-4e83-a1e1-b95db415c18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:26.387910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855c3ef-cb06-4e83-a1e1-b95db415c18c None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:26.388192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855c3ef-cb06-4e83-a1e1-b95db415c18c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:26.388467 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855c3ef-cb06-4e83-a1e1-b95db415c18c None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:26.389176 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855c3ef-cb06-4e83-a1e1-b95db415c18c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:26.390612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855c3ef-cb06-4e83-a1e1-b95db415c18c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:26.412002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 507/1051] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:53:26 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 15:53:27.116323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201850a0-4c75-4e13-90b1-b91a0c905e1a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:27.116867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201850a0-4c75-4e13-90b1-b91a0c905e1a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:27.116867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201850a0-4c75-4e13-90b1-b91a0c905e1a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:27.118495 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 545/1052] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:27.123722 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083c5a2-0b2b-46c5-b24e-1820a1e2a615 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:27.124157 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083c5a2-0b2b-46c5-b24e-1820a1e2a615 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:27.124344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083c5a2-0b2b-46c5-b24e-1820a1e2a615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:27.143578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9083c5a2-0b2b-46c5-b24e-1820a1e2a615 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:27.144913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9083c5a2-0b2b-46c5-b24e-1820a1e2a615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:27.204761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:27.227959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 508/1053] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:27.253469 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201850a0-4c75-4e13-90b1-b91a0c905e1a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:27.365689 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201850a0-4c75-4e13-90b1-b91a0c905e1a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:27.390544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:27.403951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05792d0-e671-4489-8b9d-8ebc0be7c32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:27.404797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05792d0-e671-4489-8b9d-8ebc0be7c32f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:27.405087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05792d0-e671-4489-8b9d-8ebc0be7c32f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:27.405365 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05792d0-e671-4489-8b9d-8ebc0be7c32f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:27.416602 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05792d0-e671-4489-8b9d-8ebc0be7c32f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-a05792d0-e671-4489-8b9d-8ebc0be7c32f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:53:27.424924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:27.425863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:27.426740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:27.426740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:27.426740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:27.426740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:27.426740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:53:27.426740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:53:27.426740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:53:27.426740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:53:27.426740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:53:27.426740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:53:27.426740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 15:53:27.426740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:27.426740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 546/1054] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 21 15:53:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:27.432804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083c5a2-0b2b-46c5-b24e-1820a1e2a615 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:27.544409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083c5a2-0b2b-46c5-b24e-1820a1e2a615 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:27.583831 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4343a-0708-4421-b622-a1514bb5cf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:27.584606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4343a-0708-4421-b622-a1514bb5cf13 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:27.584935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4343a-0708-4421-b622-a1514bb5cf13 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:27.585246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4343a-0708-4421-b622-a1514bb5cf13 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:27.586091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4343a-0708-4421-b622-a1514bb5cf13 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:27.586430 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4343a-0708-4421-b622-a1514bb5cf13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:27.588071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4343a-0708-4421-b622-a1514bb5cf13 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:27.597524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 509/1055] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 21 15:53:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:27.603935 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05792d0-e671-4489-8b9d-8ebc0be7c32f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:27.719058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05792d0-e671-4489-8b9d-8ebc0be7c32f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:27.756231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be092e-f21f-498e-8854-9755e89360b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:27.757134 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be092e-f21f-498e-8854-9755e89360b1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:27.757476 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be092e-f21f-498e-8854-9755e89360b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:27.757804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be092e-f21f-498e-8854-9755e89360b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:27.769416 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be092e-f21f-498e-8854-9755e89360b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:27.771032 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be092e-f21f-498e-8854-9755e89360b1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:27.789752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-38be092e-f21f-498e-8854-9755e89360b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:27.789752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:27.789752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:27.789752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:27.789752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:27.789752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:27.789752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:27.789752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:27.789752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:27.789752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:27.789752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:27.789752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:27.789752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:53:27.789752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:53:27.789752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:27.790699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:27.791634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:53:27.791634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:53:27.791634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:27.791634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:27.795187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 547/1056] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:27.797618 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4343a-0708-4421-b622-a1514bb5cf13 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:27.848073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:27.906841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4343a-0708-4421-b622-a1514bb5cf13 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:27.941348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc507a81-9803-4122-ad68-13de9250f73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:27.942021 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc507a81-9803-4122-ad68-13de9250f73b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:27.942301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc507a81-9803-4122-ad68-13de9250f73b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:27.942576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc507a81-9803-4122-ad68-13de9250f73b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:27.943334 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc507a81-9803-4122-ad68-13de9250f73b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:27.943642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc507a81-9803-4122-ad68-13de9250f73b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:27.945019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc507a81-9803-4122-ad68-13de9250f73b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:27.962373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 510/1057] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:27.963699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be092e-f21f-498e-8854-9755e89360b1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:27.999039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:28.068665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be092e-f21f-498e-8854-9755e89360b1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:28.103061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859706b-09af-4830-a735-3d86afef1195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:28.103867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859706b-09af-4830-a735-3d86afef1195 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:28.104148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859706b-09af-4830-a735-3d86afef1195 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:28.104420 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859706b-09af-4830-a735-3d86afef1195 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:28.112198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859706b-09af-4830-a735-3d86afef1195 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:28.113648 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859706b-09af-4830-a735-3d86afef1195 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-3859706b-09af-4830-a735-3d86afef1195 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:53:28.128362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:28.134674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:28.135659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:28.135659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:28.135659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:53:28.135659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:53:28.135659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:53:28.135659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:53:28.135659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:53:28.135659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:53:28.135659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:53:28.135659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:28.135659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 548/1058] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 15:53:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:28.136256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc507a81-9803-4122-ad68-13de9250f73b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:28.248014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc507a81-9803-4122-ad68-13de9250f73b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:28.251271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:28.274726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67c33e-1a4d-42be-9d46-e38839b358c1 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:28.275078 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67c33e-1a4d-42be-9d46-e38839b358c1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:28.275342 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67c33e-1a4d-42be-9d46-e38839b358c1 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:28.276862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 549/1059] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:28.281884 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9141b49-b44b-4cf5-8f55-3ca23b83884b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:28.282177 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9141b49-b44b-4cf5-8f55-3ca23b83884b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:28.282453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9141b49-b44b-4cf5-8f55-3ca23b83884b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:28.284188 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d5965-b2e0-46ae-ad45-e381cbefdb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:28.284952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d5965-b2e0-46ae-ad45-e381cbefdb5c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:28.285231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d5965-b2e0-46ae-ad45-e381cbefdb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:28.285501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d5965-b2e0-46ae-ad45-e381cbefdb5c None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:28.286334 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d5965-b2e0-46ae-ad45-e381cbefdb5c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:28.286640 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d5965-b2e0-46ae-ad45-e381cbefdb5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:28.288284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d5965-b2e0-46ae-ad45-e381cbefdb5c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:28.300984 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a9141b49-b44b-4cf5-8f55-3ca23b83884b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:28.302187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a9141b49-b44b-4cf5-8f55-3ca23b83884b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:28.308424 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 511/1060] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 15:53:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:28.314300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d5965-b2e0-46ae-ad45-e381cbefdb5c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:28.376202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 550/1061] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:28.397930 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9141b49-b44b-4cf5-8f55-3ca23b83884b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:28.417643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d5965-b2e0-46ae-ad45-e381cbefdb5c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:28.424417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:28.456783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cad85-dd12-4fa8-924e-d06b1eb0088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:28.457583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cad85-dd12-4fa8-924e-d06b1eb0088f None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:28.457866 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cad85-dd12-4fa8-924e-d06b1eb0088f None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:28.458139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cad85-dd12-4fa8-924e-d06b1eb0088f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:28.468618 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cad85-dd12-4fa8-924e-d06b1eb0088f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:28.470057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cad85-dd12-4fa8-924e-d06b1eb0088f None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:28.487420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-a62cad85-dd12-4fa8-924e-d06b1eb0088f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:28.487420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:28.487420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:28.487420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:28.487420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:28.487420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:28.487420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:28.487420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:28.487420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:28.487420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:28.487420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:28.487420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:28.487420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:53:28.487420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:53:28.487420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:28.488363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:28.489274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:53:28.489274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:53:28.489274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:28.489274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:28.489274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 512/1062] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:28.492277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69789f70-c691-4cf0-8eea-60868008a2e1 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:28.492566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69789f70-c691-4cf0-8eea-60868008a2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:28.492843 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69789f70-c691-4cf0-8eea-60868008a2e1 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:28.494513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 513/1063] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:53:28.495068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69789f70-c691-4cf0-8eea-60868008a2e1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:28.505363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9141b49-b44b-4cf5-8f55-3ca23b83884b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:28.510601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:28.538506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cb242-4593-4338-ab7a-9e4c54d635c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:28.539195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cb242-4593-4338-ab7a-9e4c54d635c7 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:28.539475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cb242-4593-4338-ab7a-9e4c54d635c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:28.539750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cb242-4593-4338-ab7a-9e4c54d635c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:28.596678 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69789f70-c691-4cf0-8eea-60868008a2e1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:28.605208 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cb242-4593-4338-ab7a-9e4c54d635c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:28.606676 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cb242-4593-4338-ab7a-9e4c54d635c7 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:28.630332 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:28.630647 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72841e33-843c-4c5d-a09b-f151666340cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:28.631344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72841e33-843c-4c5d-a09b-f151666340cc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:28.631765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72841e33-843c-4c5d-a09b-f151666340cc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:28.631867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72841e33-843c-4c5d-a09b-f151666340cc None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:28.632626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72841e33-843c-4c5d-a09b-f151666340cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:28.632951 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72841e33-843c-4c5d-a09b-f151666340cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:28.634299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72841e33-843c-4c5d-a09b-f151666340cc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:28.645659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 514/1064] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:28.646863 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee14a8-c86d-43c6-8151-1b0e1c721c56 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:28.647150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee14a8-c86d-43c6-8151-1b0e1c721c56 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:28.647429 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee14a8-c86d-43c6-8151-1b0e1c721c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:28.664021 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d8ee14a8-c86d-43c6-8151-1b0e1c721c56 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:28.665196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d8ee14a8-c86d-43c6-8151-1b0e1c721c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:28.708631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 551/1065] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:53:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 15:53:28.709469 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cb242-4593-4338-ab7a-9e4c54d635c7 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:28.740556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 515/1066] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:28.741704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee14a8-c86d-43c6-8151-1b0e1c721c56 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:28.745389 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:28.806991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cb242-4593-4338-ab7a-9e4c54d635c7 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:28.829607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:28.840370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee14a8-c86d-43c6-8151-1b0e1c721c56 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:28.844406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893715b-1219-4868-989d-3c7f13c6fed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:28.845215 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893715b-1219-4868-989d-3c7f13c6fed2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:28.845496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893715b-1219-4868-989d-3c7f13c6fed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:28.845766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b893715b-1219-4868-989d-3c7f13c6fed2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:28.853160 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893715b-1219-4868-989d-3c7f13c6fed2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:28.854622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b893715b-1219-4868-989d-3c7f13c6fed2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:28.869422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-b893715b-1219-4868-989d-3c7f13c6fed2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:28.869422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:28.869422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:28.869422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:28.869422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:28.869422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:28.869422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:28.869422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:28.869422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:28.869422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:28.869422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:28.869422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:28.869422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:53:28.869422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:53:28.869422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:28.870446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:28.871539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:53:28.871539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:53:28.871539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:53:28.871539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:53:28.871539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:53:28.871539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:53:28.871539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:28.871539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:28.871539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 552/1067] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:53:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:28.872037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893715b-1219-4868-989d-3c7f13c6fed2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:28.881282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc683d-d138-4781-b316-42d4a4ce7abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:28.882102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc683d-d138-4781-b316-42d4a4ce7abe None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:28.882379 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc683d-d138-4781-b316-42d4a4ce7abe None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:28.882646 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc683d-d138-4781-b316-42d4a4ce7abe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:28.893640 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc683d-d138-4781-b316-42d4a4ce7abe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:28.895138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc683d-d138-4781-b316-42d4a4ce7abe None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:28.913296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-43cc683d-d138-4781-b316-42d4a4ce7abe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:28.913296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:28.913296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:28.913296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:28.913296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:28.913296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:28.913296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:28.913296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:28.913296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:28.913296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:28.913296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:28.913296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:28.913296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:53:28.913296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:53:28.913296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:28.914393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:28.915367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:53:28.915367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:53:28.915367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:28.915367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:28.915367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 516/1068] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:28.915367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc683d-d138-4781-b316-42d4a4ce7abe None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:28.973839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b893715b-1219-4868-989d-3c7f13c6fed2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:28.975262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:29.009488 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855097f-1660-4c57-829a-e165369cda98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:29.010283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855097f-1660-4c57-829a-e165369cda98 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:29.010565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855097f-1660-4c57-829a-e165369cda98 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:29.010868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855097f-1660-4c57-829a-e165369cda98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:29.021087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855097f-1660-4c57-829a-e165369cda98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:53:29.023599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc683d-d138-4781-b316-42d4a4ce7abe None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d855097f-1660-4c57-829a-e165369cda98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:53:29.028652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:29.029742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:29.030612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:29.030612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:29.030612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:29.030612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:29.030612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:53:29.030612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:53:29.030612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:53:29.030612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:53:29.030612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:53:29.030612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:53:29.030612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:53:29.030612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:29.030612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 553/1069] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:53:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:29.031367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855097f-1660-4c57-829a-e165369cda98 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:29.061307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e206412-b0b6-4038-87e9-c529ee11ad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:29.061898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e206412-b0b6-4038-87e9-c529ee11ad1c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:29.062180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e206412-b0b6-4038-87e9-c529ee11ad1c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:29.062456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e206412-b0b6-4038-87e9-c529ee11ad1c None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:29.063281 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e206412-b0b6-4038-87e9-c529ee11ad1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:29.063587 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e206412-b0b6-4038-87e9-c529ee11ad1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:29.065077 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e206412-b0b6-4038-87e9-c529ee11ad1c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:29.076513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 517/1070] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:53:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:29.077297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e206412-b0b6-4038-87e9-c529ee11ad1c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:29.081896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:29.134093 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855097f-1660-4c57-829a-e165369cda98 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:29.166951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8514e8d-4330-484d-86ba-95fdfcd6476f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:29.167723 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8514e8d-4330-484d-86ba-95fdfcd6476f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:29.167881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8514e8d-4330-484d-86ba-95fdfcd6476f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:29.168156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8514e8d-4330-484d-86ba-95fdfcd6476f None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:29.168884 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8514e8d-4330-484d-86ba-95fdfcd6476f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:29.169192 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8514e8d-4330-484d-86ba-95fdfcd6476f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:29.170581 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8514e8d-4330-484d-86ba-95fdfcd6476f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:29.178278 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e206412-b0b6-4038-87e9-c529ee11ad1c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:29.183751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 554/1071] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:29.184604 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8514e8d-4330-484d-86ba-95fdfcd6476f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:29.214684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:29.238784 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62856e83-0cd5-4ada-9de9-644bc82f2e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:29.239956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62856e83-0cd5-4ada-9de9-644bc82f2e91 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:29.240211 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62856e83-0cd5-4ada-9de9-644bc82f2e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:29.240511 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62856e83-0cd5-4ada-9de9-644bc82f2e91 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:29.241411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62856e83-0cd5-4ada-9de9-644bc82f2e91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:29.241573 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62856e83-0cd5-4ada-9de9-644bc82f2e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:29.243016 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62856e83-0cd5-4ada-9de9-644bc82f2e91 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:29.254209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 518/1072] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:53:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:29.260273 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62856e83-0cd5-4ada-9de9-644bc82f2e91 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:29.311421 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8514e8d-4330-484d-86ba-95fdfcd6476f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:29.313850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:29.353895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11379e9a-8144-4432-a5b7-512d33bae209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:29.354798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11379e9a-8144-4432-a5b7-512d33bae209 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:29.355104 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11379e9a-8144-4432-a5b7-512d33bae209 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:29.355377 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11379e9a-8144-4432-a5b7-512d33bae209 None admin] PATH_INFO: `/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/e9a1ec1f6bb7467dbd63ad1da36d48a9/roles/e9d9c03727a34b14af8c89c7839193cc` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:29.360574 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11379e9a-8144-4432-a5b7-512d33bae209 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d717ed2993d4a3ab21195028a16e747, user_id=e9a1ec1f6bb7467dbd63ad1da36d48a9, role_id=e9d9c03727a34b14af8c89c7839193cc)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:29.362100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11379e9a-8144-4432-a5b7-512d33bae209 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:29.376683 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 555/1073] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:53:29 2022] PUT /identity/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/e9a1ec1f6bb7467dbd63ad1da36d48a9/roles/e9d9c03727a34b14af8c89c7839193cc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:53:29.377083 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62856e83-0cd5-4ada-9de9-644bc82f2e91 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:29.425645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2a3e0-a64d-414a-bb10-5261ca14e3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:29.426570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2a3e0-a64d-414a-bb10-5261ca14e3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:29.426891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2a3e0-a64d-414a-bb10-5261ca14e3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:29.427173 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2a3e0-a64d-414a-bb10-5261ca14e3a9 None admin] PATH_INFO: `/v3/users/9cb0d0a115ab4f2c9265cf3b33d07ed8` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:29.444237 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2a3e0-a64d-414a-bb10-5261ca14e3a9 None admin] RBAC: Authorizing `identity:get_user(user_id=9cb0d0a115ab4f2c9265cf3b33d07ed8)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:29.446138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2a3e0-a64d-414a-bb10-5261ca14e3a9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:29.448291 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 519/1074] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:53:29 2022] GET /identity/v3/users/9cb0d0a115ab4f2c9265cf3b33d07ed8 => generated 285 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:29.454245 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11379e9a-8144-4432-a5b7-512d33bae209 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:29.569591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11379e9a-8144-4432-a5b7-512d33bae209 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:29.606237 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d8e8f-24f6-4440-9ff3-679a10115db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:29.606916 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d8e8f-24f6-4440-9ff3-679a10115db0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:29.607202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d8e8f-24f6-4440-9ff3-679a10115db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:29.607478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d8e8f-24f6-4440-9ff3-679a10115db0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:29.638801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:29.677539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d8e8f-24f6-4440-9ff3-679a10115db0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:29.679040 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d8e8f-24f6-4440-9ff3-679a10115db0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:29.777877 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 556/1075] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:53:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:53:29.783881 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2a3e0-a64d-414a-bb10-5261ca14e3a9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:29.819899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:29.883213 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2a3e0-a64d-414a-bb10-5261ca14e3a9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:29.916165 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149d14d-6e51-4ad8-b67a-c80c0f7cb5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:29.917047 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149d14d-6e51-4ad8-b67a-c80c0f7cb5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:29.917323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149d14d-6e51-4ad8-b67a-c80c0f7cb5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:29.917593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149d14d-6e51-4ad8-b67a-c80c0f7cb5c6 None admin] PATH_INFO: `/v3/projects/73107e7bc96441d2a649ad10fbf16da0` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:29.918763 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149d14d-6e51-4ad8-b67a-c80c0f7cb5c6 None admin] RBAC: Authorizing `identity:get_project(project_id=73107e7bc96441d2a649ad10fbf16da0)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:29.920206 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1149d14d-6e51-4ad8-b67a-c80c0f7cb5c6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:29.921920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 520/1076] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:53:29 2022] GET /identity/v3/projects/73107e7bc96441d2a649ad10fbf16da0 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:29.928112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d8e8f-24f6-4440-9ff3-679a10115db0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:29.987500 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:30.024697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d8e8f-24f6-4440-9ff3-679a10115db0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:30.059669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3626b6-3eb3-47ed-b49d-62bda66dd54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:30.060323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3626b6-3eb3-47ed-b49d-62bda66dd54e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:30.060602 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3626b6-3eb3-47ed-b49d-62bda66dd54e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:30.060875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3626b6-3eb3-47ed-b49d-62bda66dd54e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:30.061707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3626b6-3eb3-47ed-b49d-62bda66dd54e None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=73107e7bc96441d2a649ad10fbf16da0, user.id=9cb0d0a115ab4f2c9265cf3b33d07ed8) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:30.062021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3626b6-3eb3-47ed-b49d-62bda66dd54e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:30.063481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3626b6-3eb3-47ed-b49d-62bda66dd54e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:30.068926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 557/1077] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:53:29 2022] GET /identity/v3/role_assignments?user.id=9cb0d0a115ab4f2c9265cf3b33d07ed8&scope.project.id=73107e7bc96441d2a649ad10fbf16da0&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:31.378566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f950d4-256e-4c64-bdf2-58f26b7d5b5f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:31.379162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f950d4-256e-4c64-bdf2-58f26b7d5b5f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:31.379162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f950d4-256e-4c64-bdf2-58f26b7d5b5f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:31.380477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 521/1078] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:31.385899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99b9af-7a20-446e-b382-2f0873a9bf1a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:31.386295 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99b9af-7a20-446e-b382-2f0873a9bf1a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:31.386490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99b9af-7a20-446e-b382-2f0873a9bf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:31.403888 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ba99b9af-7a20-446e-b382-2f0873a9bf1a None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:31.405066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ba99b9af-7a20-446e-b382-2f0873a9bf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:31.472587 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 558/1079] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:31.496153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f950d4-256e-4c64-bdf2-58f26b7d5b5f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:31.599929 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f950d4-256e-4c64-bdf2-58f26b7d5b5f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:31.602313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:31.636219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7586e-1464-4a6f-9992-4567d8a2de83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:31.637041 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7586e-1464-4a6f-9992-4567d8a2de83 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:31.637323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7586e-1464-4a6f-9992-4567d8a2de83 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:31.637592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7586e-1464-4a6f-9992-4567d8a2de83 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:31.647948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7586e-1464-4a6f-9992-4567d8a2de83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f4b7586e-1464-4a6f-9992-4567d8a2de83 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:53:31.656131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:31.657131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:31.658008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:31.658008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:31.658008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:31.658008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:31.658008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:53:31.658008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:53:31.658008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:53:31.658008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:53:31.658008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:53:31.658008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:53:31.658008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 15:53:31.658008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:31.658008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 522/1080] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Jul 21 15:53:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:31.663441 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99b9af-7a20-446e-b382-2f0873a9bf1a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:31.724023 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:31.768313 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99b9af-7a20-446e-b382-2f0873a9bf1a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:31.808823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9b1a0-05b4-4b22-b04c-7142db90a024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:31.809491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9b1a0-05b4-4b22-b04c-7142db90a024 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:31.809770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9b1a0-05b4-4b22-b04c-7142db90a024 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:31.810041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9b1a0-05b4-4b22-b04c-7142db90a024 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:31.810789 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9b1a0-05b4-4b22-b04c-7142db90a024 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:31.811197 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9b1a0-05b4-4b22-b04c-7142db90a024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:31.812575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9b1a0-05b4-4b22-b04c-7142db90a024 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:31.821119 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 559/1081] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 21 15:53:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:31.826933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7586e-1464-4a6f-9992-4567d8a2de83 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:31.935212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7586e-1464-4a6f-9992-4567d8a2de83 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:31.969267 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc59d87-2293-4e9a-b026-95e18a1fc477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:31.970057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc59d87-2293-4e9a-b026-95e18a1fc477 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:31.970335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc59d87-2293-4e9a-b026-95e18a1fc477 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:31.970603 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc59d87-2293-4e9a-b026-95e18a1fc477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:31.981547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc59d87-2293-4e9a-b026-95e18a1fc477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:31.982949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc59d87-2293-4e9a-b026-95e18a1fc477 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:32.000217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-bbc59d87-2293-4e9a-b026-95e18a1fc477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:32.000217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:32.000217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:32.000217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:32.000217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:32.000217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:32.000217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:32.000217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:32.000217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:32.000217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:32.000217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:32.000217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:32.000217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:53:32.000217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:53:32.000217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:32.001240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:32.002356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:53:32.002356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:53:32.002356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:32.002356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:32.002356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 523/1082] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:32.007281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9b1a0-05b4-4b22-b04c-7142db90a024 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:32.032262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eb05d-1287-4b71-976e-9ecbfba95a89 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:32.032578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eb05d-1287-4b71-976e-9ecbfba95a89 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:32.032800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291eb05d-1287-4b71-976e-9ecbfba95a89 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:32.034201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 524/1083] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:53:32.039128 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec8ce3-40a1-48a1-bf6c-f7248749bb21 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:32.039407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec8ce3-40a1-48a1-bf6c-f7248749bb21 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:32.039678 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aec8ce3-40a1-48a1-bf6c-f7248749bb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:32.056762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3aec8ce3-40a1-48a1-bf6c-f7248749bb21 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:32.057946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3aec8ce3-40a1-48a1-bf6c-f7248749bb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:32.068781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:32.109455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9b1a0-05b4-4b22-b04c-7142db90a024 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:32.126638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 525/1084] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:53:32.129497 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:32.143858 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dd4fd-d6cd-4450-a543-d9279ebdd6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:32.144527 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dd4fd-d6cd-4450-a543-d9279ebdd6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:32.144811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dd4fd-d6cd-4450-a543-d9279ebdd6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:32.145089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dd4fd-d6cd-4450-a543-d9279ebdd6f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:32.145814 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dd4fd-d6cd-4450-a543-d9279ebdd6f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:32.146122 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dd4fd-d6cd-4450-a543-d9279ebdd6f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:32.147541 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dd4fd-d6cd-4450-a543-d9279ebdd6f9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:32.148724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec8ce3-40a1-48a1-bf6c-f7248749bb21 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:32.159553 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 560/1085] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:32.165088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dd4fd-d6cd-4450-a543-d9279ebdd6f9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:32.249973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aec8ce3-40a1-48a1-bf6c-f7248749bb21 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:32.264423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dd4fd-d6cd-4450-a543-d9279ebdd6f9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:32.283230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88faed-757c-4c54-9a31-4347889a7bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:32.284039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88faed-757c-4c54-9a31-4347889a7bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:32.284326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88faed-757c-4c54-9a31-4347889a7bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:32.284597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa88faed-757c-4c54-9a31-4347889a7bd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:32.296216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa88faed-757c-4c54-9a31-4347889a7bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:53:32.297165 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb8472-4f55-443a-82a0-3b9818ab3b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:32.297953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8472-4f55-443a-82a0-3b9818ab3b1f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:32.298231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8472-4f55-443a-82a0-3b9818ab3b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:32.298508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb8472-4f55-443a-82a0-3b9818ab3b1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-fa88faed-757c-4c54-9a31-4347889a7bd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:53:32.303993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:32.305085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:32.305964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:32.305964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:32.305964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:32.305964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:32.305964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:53:32.305964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:53:32.305964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:53:32.305964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:53:32.305964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:53:32.305964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:53:32.305964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:53:32.305964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:32.305964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 526/1086] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:53:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:32.306673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb8472-4f55-443a-82a0-3b9818ab3b1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:32.307157 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb8472-4f55-443a-82a0-3b9818ab3b1f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:32.311140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88faed-757c-4c54-9a31-4347889a7bd0 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:32.320858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-80cb8472-4f55-443a-82a0-3b9818ab3b1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:53:32.321439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:32.322671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:32.323712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:32.323712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:32.323712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:53:32.323712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:53:32.323712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:53:32.323712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:53:32.323712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:53:32.323712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:53:32.323712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 15:53:32.323712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:32.323712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 561/1087] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Jul 21 15:53:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:32.328406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb8472-4f55-443a-82a0-3b9818ab3b1f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:32.370434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:32.413318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa88faed-757c-4c54-9a31-4347889a7bd0 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:32.430454 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb8472-4f55-443a-82a0-3b9818ab3b1f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:32.446357 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7035f7b-c466-4aee-ae18-349d3ee5fd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:32.447056 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7035f7b-c466-4aee-ae18-349d3ee5fd2d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:32.447342 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7035f7b-c466-4aee-ae18-349d3ee5fd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:32.447614 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7035f7b-c466-4aee-ae18-349d3ee5fd2d None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:32.448362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7035f7b-c466-4aee-ae18-349d3ee5fd2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:32.448672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7035f7b-c466-4aee-ae18-349d3ee5fd2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:32.450051 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7035f7b-c466-4aee-ae18-349d3ee5fd2d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:32.458615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 527/1088] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:53:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:32.464709 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7035f7b-c466-4aee-ae18-349d3ee5fd2d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:32.465935 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5ad96-96b1-47e8-9b14-0006352cda75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:32.466705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5ad96-96b1-47e8-9b14-0006352cda75 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:32.467081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5ad96-96b1-47e8-9b14-0006352cda75 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:32.467430 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5ad96-96b1-47e8-9b14-0006352cda75 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:32.468349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5ad96-96b1-47e8-9b14-0006352cda75 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:32.468727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5ad96-96b1-47e8-9b14-0006352cda75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:32.470226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5ad96-96b1-47e8-9b14-0006352cda75 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:32.487517 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 562/1089] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Jul 21 15:53:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:32.493522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5ad96-96b1-47e8-9b14-0006352cda75 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:32.534897 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:32.569630 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7035f7b-c466-4aee-ae18-349d3ee5fd2d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:32.590578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:32.594527 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5ad96-96b1-47e8-9b14-0006352cda75 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:32.604503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f236c1-e15a-437d-aaab-0a2a3c0aa070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:32.605463 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f236c1-e15a-437d-aaab-0a2a3c0aa070 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:32.605772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f236c1-e15a-437d-aaab-0a2a3c0aa070 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:32.606079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f236c1-e15a-437d-aaab-0a2a3c0aa070 None admin] PATH_INFO: `/v3/users/9cb0d0a115ab4f2c9265cf3b33d07ed8` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:32.607422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f236c1-e15a-437d-aaab-0a2a3c0aa070 None admin] RBAC: Authorizing `identity:get_user(user_id=9cb0d0a115ab4f2c9265cf3b33d07ed8)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:32.609002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f236c1-e15a-437d-aaab-0a2a3c0aa070 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:32.610901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 528/1090] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:53:32 2022] GET /identity/v3/users/9cb0d0a115ab4f2c9265cf3b33d07ed8 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:53:32.617975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f236c1-e15a-437d-aaab-0a2a3c0aa070 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:32.630278 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b45fa-f731-46c5-a845-64011df7a078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:32.630958 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b45fa-f731-46c5-a845-64011df7a078 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:32.631240 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b45fa-f731-46c5-a845-64011df7a078 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:32.631508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b45fa-f731-46c5-a845-64011df7a078 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:32.700618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b45fa-f731-46c5-a845-64011df7a078 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:32.702255 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b45fa-f731-46c5-a845-64011df7a078 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:32.719303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f236c1-e15a-437d-aaab-0a2a3c0aa070 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:32.754033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b55803-e862-43a1-88a5-25a647c113e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:32.755018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b55803-e862-43a1-88a5-25a647c113e1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:32.755332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b55803-e862-43a1-88a5-25a647c113e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:32.755624 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b55803-e862-43a1-88a5-25a647c113e1 None admin] PATH_INFO: `/v3/projects/73107e7bc96441d2a649ad10fbf16da0` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:32.756945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b55803-e862-43a1-88a5-25a647c113e1 None admin] RBAC: Authorizing `identity:get_project(project_id=73107e7bc96441d2a649ad10fbf16da0)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:32.758501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b55803-e862-43a1-88a5-25a647c113e1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:32.760395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 529/1091] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:53:32 2022] GET /identity/v3/projects/73107e7bc96441d2a649ad10fbf16da0 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:32.766885 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b55803-e862-43a1-88a5-25a647c113e1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:32.770580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:32.796712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:32.802036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 563/1092] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:53:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:53:32.807640 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b45fa-f731-46c5-a845-64011df7a078 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:32.874407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b55803-e862-43a1-88a5-25a647c113e1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:32.905566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b45fa-f731-46c5-a845-64011df7a078 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:32.910069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76015110-92df-45a3-bb73-9f7d2cb3a4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:32.910069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76015110-92df-45a3-bb73-9f7d2cb3a4c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:32.910069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76015110-92df-45a3-bb73-9f7d2cb3a4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:32.910400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76015110-92df-45a3-bb73-9f7d2cb3a4c3 None admin] PATH_INFO: `/v3/projects/73107e7bc96441d2a649ad10fbf16da0/users/9cb0d0a115ab4f2c9265cf3b33d07ed8/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:32.912101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76015110-92df-45a3-bb73-9f7d2cb3a4c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=73107e7bc96441d2a649ad10fbf16da0, user_id=9cb0d0a115ab4f2c9265cf3b33d07ed8, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:32.913537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76015110-92df-45a3-bb73-9f7d2cb3a4c3 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:32.927185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 530/1093] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:53:32 2022] PUT /identity/v3/projects/73107e7bc96441d2a649ad10fbf16da0/users/9cb0d0a115ab4f2c9265cf3b33d07ed8/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 15:53:32.940559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a07fc-c3d5-4d38-ac39-baeb8dd3bfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:32.941390 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a07fc-c3d5-4d38-ac39-baeb8dd3bfe1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:32.941671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a07fc-c3d5-4d38-ac39-baeb8dd3bfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:32.941947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a07fc-c3d5-4d38-ac39-baeb8dd3bfe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:32.953613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a07fc-c3d5-4d38-ac39-baeb8dd3bfe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:32.955261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a07fc-c3d5-4d38-ac39-baeb8dd3bfe1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:32.974261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-238a07fc-c3d5-4d38-ac39-baeb8dd3bfe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:32.974261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:32.974261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:32.974261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:32.974261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:32.974261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:32.974261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:32.974261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:32.974261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:32.974261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:32.974261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:32.974261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:32.974261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:53:32.974261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:53:32.974261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:32.975292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:32.976205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:53:32.976205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:53:32.976205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:53:32.976205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:32.976205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 564/1094] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:53:32.981784 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76015110-92df-45a3-bb73-9f7d2cb3a4c3 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:33.050687 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:33.093456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76015110-92df-45a3-bb73-9f7d2cb3a4c3 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:33.128594 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69af51-df45-4674-8178-de9a554d8fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:33.129265 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69af51-df45-4674-8178-de9a554d8fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:33.129548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69af51-df45-4674-8178-de9a554d8fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:33.129826 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69af51-df45-4674-8178-de9a554d8fa7 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:33.130548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69af51-df45-4674-8178-de9a554d8fa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:33.130886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69af51-df45-4674-8178-de9a554d8fa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:33.132270 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69af51-df45-4674-8178-de9a554d8fa7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:33.144212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 531/1095] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:33.150150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a07fc-c3d5-4d38-ac39-baeb8dd3bfe1 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:33.202608 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:33.256228 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a07fc-c3d5-4d38-ac39-baeb8dd3bfe1 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:33.291191 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a85ce-02f6-41e9-a8df-8c293ec80454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:33.291993 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a85ce-02f6-41e9-a8df-8c293ec80454 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:33.292281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a85ce-02f6-41e9-a8df-8c293ec80454 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:33.292560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16a85ce-02f6-41e9-a8df-8c293ec80454 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:33.299450 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a85ce-02f6-41e9-a8df-8c293ec80454 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:33.300963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16a85ce-02f6-41e9-a8df-8c293ec80454 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:33.314463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d16a85ce-02f6-41e9-a8df-8c293ec80454 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:33.314463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:33.314463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:33.314463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:33.314463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:33.314463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:33.314463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:33.314463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:33.314463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:33.314463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:33.314463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:33.314463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:33.314463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:53:33.314463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:53:33.314463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:33.315444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:33.316537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:53:33.316537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:53:33.316537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:53:33.316537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:53:33.316537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:53:33.316537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:53:33.316537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:53:33.316537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:53:33.316537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 565/1096] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:53:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:33.321720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69af51-df45-4674-8178-de9a554d8fa7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:33.426515 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69af51-df45-4674-8178-de9a554d8fa7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:33.450239 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:33.461682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab0e670-5452-447e-8169-42c66a42ff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:33.462351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0e670-5452-447e-8169-42c66a42ff0c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:33.462631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0e670-5452-447e-8169-42c66a42ff0c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:33.462936 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab0e670-5452-447e-8169-42c66a42ff0c None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:33.463734 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0e670-5452-447e-8169-42c66a42ff0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:33.464047 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0e670-5452-447e-8169-42c66a42ff0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:33.465485 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab0e670-5452-447e-8169-42c66a42ff0c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:33.476976 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 532/1097] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:53:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:33.483133 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a85ce-02f6-41e9-a8df-8c293ec80454 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:33.587793 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16a85ce-02f6-41e9-a8df-8c293ec80454 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:33.598384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:33.625445 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3ab20-e79c-4c0a-b233-c1d877580410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:33.626108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3ab20-e79c-4c0a-b233-c1d877580410 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:33.626378 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3ab20-e79c-4c0a-b233-c1d877580410 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:33.626651 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3ab20-e79c-4c0a-b233-c1d877580410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:33.627631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3ab20-e79c-4c0a-b233-c1d877580410 None admin] RBAC: Adding query filter params (role.id=e9d9c03727a34b14af8c89c7839193cc, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=e9a1ec1f6bb7467dbd63ad1da36d48a9) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:33.627941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3ab20-e79c-4c0a-b233-c1d877580410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:33.629367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3ab20-e79c-4c0a-b233-c1d877580410 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:33.635559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 566/1098] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:53:33 2022] GET /identity/v3/role_assignments?user.id=e9a1ec1f6bb7467dbd63ad1da36d48a9&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=e9d9c03727a34b14af8c89c7839193cc => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:35.004984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad87b7-2a3f-40bb-9f92-e52c70755606 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:35.005781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad87b7-2a3f-40bb-9f92-e52c70755606 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:35.005781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad87b7-2a3f-40bb-9f92-e52c70755606 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:35.007903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 533/1099] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:35.014094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e97b4b-308b-422f-9c67-1a86e9fd47f1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:35.014870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e97b4b-308b-422f-9c67-1a86e9fd47f1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:35.015033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e97b4b-308b-422f-9c67-1a86e9fd47f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:35.038979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-98e97b4b-308b-422f-9c67-1a86e9fd47f1 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:35.040170 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-98e97b4b-308b-422f-9c67-1a86e9fd47f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:35.119493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 567/1100] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:35.145993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad87b7-2a3f-40bb-9f92-e52c70755606 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:35.264182 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad87b7-2a3f-40bb-9f92-e52c70755606 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:35.299389 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9419a2-8ec0-4214-9ff0-aac65590be9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:35.300173 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9419a2-8ec0-4214-9ff0-aac65590be9b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:35.300457 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9419a2-8ec0-4214-9ff0-aac65590be9b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:35.300731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9419a2-8ec0-4214-9ff0-aac65590be9b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:35.311748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9419a2-8ec0-4214-9ff0-aac65590be9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8c9419a2-8ec0-4214-9ff0-aac65590be9b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:53:35.319368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:35.320431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:35.321483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:35.321483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:35.321483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:35.321483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:35.321483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:53:35.321483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:53:35.321483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:53:35.321483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:53:35.321483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:53:35.321483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:53:35.321483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:53:35.321483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:35.321483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 534/1101] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:35.326910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e97b4b-308b-422f-9c67-1a86e9fd47f1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:35.426744 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e97b4b-308b-422f-9c67-1a86e9fd47f1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:35.429074 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:35.473038 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb159174-9229-4472-bdd6-60b83689b115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:35.473713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb159174-9229-4472-bdd6-60b83689b115 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:35.473993 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb159174-9229-4472-bdd6-60b83689b115 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:35.474265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb159174-9229-4472-bdd6-60b83689b115 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:35.475046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb159174-9229-4472-bdd6-60b83689b115 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:35.475357 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb159174-9229-4472-bdd6-60b83689b115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:35.476743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb159174-9229-4472-bdd6-60b83689b115 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:35.485110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 568/1102] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:53:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:35.491958 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9419a2-8ec0-4214-9ff0-aac65590be9b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:35.538330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:35.595408 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9419a2-8ec0-4214-9ff0-aac65590be9b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:35.631157 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab8bb2-eb2c-4ab2-96ba-8eeaf4d46702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:35.632007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab8bb2-eb2c-4ab2-96ba-8eeaf4d46702 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:35.632286 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab8bb2-eb2c-4ab2-96ba-8eeaf4d46702 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:35.632554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ab8bb2-eb2c-4ab2-96ba-8eeaf4d46702 None admin] PATH_INFO: `/v3/users/9cb0d0a115ab4f2c9265cf3b33d07ed8` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:35.633758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab8bb2-eb2c-4ab2-96ba-8eeaf4d46702 None admin] RBAC: Authorizing `identity:get_user(user_id=9cb0d0a115ab4f2c9265cf3b33d07ed8)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:35.635217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ab8bb2-eb2c-4ab2-96ba-8eeaf4d46702 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:35.636767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 535/1103] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:53:35 2022] GET /identity/v3/users/9cb0d0a115ab4f2c9265cf3b33d07ed8 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:35.645637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb159174-9229-4472-bdd6-60b83689b115 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:35.754190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb159174-9229-4472-bdd6-60b83689b115 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:35.797354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec690101-7d8f-4ddd-ad96-7a6fd9f0fd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:35.797923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec690101-7d8f-4ddd-ad96-7a6fd9f0fd2d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:35.798204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec690101-7d8f-4ddd-ad96-7a6fd9f0fd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:35.798476 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec690101-7d8f-4ddd-ad96-7a6fd9f0fd2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:35.830578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:35.871669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec690101-7d8f-4ddd-ad96-7a6fd9f0fd2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:35.873312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec690101-7d8f-4ddd-ad96-7a6fd9f0fd2d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:35.985876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 569/1104] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:53:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:53:35.993142 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab8bb2-eb2c-4ab2-96ba-8eeaf4d46702 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:36.109231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ab8bb2-eb2c-4ab2-96ba-8eeaf4d46702 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:36.125216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:36.148554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45871df2-82df-410c-9a50-d36df0795926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:36.149435 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45871df2-82df-410c-9a50-d36df0795926 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:36.149713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45871df2-82df-410c-9a50-d36df0795926 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:36.149985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45871df2-82df-410c-9a50-d36df0795926 None admin] PATH_INFO: `/v3/projects/73107e7bc96441d2a649ad10fbf16da0` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:36.151228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45871df2-82df-410c-9a50-d36df0795926 None admin] RBAC: Authorizing `identity:get_project(project_id=73107e7bc96441d2a649ad10fbf16da0)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:36.152655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45871df2-82df-410c-9a50-d36df0795926 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:36.154336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 536/1105] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:53:35 2022] GET /identity/v3/projects/73107e7bc96441d2a649ad10fbf16da0 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:36.164288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec690101-7d8f-4ddd-ad96-7a6fd9f0fd2d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:36.234893 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:36.283047 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec690101-7d8f-4ddd-ad96-7a6fd9f0fd2d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:36.319434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be17bb8-dd78-4ede-b931-cda6366ec68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:36.320080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be17bb8-dd78-4ede-b931-cda6366ec68d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:36.320357 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be17bb8-dd78-4ede-b931-cda6366ec68d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:36.320633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be17bb8-dd78-4ede-b931-cda6366ec68d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:36.321462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be17bb8-dd78-4ede-b931-cda6366ec68d None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=73107e7bc96441d2a649ad10fbf16da0, user.id=9cb0d0a115ab4f2c9265cf3b33d07ed8) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:36.321776 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be17bb8-dd78-4ede-b931-cda6366ec68d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:36.323228 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be17bb8-dd78-4ede-b931-cda6366ec68d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:36.329213 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 570/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:53:36 2022] GET /identity/v3/role_assignments?user.id=9cb0d0a115ab4f2c9265cf3b33d07ed8&scope.project.id=73107e7bc96441d2a649ad10fbf16da0&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:38.323404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dd2f4-5036-4349-9536-06559ae71830 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:38.323941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dd2f4-5036-4349-9536-06559ae71830 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:38.323941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2dd2f4-5036-4349-9536-06559ae71830 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:38.325297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 537/1107] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:38.330789 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd6cbd-6e5d-4b6c-912d-c8998e48aa85 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:38.331251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd6cbd-6e5d-4b6c-912d-c8998e48aa85 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:38.331350 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd6cbd-6e5d-4b6c-912d-c8998e48aa85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:38.349738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e9fd6cbd-6e5d-4b6c-912d-c8998e48aa85 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:38.350940 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e9fd6cbd-6e5d-4b6c-912d-c8998e48aa85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:38.424779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 571/1108] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:38.460609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dd2f4-5036-4349-9536-06559ae71830 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:38.581672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2dd2f4-5036-4349-9536-06559ae71830 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:38.617841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141480d-96d2-4600-bef3-80d859fc494b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:38.618642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141480d-96d2-4600-bef3-80d859fc494b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:38.618961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141480d-96d2-4600-bef3-80d859fc494b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:38.619238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141480d-96d2-4600-bef3-80d859fc494b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:38.620478 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141480d-96d2-4600-bef3-80d859fc494b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:38.621930 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141480d-96d2-4600-bef3-80d859fc494b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:38.623570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 538/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:38.632207 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd6cbd-6e5d-4b6c-912d-c8998e48aa85 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:38.698506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:38.740726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd6cbd-6e5d-4b6c-912d-c8998e48aa85 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:38.776859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6fef77-6d3e-4173-b7ba-f62360a5cee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:38.777521 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fef77-6d3e-4173-b7ba-f62360a5cee2 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:38.777798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fef77-6d3e-4173-b7ba-f62360a5cee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:38.778065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6fef77-6d3e-4173-b7ba-f62360a5cee2 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:38.778768 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fef77-6d3e-4173-b7ba-f62360a5cee2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:38.780241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6fef77-6d3e-4173-b7ba-f62360a5cee2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:38.802876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 572/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:53:38 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:53:40.884212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbee81c-0f97-4460-ac19-07fcae4053e0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:40.884957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbee81c-0f97-4460-ac19-07fcae4053e0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:40.884957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbee81c-0f97-4460-ac19-07fcae4053e0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:40.886780 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 539/1111] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:40.894987 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da347195-c4a8-49f5-bf6c-980488667b70 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:40.895435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da347195-c4a8-49f5-bf6c-980488667b70 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:40.895579 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da347195-c4a8-49f5-bf6c-980488667b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:40.918352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-da347195-c4a8-49f5-bf6c-980488667b70 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:40.919580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-da347195-c4a8-49f5-bf6c-980488667b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:40.987759 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 573/1112] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:41.011393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbee81c-0f97-4460-ac19-07fcae4053e0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:41.063009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:41.125194 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbee81c-0f97-4460-ac19-07fcae4053e0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:41.160839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d757fa-0186-47bf-b42d-71e22c2c4961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:41.161689 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d757fa-0186-47bf-b42d-71e22c2c4961 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:41.161971 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d757fa-0186-47bf-b42d-71e22c2c4961 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:41.162226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d757fa-0186-47bf-b42d-71e22c2c4961 None admin] PATH_INFO: `/v3/roles/e9dc595c6b4248d3b5262b70a90e76c5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:41.163809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d757fa-0186-47bf-b42d-71e22c2c4961 None admin] RBAC: Authorizing `identity:get_role(role_id=e9dc595c6b4248d3b5262b70a90e76c5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:41.165193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d757fa-0186-47bf-b42d-71e22c2c4961 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:41.166604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 540/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:53:41 2022] GET /identity/v3/roles/e9dc595c6b4248d3b5262b70a90e76c5 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:41.173278 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da347195-c4a8-49f5-bf6c-980488667b70 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:41.227845 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:41.283697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da347195-c4a8-49f5-bf6c-980488667b70 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:41.318700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd361dfc-b478-4e3b-b7be-b7b3d7ab8f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:41.319603 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd361dfc-b478-4e3b-b7be-b7b3d7ab8f1f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:41.319879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd361dfc-b478-4e3b-b7be-b7b3d7ab8f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:41.320158 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd361dfc-b478-4e3b-b7be-b7b3d7ab8f1f None admin] PATH_INFO: `/v3/users/2663895abc5f4718b29b35963180bc27` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:41.333658 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd361dfc-b478-4e3b-b7be-b7b3d7ab8f1f None admin] RBAC: Authorizing `identity:get_user(user_id=2663895abc5f4718b29b35963180bc27)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:41.335148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd361dfc-b478-4e3b-b7be-b7b3d7ab8f1f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:41.336785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 574/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:53:41 2022] GET /identity/v3/users/2663895abc5f4718b29b35963180bc27 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:41.343546 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d757fa-0186-47bf-b42d-71e22c2c4961 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:41.450637 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d757fa-0186-47bf-b42d-71e22c2c4961 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:41.469360 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:41.497601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c2624-6086-4bb4-b1ff-599d91bb5264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:41.498271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c2624-6086-4bb4-b1ff-599d91bb5264 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:41.498565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c2624-6086-4bb4-b1ff-599d91bb5264 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:41.498840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c2624-6086-4bb4-b1ff-599d91bb5264 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:41.572001 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c2624-6086-4bb4-b1ff-599d91bb5264 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:41.573454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c2624-6086-4bb4-b1ff-599d91bb5264 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:41.688669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 541/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:53:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:53:41.698305 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd361dfc-b478-4e3b-b7be-b7b3d7ab8f1f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:41.807021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd361dfc-b478-4e3b-b7be-b7b3d7ab8f1f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:41.809274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:41.858350 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043aa03-d305-4229-b912-bc7ff13738b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:41.859723 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043aa03-d305-4229-b912-bc7ff13738b8 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:41.860161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043aa03-d305-4229-b912-bc7ff13738b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:41.860582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043aa03-d305-4229-b912-bc7ff13738b8 None admin] PATH_INFO: `/v3/projects/73107e7bc96441d2a649ad10fbf16da0` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:41.862851 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043aa03-d305-4229-b912-bc7ff13738b8 None admin] RBAC: Authorizing `identity:get_project(project_id=73107e7bc96441d2a649ad10fbf16da0)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:41.865565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043aa03-d305-4229-b912-bc7ff13738b8 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:41.867706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 575/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:53:41 2022] GET /identity/v3/projects/73107e7bc96441d2a649ad10fbf16da0 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:41.876732 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c2624-6086-4bb4-b1ff-599d91bb5264 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:41.903189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:41.991461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c2624-6086-4bb4-b1ff-599d91bb5264 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:42.026835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854ddfa-7fa2-4c5d-a242-b14f69b6ce14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:42.027487 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854ddfa-7fa2-4c5d-a242-b14f69b6ce14 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:42.027766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854ddfa-7fa2-4c5d-a242-b14f69b6ce14 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:42.028040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854ddfa-7fa2-4c5d-a242-b14f69b6ce14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:42.028868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854ddfa-7fa2-4c5d-a242-b14f69b6ce14 None admin] RBAC: Adding query filter params (role.id=e9dc595c6b4248d3b5262b70a90e76c5, scope.project.id=73107e7bc96441d2a649ad10fbf16da0, user.id=2663895abc5f4718b29b35963180bc27) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:42.029178 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854ddfa-7fa2-4c5d-a242-b14f69b6ce14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:42.030612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854ddfa-7fa2-4c5d-a242-b14f69b6ce14 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:42.036175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 542/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:53:41 2022] GET /identity/v3/role_assignments?user.id=2663895abc5f4718b29b35963180bc27&scope.project.id=73107e7bc96441d2a649ad10fbf16da0&role.id=e9dc595c6b4248d3b5262b70a90e76c5 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:44.002721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ffbcb-2c43-429d-ade6-1a2695819a9f None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:44.003642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ffbcb-2c43-429d-ade6-1a2695819a9f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:44.003642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ffbcb-2c43-429d-ade6-1a2695819a9f None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:44.005883 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 576/1118] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:44.014405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a49640-382e-4667-95a1-c1082366d2e0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:44.014855 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a49640-382e-4667-95a1-c1082366d2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:44.015034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a49640-382e-4667-95a1-c1082366d2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:44.035645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-74a49640-382e-4667-95a1-c1082366d2e0 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:44.036813 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-74a49640-382e-4667-95a1-c1082366d2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:44.105805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 543/1119] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:44.137559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ffbcb-2c43-429d-ade6-1a2695819a9f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:44.252409 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ffbcb-2c43-429d-ade6-1a2695819a9f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:44.291450 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636466fc-edfe-408f-9239-a762ffe65dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:44.292234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636466fc-edfe-408f-9239-a762ffe65dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:44.292520 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636466fc-edfe-408f-9239-a762ffe65dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:44.292796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636466fc-edfe-408f-9239-a762ffe65dd3 None admin] PATH_INFO: `/v3/roles/e9dc595c6b4248d3b5262b70a90e76c5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:44.294323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636466fc-edfe-408f-9239-a762ffe65dd3 None admin] RBAC: Authorizing `identity:get_role(role_id=e9dc595c6b4248d3b5262b70a90e76c5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:44.295741 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636466fc-edfe-408f-9239-a762ffe65dd3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:44.297109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 577/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:53:44 2022] GET /identity/v3/roles/e9dc595c6b4248d3b5262b70a90e76c5 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:44.304586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a49640-382e-4667-95a1-c1082366d2e0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:44.321912 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:44.422480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a49640-382e-4667-95a1-c1082366d2e0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:44.457994 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231da3d7-ae71-4352-b9a5-065b0ff15140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:44.458943 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231da3d7-ae71-4352-b9a5-065b0ff15140 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:44.459223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231da3d7-ae71-4352-b9a5-065b0ff15140 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:44.459497 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231da3d7-ae71-4352-b9a5-065b0ff15140 None admin] PATH_INFO: `/v3/users/2663895abc5f4718b29b35963180bc27` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:44.460722 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231da3d7-ae71-4352-b9a5-065b0ff15140 None admin] RBAC: Authorizing `identity:get_user(user_id=2663895abc5f4718b29b35963180bc27)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:44.462165 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231da3d7-ae71-4352-b9a5-065b0ff15140 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:44.464106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 544/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:53:44 2022] GET /identity/v3/users/2663895abc5f4718b29b35963180bc27 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:44.470224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636466fc-edfe-408f-9239-a762ffe65dd3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:44.521168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:44.583933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636466fc-edfe-408f-9239-a762ffe65dd3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:44.620055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8539cfe0-071f-4a10-a2c9-fbc1a4307703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:44.620918 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539cfe0-071f-4a10-a2c9-fbc1a4307703 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:44.621198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539cfe0-071f-4a10-a2c9-fbc1a4307703 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:44.621473 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8539cfe0-071f-4a10-a2c9-fbc1a4307703 None admin] PATH_INFO: `/v3/projects/73107e7bc96441d2a649ad10fbf16da0` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:44.622674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539cfe0-071f-4a10-a2c9-fbc1a4307703 None admin] RBAC: Authorizing `identity:get_project(project_id=73107e7bc96441d2a649ad10fbf16da0)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:44.624156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8539cfe0-071f-4a10-a2c9-fbc1a4307703 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:44.625874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 578/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:53:44 2022] GET /identity/v3/projects/73107e7bc96441d2a649ad10fbf16da0 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:44.632396 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231da3d7-ae71-4352-b9a5-065b0ff15140 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:44.709674 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:44.748828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231da3d7-ae71-4352-b9a5-065b0ff15140 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:44.786090 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82aa28f-4402-4faa-9fe5-3d67cd7c057d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:44.787003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82aa28f-4402-4faa-9fe5-3d67cd7c057d None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:44.787279 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82aa28f-4402-4faa-9fe5-3d67cd7c057d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:44.787551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82aa28f-4402-4faa-9fe5-3d67cd7c057d None admin] PATH_INFO: `/v3/projects/73107e7bc96441d2a649ad10fbf16da0/users/2663895abc5f4718b29b35963180bc27/roles/e9dc595c6b4248d3b5262b70a90e76c5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:44.789839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82aa28f-4402-4faa-9fe5-3d67cd7c057d None admin] RBAC: Authorizing `identity:create_grant(project_id=73107e7bc96441d2a649ad10fbf16da0, user_id=2663895abc5f4718b29b35963180bc27, role_id=e9dc595c6b4248d3b5262b70a90e76c5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:44.791304 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82aa28f-4402-4faa-9fe5-3d67cd7c057d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:44.807173 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 545/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:53:44 2022] PUT /identity/v3/projects/73107e7bc96441d2a649ad10fbf16da0/users/2663895abc5f4718b29b35963180bc27/roles/e9dc595c6b4248d3b5262b70a90e76c5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:53:46.779671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fc2d3-089f-45ae-9656-fcfdc54d4caf None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:46.780568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fc2d3-089f-45ae-9656-fcfdc54d4caf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:46.780568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fc2d3-089f-45ae-9656-fcfdc54d4caf None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:46.782731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 579/1124] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:46.789248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e030d97-7591-4f46-aee2-8e8c8327f68e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:46.789966 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e030d97-7591-4f46-aee2-8e8c8327f68e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:46.790121 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e030d97-7591-4f46-aee2-8e8c8327f68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:46.811399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6e030d97-7591-4f46-aee2-8e8c8327f68e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:46.812619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6e030d97-7591-4f46-aee2-8e8c8327f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:46.883667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 546/1125] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:46.916944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fc2d3-089f-45ae-9656-fcfdc54d4caf None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:47.031276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fc2d3-089f-45ae-9656-fcfdc54d4caf None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:47.040692 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:47.070110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f216c-6983-4171-9753-e972ec344eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:47.070975 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f216c-6983-4171-9753-e972ec344eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:47.071252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f216c-6983-4171-9753-e972ec344eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:47.071536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f216c-6983-4171-9753-e972ec344eb2 None admin] PATH_INFO: `/v3/roles/e9dc595c6b4248d3b5262b70a90e76c5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:47.073092 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f216c-6983-4171-9753-e972ec344eb2 None admin] RBAC: Authorizing `identity:get_role(role_id=e9dc595c6b4248d3b5262b70a90e76c5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:47.074515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f216c-6983-4171-9753-e972ec344eb2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:47.075991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 580/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:53:46 2022] GET /identity/v3/roles/e9dc595c6b4248d3b5262b70a90e76c5 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:47.082773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e030d97-7591-4f46-aee2-8e8c8327f68e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:47.158983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:47.195523 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e030d97-7591-4f46-aee2-8e8c8327f68e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:47.231157 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036be65-7661-4859-8e5a-c201b96e607a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:47.232018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036be65-7661-4859-8e5a-c201b96e607a None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:47.232301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036be65-7661-4859-8e5a-c201b96e607a None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:47.232550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036be65-7661-4859-8e5a-c201b96e607a None admin] PATH_INFO: `/v3/users/2663895abc5f4718b29b35963180bc27` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:47.233757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036be65-7661-4859-8e5a-c201b96e607a None admin] RBAC: Authorizing `identity:get_user(user_id=2663895abc5f4718b29b35963180bc27)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:47.235241 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036be65-7661-4859-8e5a-c201b96e607a None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:47.236940 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 547/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:53:47 2022] GET /identity/v3/users/2663895abc5f4718b29b35963180bc27 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:47.244867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f216c-6983-4171-9753-e972ec344eb2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:47.347580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f216c-6983-4171-9753-e972ec344eb2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:47.382806 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4dde4-7e6f-4d00-b1c1-83244281bd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:47.383767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4dde4-7e6f-4d00-b1c1-83244281bd46 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:47.384200 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4dde4-7e6f-4d00-b1c1-83244281bd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:47.384568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4dde4-7e6f-4d00-b1c1-83244281bd46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:47.433451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:47.460274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4dde4-7e6f-4d00-b1c1-83244281bd46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:47.461730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4dde4-7e6f-4d00-b1c1-83244281bd46 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:47.560003 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 581/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:53:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:53:47.569060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036be65-7661-4859-8e5a-c201b96e607a None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:47.679821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036be65-7661-4859-8e5a-c201b96e607a None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:47.724469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98548ae8-cafa-43c5-83c2-947bae8a3b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:47.725326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98548ae8-cafa-43c5-83c2-947bae8a3b5b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:47.725603 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98548ae8-cafa-43c5-83c2-947bae8a3b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:47.725877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98548ae8-cafa-43c5-83c2-947bae8a3b5b None admin] PATH_INFO: `/v3/projects/73107e7bc96441d2a649ad10fbf16da0` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:47.727176 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98548ae8-cafa-43c5-83c2-947bae8a3b5b None admin] RBAC: Authorizing `identity:get_project(project_id=73107e7bc96441d2a649ad10fbf16da0)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:47.728614 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98548ae8-cafa-43c5-83c2-947bae8a3b5b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:47.730266 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 548/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:53:47 2022] GET /identity/v3/projects/73107e7bc96441d2a649ad10fbf16da0 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:47.736908 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4dde4-7e6f-4d00-b1c1-83244281bd46 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:47.816919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:47.854302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4dde4-7e6f-4d00-b1c1-83244281bd46 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:47.892859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a427efa7-8299-412f-8873-858dc8cd91ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:47.893511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427efa7-8299-412f-8873-858dc8cd91ce None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:47.893793 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427efa7-8299-412f-8873-858dc8cd91ce None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:47.894069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a427efa7-8299-412f-8873-858dc8cd91ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:47.894925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427efa7-8299-412f-8873-858dc8cd91ce None admin] RBAC: Adding query filter params (role.id=e9dc595c6b4248d3b5262b70a90e76c5, scope.project.id=73107e7bc96441d2a649ad10fbf16da0, user.id=2663895abc5f4718b29b35963180bc27) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:47.895240 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427efa7-8299-412f-8873-858dc8cd91ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:47.896657 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a427efa7-8299-412f-8873-858dc8cd91ce None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:47.903159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 582/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:53:47 2022] GET /identity/v3/role_assignments?user.id=2663895abc5f4718b29b35963180bc27&scope.project.id=73107e7bc96441d2a649ad10fbf16da0&role.id=e9dc595c6b4248d3b5262b70a90e76c5 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:49.952648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93781d95-c271-4206-8fc2-a6b37d27f0eb None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:49.953285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93781d95-c271-4206-8fc2-a6b37d27f0eb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:49.953285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93781d95-c271-4206-8fc2-a6b37d27f0eb None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:49.954562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 549/1131] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:49.959941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eaed2-714b-4c41-8986-e504c0ee7b09 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:49.960383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eaed2-714b-4c41-8986-e504c0ee7b09 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:49.960481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43eaed2-714b-4c41-8986-e504c0ee7b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:49.978996 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a43eaed2-714b-4c41-8986-e504c0ee7b09 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:49.980232 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a43eaed2-714b-4c41-8986-e504c0ee7b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:50.053950 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 583/1132] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:50.077823 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93781d95-c271-4206-8fc2-a6b37d27f0eb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:50.082093 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:50.193889 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93781d95-c271-4206-8fc2-a6b37d27f0eb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:50.229483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba3467-3350-41eb-8ce4-e8cf5f7c9392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:50.230198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba3467-3350-41eb-8ce4-e8cf5f7c9392 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:50.230474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba3467-3350-41eb-8ce4-e8cf5f7c9392 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:50.230747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba3467-3350-41eb-8ce4-e8cf5f7c9392 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:50.231996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba3467-3350-41eb-8ce4-e8cf5f7c9392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:50.233425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba3467-3350-41eb-8ce4-e8cf5f7c9392 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:50.235171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 550/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:50.243267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43eaed2-714b-4c41-8986-e504c0ee7b09 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:50.324244 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:50.358611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43eaed2-714b-4c41-8986-e504c0ee7b09 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:50.394750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96ae34-8f7f-4a2c-b649-08fe895d626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:50.395604 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96ae34-8f7f-4a2c-b649-08fe895d626c None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:50.395891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96ae34-8f7f-4a2c-b649-08fe895d626c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:50.396169 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96ae34-8f7f-4a2c-b649-08fe895d626c None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:50.396909 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96ae34-8f7f-4a2c-b649-08fe895d626c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:50.399245 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96ae34-8f7f-4a2c-b649-08fe895d626c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:50.430405 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 584/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 15:53:50 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:53:52.494003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4693f-5ede-4820-8f53-5a722ef5b6ae None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:52.494533 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4693f-5ede-4820-8f53-5a722ef5b6ae None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:52.494533 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4693f-5ede-4820-8f53-5a722ef5b6ae None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:52.496584 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 551/1135] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:52.503108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5731012-ee7b-4309-b927-165279c28143 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:52.503592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5731012-ee7b-4309-b927-165279c28143 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:52.503699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5731012-ee7b-4309-b927-165279c28143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:52.527822 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a5731012-ee7b-4309-b927-165279c28143 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:52.529098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a5731012-ee7b-4309-b927-165279c28143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:52.607175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 585/1136] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:52.632397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4693f-5ede-4820-8f53-5a722ef5b6ae None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:52.709134 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:52.743263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4693f-5ede-4820-8f53-5a722ef5b6ae None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:52.790619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e841b54c-75f2-4d17-9b5e-f677b8d6c0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:52.791358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841b54c-75f2-4d17-9b5e-f677b8d6c0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:52.791642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841b54c-75f2-4d17-9b5e-f677b8d6c0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:52.791915 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841b54c-75f2-4d17-9b5e-f677b8d6c0f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:52.793216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841b54c-75f2-4d17-9b5e-f677b8d6c0f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:52.794659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e841b54c-75f2-4d17-9b5e-f677b8d6c0f2 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:52.796291 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 552/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:53:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:52.803044 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5731012-ee7b-4309-b927-165279c28143 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:52.865605 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:52.914079 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5731012-ee7b-4309-b927-165279c28143 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:52.949018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f87737-c3f2-4992-8c86-84fa80716d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:52.949680 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f87737-c3f2-4992-8c86-84fa80716d34 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:52.949959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f87737-c3f2-4992-8c86-84fa80716d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:52.950233 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f87737-c3f2-4992-8c86-84fa80716d34 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:52.950981 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f87737-c3f2-4992-8c86-84fa80716d34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:52.952408 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f87737-c3f2-4992-8c86-84fa80716d34 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:52.972344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 586/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:53:52 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 15:53:55.079682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4cf59-78ca-47ee-a538-35ac329e6a63 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:55.080336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4cf59-78ca-47ee-a538-35ac329e6a63 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:55.080336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4cf59-78ca-47ee-a538-35ac329e6a63 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:55.081649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 553/1139] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:55.086986 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68608cda-1492-4c8e-b8d2-ab0b52a60546 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:55.087462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68608cda-1492-4c8e-b8d2-ab0b52a60546 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:55.087557 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68608cda-1492-4c8e-b8d2-ab0b52a60546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:55.104407 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-68608cda-1492-4c8e-b8d2-ab0b52a60546 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:55.105611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-68608cda-1492-4c8e-b8d2-ab0b52a60546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:55.173215 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 587/1140] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:55.196672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4cf59-78ca-47ee-a538-35ac329e6a63 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:55.300702 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4cf59-78ca-47ee-a538-35ac329e6a63 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:55.334130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d3e4f-3a36-463a-a2ff-e743b12eb8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:55.334867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d3e4f-3a36-463a-a2ff-e743b12eb8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:55.335149 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d3e4f-3a36-463a-a2ff-e743b12eb8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:55.335424 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d3e4f-3a36-463a-a2ff-e743b12eb8a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:55.343238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:55.346533 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d3e4f-3a36-463a-a2ff-e743b12eb8a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-4c1d3e4f-3a36-463a-a2ff-e743b12eb8a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:53:55.354506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:55.355766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:55.356711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:55.356711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:55.356711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:55.356711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:55.356711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:53:55.356711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:53:55.356711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:53:55.356711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:53:55.356711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:53:55.356711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:53:55.356711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:53:55.356711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:55.356711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 554/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:53:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:55.362028 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68608cda-1492-4c8e-b8d2-ab0b52a60546 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:55.407120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:55.467268 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68608cda-1492-4c8e-b8d2-ab0b52a60546 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:55.500655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a472569-8d3a-4745-8ea6-8eb2a134e86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:55.501327 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a472569-8d3a-4745-8ea6-8eb2a134e86c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:55.501640 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a472569-8d3a-4745-8ea6-8eb2a134e86c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:55.501916 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a472569-8d3a-4745-8ea6-8eb2a134e86c None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:55.502671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a472569-8d3a-4745-8ea6-8eb2a134e86c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:55.503008 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a472569-8d3a-4745-8ea6-8eb2a134e86c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:55.504383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a472569-8d3a-4745-8ea6-8eb2a134e86c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:55.512294 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 588/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:53:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:55.518795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d3e4f-3a36-463a-a2ff-e743b12eb8a1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:55.616668 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d3e4f-3a36-463a-a2ff-e743b12eb8a1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:55.650938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e20c1-42d3-413f-a94c-08dc78a99180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:55.651823 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e20c1-42d3-413f-a94c-08dc78a99180 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:55.652099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e20c1-42d3-413f-a94c-08dc78a99180 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:55.652368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e20c1-42d3-413f-a94c-08dc78a99180 None admin] PATH_INFO: `/v3/users/b0ced215c9194bd2bafecab971c793c6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:55.666585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e20c1-42d3-413f-a94c-08dc78a99180 None admin] RBAC: Authorizing `identity:get_user(user_id=b0ced215c9194bd2bafecab971c793c6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:55.668108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e20c1-42d3-413f-a94c-08dc78a99180 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:55.669938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 555/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:53:55 2022] GET /identity/v3/users/b0ced215c9194bd2bafecab971c793c6 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:55.677241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a472569-8d3a-4745-8ea6-8eb2a134e86c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:55.778741 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:55.782692 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a472569-8d3a-4745-8ea6-8eb2a134e86c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:55.820141 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5958393-6cf6-4cfb-b46d-f934d4b7fdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:55.820845 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5958393-6cf6-4cfb-b46d-f934d4b7fdbe None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:55.821142 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5958393-6cf6-4cfb-b46d-f934d4b7fdbe None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:55.821412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5958393-6cf6-4cfb-b46d-f934d4b7fdbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:55.894684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5958393-6cf6-4cfb-b46d-f934d4b7fdbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:55.896215 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5958393-6cf6-4cfb-b46d-f934d4b7fdbe None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:56.000840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:56.005399 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 589/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:53:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 15:53:56.014154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e20c1-42d3-413f-a94c-08dc78a99180 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:56.082307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:56.135985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e20c1-42d3-413f-a94c-08dc78a99180 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:56.187232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217be3b-4bbd-43d5-b514-5f6e7ac71fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:56.188489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217be3b-4bbd-43d5-b514-5f6e7ac71fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:56.188834 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217be3b-4bbd-43d5-b514-5f6e7ac71fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:56.189242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217be3b-4bbd-43d5-b514-5f6e7ac71fe4 None admin] PATH_INFO: `/v3/projects/5c45f87f06e948ed9e72d3f900399347` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:56.190778 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217be3b-4bbd-43d5-b514-5f6e7ac71fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=5c45f87f06e948ed9e72d3f900399347)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:56.192358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217be3b-4bbd-43d5-b514-5f6e7ac71fe4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:56.194273 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 556/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:53:56 2022] GET /identity/v3/projects/5c45f87f06e948ed9e72d3f900399347 => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:56.202494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5958393-6cf6-4cfb-b46d-f934d4b7fdbe None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:56.307856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5958393-6cf6-4cfb-b46d-f934d4b7fdbe None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:56.344018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bb371-e77d-4f46-aa6a-ecba649ff730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:56.344701 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bb371-e77d-4f46-aa6a-ecba649ff730 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:56.344982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bb371-e77d-4f46-aa6a-ecba649ff730 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:56.345255 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bb371-e77d-4f46-aa6a-ecba649ff730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:56.346103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bb371-e77d-4f46-aa6a-ecba649ff730 None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=5c45f87f06e948ed9e72d3f900399347, user.id=b0ced215c9194bd2bafecab971c793c6) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:56.346411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bb371-e77d-4f46-aa6a-ecba649ff730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:56.348029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bb371-e77d-4f46-aa6a-ecba649ff730 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:56.354396 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 590/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:53:56 2022] GET /identity/v3/role_assignments?user.id=b0ced215c9194bd2bafecab971c793c6&scope.project.id=5c45f87f06e948ed9e72d3f900399347&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:58.389701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a6033-a78b-4064-a7a0-668855a9e3bb None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:58.390292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a6033-a78b-4064-a7a0-668855a9e3bb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:58.390292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a6033-a78b-4064-a7a0-668855a9e3bb None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:58.391649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 557/1147] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:53:58.396953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978c390-9fc5-4aaa-bc53-dbebc3a17a5b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:58.397429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978c390-9fc5-4aaa-bc53-dbebc3a17a5b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:58.397522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978c390-9fc5-4aaa-bc53-dbebc3a17a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:58.414650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6978c390-9fc5-4aaa-bc53-dbebc3a17a5b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:53:58.415908 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6978c390-9fc5-4aaa-bc53-dbebc3a17a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:53:58.476924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:58.487435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 591/1148] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:53:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:53:58.512296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a6033-a78b-4064-a7a0-668855a9e3bb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:58.625186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a6033-a78b-4064-a7a0-668855a9e3bb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:58.654937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:58.665859 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de57e8-2694-4f8f-aea9-4f5eaf5ae490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:58.666661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de57e8-2694-4f8f-aea9-4f5eaf5ae490 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:58.666982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de57e8-2694-4f8f-aea9-4f5eaf5ae490 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:58.667261 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de57e8-2694-4f8f-aea9-4f5eaf5ae490 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:58.679316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de57e8-2694-4f8f-aea9-4f5eaf5ae490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-70de57e8-2694-4f8f-aea9-4f5eaf5ae490 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:53:58.686854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:53:58.687917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:53:58.689105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:53:58.689105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:53:58.689105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:53:58.689105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:53:58.689105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:53:58.689105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:53:58.689105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:53:58.689105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:53:58.689105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:53:58.689105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:53:58.689105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:53:58.689105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:53:58.689105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 558/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:53:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:53:58.696861 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978c390-9fc5-4aaa-bc53-dbebc3a17a5b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:58.806608 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978c390-9fc5-4aaa-bc53-dbebc3a17a5b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:58.848890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adaeeae-4231-404c-8576-1126b7884c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:58.849580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adaeeae-4231-404c-8576-1126b7884c28 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:58.849861 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adaeeae-4231-404c-8576-1126b7884c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:58.850138 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adaeeae-4231-404c-8576-1126b7884c28 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:58.850919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adaeeae-4231-404c-8576-1126b7884c28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:53:58.851222 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adaeeae-4231-404c-8576-1126b7884c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:58.852639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adaeeae-4231-404c-8576-1126b7884c28 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:58.861073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 592/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:53:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:58.867806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de57e8-2694-4f8f-aea9-4f5eaf5ae490 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:58.983091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de57e8-2694-4f8f-aea9-4f5eaf5ae490 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:59.015896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3998b8-2c84-46ed-b4a1-f63fddf44522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:59.016771 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3998b8-2c84-46ed-b4a1-f63fddf44522 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:59.017055 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3998b8-2c84-46ed-b4a1-f63fddf44522 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:59.017329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3998b8-2c84-46ed-b4a1-f63fddf44522 None admin] PATH_INFO: `/v3/users/b0ced215c9194bd2bafecab971c793c6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:59.018571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3998b8-2c84-46ed-b4a1-f63fddf44522 None admin] RBAC: Authorizing `identity:get_user(user_id=b0ced215c9194bd2bafecab971c793c6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:59.020046 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3998b8-2c84-46ed-b4a1-f63fddf44522 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:59.021675 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 559/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:53:58 2022] GET /identity/v3/users/b0ced215c9194bd2bafecab971c793c6 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:59.028217 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adaeeae-4231-404c-8576-1126b7884c28 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:59.088780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:59.135872 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adaeeae-4231-404c-8576-1126b7884c28 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:59.173469 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bed69-de7e-4e0b-91a9-d58b6a865bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:59.174351 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bed69-de7e-4e0b-91a9-d58b6a865bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:59.174635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bed69-de7e-4e0b-91a9-d58b6a865bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:59.175051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bed69-de7e-4e0b-91a9-d58b6a865bd1 None admin] PATH_INFO: `/v3/projects/5c45f87f06e948ed9e72d3f900399347` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:59.176325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bed69-de7e-4e0b-91a9-d58b6a865bd1 None admin] RBAC: Authorizing `identity:get_project(project_id=5c45f87f06e948ed9e72d3f900399347)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:59.177775 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bed69-de7e-4e0b-91a9-d58b6a865bd1 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:59.179536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 593/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:53:59 2022] GET /identity/v3/projects/5c45f87f06e948ed9e72d3f900399347 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:53:59.185891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3998b8-2c84-46ed-b4a1-f63fddf44522 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:53:59.253779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:53:59.300308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3998b8-2c84-46ed-b4a1-f63fddf44522 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:53:59.342309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94f8734-43cc-44fa-98d0-87023670788b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:53:59.343175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f8734-43cc-44fa-98d0-87023670788b None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:53:59.343459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f8734-43cc-44fa-98d0-87023670788b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:53:59.343736 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94f8734-43cc-44fa-98d0-87023670788b None admin] PATH_INFO: `/v3/projects/5c45f87f06e948ed9e72d3f900399347/users/b0ced215c9194bd2bafecab971c793c6/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:53:59.345718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f8734-43cc-44fa-98d0-87023670788b None admin] RBAC: Authorizing `identity:create_grant(project_id=5c45f87f06e948ed9e72d3f900399347, user_id=b0ced215c9194bd2bafecab971c793c6, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:53:59.347220 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94f8734-43cc-44fa-98d0-87023670788b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:53:59.361430 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 560/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:53:59 2022] PUT /identity/v3/projects/5c45f87f06e948ed9e72d3f900399347/users/b0ced215c9194bd2bafecab971c793c6/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:54:01.477139 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab3558-ca82-41d5-be2b-be9ad3b2fa73 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:01.477686 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab3558-ca82-41d5-be2b-be9ad3b2fa73 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:01.477686 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ab3558-ca82-41d5-be2b-be9ad3b2fa73 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:01.479026 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 594/1154] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:54:01.484295 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9fb56-806e-49e8-afee-59c0b42bfba3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:01.484729 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9fb56-806e-49e8-afee-59c0b42bfba3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:01.484821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b9fb56-806e-49e8-afee-59c0b42bfba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:01.502512 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-02b9fb56-806e-49e8-afee-59c0b42bfba3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:54:01.503764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-02b9fb56-806e-49e8-afee-59c0b42bfba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:54:01.571082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 561/1155] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:54:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:54:01.594492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab3558-ca82-41d5-be2b-be9ad3b2fa73 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:01.704737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ab3558-ca82-41d5-be2b-be9ad3b2fa73 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:01.727904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:01.739353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d06e94-ab3d-46f1-a9fd-c2c9cefb639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:01.740158 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d06e94-ab3d-46f1-a9fd-c2c9cefb639a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:01.740491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d06e94-ab3d-46f1-a9fd-c2c9cefb639a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:01.740765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d06e94-ab3d-46f1-a9fd-c2c9cefb639a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:01.751157 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d06e94-ab3d-46f1-a9fd-c2c9cefb639a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e4d06e94-ab3d-46f1-a9fd-c2c9cefb639a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:54:01.758667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:54:01.759684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:54:01.760544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:54:01.760544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:54:01.760544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:54:01.760544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:54:01.760544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:54:01.760544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:54:01.760544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:54:01.760544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:54:01.760544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:54:01.760544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:54:01.760544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:54:01.760544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:54:01.760544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 595/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:54:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:54:01.766795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9fb56-806e-49e8-afee-59c0b42bfba3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:01.816015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:01.874721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b9fb56-806e-49e8-afee-59c0b42bfba3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:01.909419 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32815d80-b14d-4a50-84fa-7cb9cb588784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:01.910094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32815d80-b14d-4a50-84fa-7cb9cb588784 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:01.910376 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32815d80-b14d-4a50-84fa-7cb9cb588784 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:01.910649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32815d80-b14d-4a50-84fa-7cb9cb588784 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:01.911435 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32815d80-b14d-4a50-84fa-7cb9cb588784 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:54:01.911741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32815d80-b14d-4a50-84fa-7cb9cb588784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:01.913134 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32815d80-b14d-4a50-84fa-7cb9cb588784 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:01.921242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 562/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:54:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:54:01.927489 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d06e94-ab3d-46f1-a9fd-c2c9cefb639a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:02.028686 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d06e94-ab3d-46f1-a9fd-c2c9cefb639a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:02.063244 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b46ae-f341-4e9b-aba6-950740a6461b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:02.064116 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b46ae-f341-4e9b-aba6-950740a6461b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:02.064394 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b46ae-f341-4e9b-aba6-950740a6461b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:02.064662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b46ae-f341-4e9b-aba6-950740a6461b None admin] PATH_INFO: `/v3/users/b0ced215c9194bd2bafecab971c793c6` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:02.065953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b46ae-f341-4e9b-aba6-950740a6461b None admin] RBAC: Authorizing `identity:get_user(user_id=b0ced215c9194bd2bafecab971c793c6)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:02.067437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b46ae-f341-4e9b-aba6-950740a6461b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:02.069061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 596/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:54:01 2022] GET /identity/v3/users/b0ced215c9194bd2bafecab971c793c6 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:54:02.075207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32815d80-b14d-4a50-84fa-7cb9cb588784 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:02.180581 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32815d80-b14d-4a50-84fa-7cb9cb588784 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:02.187935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:02.217472 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e60c50-8f78-449b-a17f-3fbd58e25c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:02.218132 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e60c50-8f78-449b-a17f-3fbd58e25c2e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:02.218411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e60c50-8f78-449b-a17f-3fbd58e25c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:02.218688 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e60c50-8f78-449b-a17f-3fbd58e25c2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:02.287578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e60c50-8f78-449b-a17f-3fbd58e25c2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:02.288945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e60c50-8f78-449b-a17f-3fbd58e25c2e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:02.396789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 563/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:54:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:54:02.403079 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b46ae-f341-4e9b-aba6-950740a6461b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:02.458842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:02.507583 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b46ae-f341-4e9b-aba6-950740a6461b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:02.543256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d521983-bfbd-4f38-b57c-80ac755d6434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:02.544077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d521983-bfbd-4f38-b57c-80ac755d6434 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:02.544395 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d521983-bfbd-4f38-b57c-80ac755d6434 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:02.544707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d521983-bfbd-4f38-b57c-80ac755d6434 None admin] PATH_INFO: `/v3/projects/5c45f87f06e948ed9e72d3f900399347` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:02.545976 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d521983-bfbd-4f38-b57c-80ac755d6434 None admin] RBAC: Authorizing `identity:get_project(project_id=5c45f87f06e948ed9e72d3f900399347)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:02.547458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d521983-bfbd-4f38-b57c-80ac755d6434 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:02.549156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 597/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:54:02 2022] GET /identity/v3/projects/5c45f87f06e948ed9e72d3f900399347 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:54:02.555559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e60c50-8f78-449b-a17f-3fbd58e25c2e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:02.563982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:02.654011 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e60c50-8f78-449b-a17f-3fbd58e25c2e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:02.687566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f0261-ff37-408d-8041-6a68888dc720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:02.688256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f0261-ff37-408d-8041-6a68888dc720 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:02.688536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f0261-ff37-408d-8041-6a68888dc720 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:02.688810 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f0261-ff37-408d-8041-6a68888dc720 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:02.689665 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f0261-ff37-408d-8041-6a68888dc720 None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=5c45f87f06e948ed9e72d3f900399347, user.id=b0ced215c9194bd2bafecab971c793c6) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:54:02.689978 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f0261-ff37-408d-8041-6a68888dc720 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:02.691513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f0261-ff37-408d-8041-6a68888dc720 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:02.697225 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 564/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:54:02 2022] GET /identity/v3/role_assignments?user.id=b0ced215c9194bd2bafecab971c793c6&scope.project.id=5c45f87f06e948ed9e72d3f900399347&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:54:04.748509 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac7fae-8199-4937-a747-04c5b55b3ae3 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:04.749081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac7fae-8199-4937-a747-04c5b55b3ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:04.749081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac7fae-8199-4937-a747-04c5b55b3ae3 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:04.750448 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 598/1162] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:54:04.756233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0383a-4909-4827-a78d-d13a8646487f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:04.756654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0383a-4909-4827-a78d-d13a8646487f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:04.756773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0383a-4909-4827-a78d-d13a8646487f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:04.775493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-efa0383a-4909-4827-a78d-d13a8646487f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:54:04.776710 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-efa0383a-4909-4827-a78d-d13a8646487f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:54:04.843917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:04.849303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 565/1163] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:54:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:54:04.873065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac7fae-8199-4937-a747-04c5b55b3ae3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:04.976002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac7fae-8199-4937-a747-04c5b55b3ae3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:04.996507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:05.015724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4e43a-6d9e-4276-8cd8-8bcf5e09d63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:05.016533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4e43a-6d9e-4276-8cd8-8bcf5e09d63d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:05.016917 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4e43a-6d9e-4276-8cd8-8bcf5e09d63d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:05.017303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4e43a-6d9e-4276-8cd8-8bcf5e09d63d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:05.089587 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4e43a-6d9e-4276-8cd8-8bcf5e09d63d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:05.091084 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4e43a-6d9e-4276-8cd8-8bcf5e09d63d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:05.193320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 599/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:54:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:54:05.199557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0383a-4909-4827-a78d-d13a8646487f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:05.302090 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0383a-4909-4827-a78d-d13a8646487f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:05.339449 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63eff54-fcfe-4271-9c4e-f02f92ec4888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:05.340278 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63eff54-fcfe-4271-9c4e-f02f92ec4888 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:05.340562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63eff54-fcfe-4271-9c4e-f02f92ec4888 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:05.340842 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63eff54-fcfe-4271-9c4e-f02f92ec4888 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:05.348293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63eff54-fcfe-4271-9c4e-f02f92ec4888 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:05.349768 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63eff54-fcfe-4271-9c4e-f02f92ec4888 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f63eff54-fcfe-4271-9c4e-f02f92ec4888 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:54:05.365174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:54:05.366359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:54:05.367505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:54:05.367505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:54:05.367505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:54:05.367505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:54:05.367505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:54:05.367505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:54:05.367505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:54:05.367505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:54:05.367505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:54:05.367505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:54:05.367505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 15:54:05.367505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:54:05.367505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 15:54:05.367505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:54:05.367505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 566/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 15:54:05 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:54:05.373066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4e43a-6d9e-4276-8cd8-8bcf5e09d63d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:05.395376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:05.478164 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4e43a-6d9e-4276-8cd8-8bcf5e09d63d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:05.515490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9eaaf4-b3b8-4da6-a1b1-c1395b99ceea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:05.516153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eaaf4-b3b8-4da6-a1b1-c1395b99ceea None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:05.516435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eaaf4-b3b8-4da6-a1b1-c1395b99ceea None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:05.516708 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eaaf4-b3b8-4da6-a1b1-c1395b99ceea None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:05.517436 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9eaaf4-b3b8-4da6-a1b1-c1395b99ceea None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:54:05.517740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9eaaf4-b3b8-4da6-a1b1-c1395b99ceea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:05.519223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9eaaf4-b3b8-4da6-a1b1-c1395b99ceea None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:05.526773 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 600/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Jul 21 15:54:05 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:54:07.599252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0f2c1-f56d-41a7-bc18-4f96503b6c55 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:07.599834 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0f2c1-f56d-41a7-bc18-4f96503b6c55 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:07.599834 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c0f2c1-f56d-41a7-bc18-4f96503b6c55 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:07.601101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 567/1167] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:54:07.608324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ee6a-ae8b-412e-9b5a-fe97df438bc8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:07.608774 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ee6a-ae8b-412e-9b5a-fe97df438bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:07.608896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ee6a-ae8b-412e-9b5a-fe97df438bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:07.627666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-df98ee6a-ae8b-412e-9b5a-fe97df438bc8 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:54:07.628936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-df98ee6a-ae8b-412e-9b5a-fe97df438bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:54:07.702980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 601/1168] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:54:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:54:07.726234 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0f2c1-f56d-41a7-bc18-4f96503b6c55 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:07.790554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:07.833836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c0f2c1-f56d-41a7-bc18-4f96503b6c55 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:07.878093 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e936b-eecb-4fb4-ad23-8cc822690e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:07.878684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e936b-eecb-4fb4-ad23-8cc822690e48 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:07.879000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e936b-eecb-4fb4-ad23-8cc822690e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:07.879272 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e936b-eecb-4fb4-ad23-8cc822690e48 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:07.880014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e936b-eecb-4fb4-ad23-8cc822690e48 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:07.881392 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e936b-eecb-4fb4-ad23-8cc822690e48 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:07.897241 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 568/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Thu Jul 21 15:54:07 2022] POST /identity/v3/domains => generated 267 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:54:10.062938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d8bf6-2275-4897-834d-985ad69acb16 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:10.063504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d8bf6-2275-4897-834d-985ad69acb16 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:10.063504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16d8bf6-2275-4897-834d-985ad69acb16 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:10.064863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 602/1170] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:54:10.071961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04ac52-ab46-4d51-a98f-86b0a5400ee5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:10.072772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04ac52-ab46-4d51-a98f-86b0a5400ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:10.072872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04ac52-ab46-4d51-a98f-86b0a5400ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:10.098715 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0b04ac52-ab46-4d51-a98f-86b0a5400ee5 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:54:10.099947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0b04ac52-ab46-4d51-a98f-86b0a5400ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:54:10.180069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 569/1171] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:54:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:54:10.203548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d8bf6-2275-4897-834d-985ad69acb16 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:10.220999 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:10.325047 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16d8bf6-2275-4897-834d-985ad69acb16 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:10.359601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84f7be5-733b-420f-8a6c-ad7a14c57ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:10.360463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f7be5-733b-420f-8a6c-ad7a14c57ccc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:10.360737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f7be5-733b-420f-8a6c-ad7a14c57ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:10.361003 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f7be5-733b-420f-8a6c-ad7a14c57ccc None admin] PATH_INFO: `/v3/domains/2d392336dc684969a2a0387c64b51f19` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:10.372333 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f7be5-733b-420f-8a6c-ad7a14c57ccc None admin] RBAC: Authorizing `identity:get_domain(domain_id=2d392336dc684969a2a0387c64b51f19)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:10.373778 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84f7be5-733b-420f-8a6c-ad7a14c57ccc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:10.375425 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 603/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Thu Jul 21 15:54:10 2022] GET /identity/v3/domains/2d392336dc684969a2a0387c64b51f19 => generated 267 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:54:10.382523 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04ac52-ab46-4d51-a98f-86b0a5400ee5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:10.450838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:10.516185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04ac52-ab46-4d51-a98f-86b0a5400ee5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:10.553816 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87d0e3-65b4-4cd7-9dd2-41f9300f8e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:10.554478 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87d0e3-65b4-4cd7-9dd2-41f9300f8e8e None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:10.554760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87d0e3-65b4-4cd7-9dd2-41f9300f8e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:10.555068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87d0e3-65b4-4cd7-9dd2-41f9300f8e8e None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:10.555779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87d0e3-65b4-4cd7-9dd2-41f9300f8e8e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:10.557236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87d0e3-65b4-4cd7-9dd2-41f9300f8e8e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:10.584824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 570/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 15:54:10 2022] POST /identity/v3/projects => generated 361 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:54:12.667862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f2cd3-8dff-4792-be8a-097d7a273fda None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:12.668497 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f2cd3-8dff-4792-be8a-097d7a273fda None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:12.668497 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f2cd3-8dff-4792-be8a-097d7a273fda None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:12.669839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 604/1174] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:54:12.675372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1035-6c7c-4339-a91a-87a5e895736e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:12.675955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1035-6c7c-4339-a91a-87a5e895736e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:12.675955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1035-6c7c-4339-a91a-87a5e895736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:12.694521 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-217f1035-6c7c-4339-a91a-87a5e895736e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:54:12.695749 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-217f1035-6c7c-4339-a91a-87a5e895736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:54:12.769396 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 571/1175] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:54:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:54:12.794394 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f2cd3-8dff-4792-be8a-097d7a273fda None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:12.891264 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:12.920833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f2cd3-8dff-4792-be8a-097d7a273fda None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:12.956398 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13384822-71e8-4a3e-9fc9-78c06109d774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:12.957303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13384822-71e8-4a3e-9fc9-78c06109d774 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:12.957629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13384822-71e8-4a3e-9fc9-78c06109d774 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:12.957903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13384822-71e8-4a3e-9fc9-78c06109d774 None admin] PATH_INFO: `/v3/domains/2d392336dc684969a2a0387c64b51f19` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:12.959223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13384822-71e8-4a3e-9fc9-78c06109d774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2d392336dc684969a2a0387c64b51f19)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:12.960658 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13384822-71e8-4a3e-9fc9-78c06109d774 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:12.962280 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 605/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Thu Jul 21 15:54:12 2022] GET /identity/v3/domains/2d392336dc684969a2a0387c64b51f19 => generated 267 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:54:12.968670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f1035-6c7c-4339-a91a-87a5e895736e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:12.999284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:13.081181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f1035-6c7c-4339-a91a-87a5e895736e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:13.123527 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5813d710-5589-41b8-b49e-86429482afe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:13.124205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813d710-5589-41b8-b49e-86429482afe6 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:13.124486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813d710-5589-41b8-b49e-86429482afe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:13.124761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5813d710-5589-41b8-b49e-86429482afe6 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:13.125475 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813d710-5589-41b8-b49e-86429482afe6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:13.126980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5813d710-5589-41b8-b49e-86429482afe6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:13.150337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 572/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:54:12 2022] POST /identity/v3/users => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:54:15.224621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1339e-72d5-4b94-8d08-cb6c944f5549 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:15.225206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1339e-72d5-4b94-8d08-cb6c944f5549 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:15.225206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1339e-72d5-4b94-8d08-cb6c944f5549 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:15.226549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 606/1178] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:54:15.233003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66437b-f53a-43be-826b-e6b832cab86f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:15.233761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66437b-f53a-43be-826b-e6b832cab86f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:15.233909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66437b-f53a-43be-826b-e6b832cab86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:15.254104 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1f66437b-f53a-43be-826b-e6b832cab86f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:54:15.255386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1f66437b-f53a-43be-826b-e6b832cab86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:54:15.332670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 573/1179] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:54:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:54:15.361645 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1339e-72d5-4b94-8d08-cb6c944f5549 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:15.478514 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c1339e-72d5-4b94-8d08-cb6c944f5549 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:15.517757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b523b-3f78-4557-9aaf-9be93264e604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:15.519176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b523b-3f78-4557-9aaf-9be93264e604 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:15.519505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b523b-3f78-4557-9aaf-9be93264e604 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:15.520031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b523b-3f78-4557-9aaf-9be93264e604 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:15.536297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b523b-3f78-4557-9aaf-9be93264e604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-7c7b523b-3f78-4557-9aaf-9be93264e604 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:54:15.544181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:54:15.545414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:54:15.546671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:54:15.546671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:54:15.546671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:54:15.546671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:54:15.546671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:54:15.546671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:54:15.546671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:54:15.546671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:54:15.546671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:54:15.546671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:54:15.546671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:54:15.546671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:54:15.546671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 607/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:54:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:54:15.552213 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66437b-f53a-43be-826b-e6b832cab86f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:15.572621 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:15.676939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66437b-f53a-43be-826b-e6b832cab86f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:15.722433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d9c9a-0458-4a70-b9a3-565bed5a2f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:15.723147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d9c9a-0458-4a70-b9a3-565bed5a2f90 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:15.723434 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d9c9a-0458-4a70-b9a3-565bed5a2f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:15.723680 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13d9c9a-0458-4a70-b9a3-565bed5a2f90 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:15.724459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d9c9a-0458-4a70-b9a3-565bed5a2f90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:54:15.724766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d9c9a-0458-4a70-b9a3-565bed5a2f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:15.726240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13d9c9a-0458-4a70-b9a3-565bed5a2f90 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:15.735120 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 574/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:54:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:54:15.742578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b523b-3f78-4557-9aaf-9be93264e604 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:15.745705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:15.850316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b523b-3f78-4557-9aaf-9be93264e604 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:15.896199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47c4e5-f57c-44b5-94d6-c7092a9e9976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:15.897094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47c4e5-f57c-44b5-94d6-c7092a9e9976 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:15.897373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47c4e5-f57c-44b5-94d6-c7092a9e9976 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:15.897648 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a47c4e5-f57c-44b5-94d6-c7092a9e9976 None admin] PATH_INFO: `/v3/users/0a599c9a250244f6a5597a5961ba5b6e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:15.912724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47c4e5-f57c-44b5-94d6-c7092a9e9976 None admin] RBAC: Authorizing `identity:get_user(user_id=0a599c9a250244f6a5597a5961ba5b6e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:15.914525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a47c4e5-f57c-44b5-94d6-c7092a9e9976 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:15.917492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 608/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:54:15 2022] GET /identity/v3/users/0a599c9a250244f6a5597a5961ba5b6e => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:54:15.923803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d9c9a-0458-4a70-b9a3-565bed5a2f90 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:16.008932 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:16.029262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13d9c9a-0458-4a70-b9a3-565bed5a2f90 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:16.061730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44a5a4-8a8f-41d4-8304-2a60e2a86ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:16.062373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44a5a4-8a8f-41d4-8304-2a60e2a86ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:16.062651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44a5a4-8a8f-41d4-8304-2a60e2a86ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:16.062954 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44a5a4-8a8f-41d4-8304-2a60e2a86ec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:16.137387 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44a5a4-8a8f-41d4-8304-2a60e2a86ec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:16.138851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44a5a4-8a8f-41d4-8304-2a60e2a86ec1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:16.227411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:16.250233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 575/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:54:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:54:16.257044 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47c4e5-f57c-44b5-94d6-c7092a9e9976 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:16.320001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:16.364662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a47c4e5-f57c-44b5-94d6-c7092a9e9976 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:16.404043 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6a78d-32d1-46bb-935b-647d349c805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:16.405325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6a78d-32d1-46bb-935b-647d349c805a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:16.405717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6a78d-32d1-46bb-935b-647d349c805a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:16.405995 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6a78d-32d1-46bb-935b-647d349c805a None admin] PATH_INFO: `/v3/projects/7183a03ddc1c42a1936553d733e1a2af` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:16.407223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6a78d-32d1-46bb-935b-647d349c805a None admin] RBAC: Authorizing `identity:get_project(project_id=7183a03ddc1c42a1936553d733e1a2af)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:16.408668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6a78d-32d1-46bb-935b-647d349c805a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:16.410492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 609/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:54:16 2022] GET /identity/v3/projects/7183a03ddc1c42a1936553d733e1a2af => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:54:16.417161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44a5a4-8a8f-41d4-8304-2a60e2a86ec1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:16.525767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44a5a4-8a8f-41d4-8304-2a60e2a86ec1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:16.565670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95124c-3dfc-4742-a946-404905ce6fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:16.566356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95124c-3dfc-4742-a946-404905ce6fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:16.566629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95124c-3dfc-4742-a946-404905ce6fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:16.566921 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95124c-3dfc-4742-a946-404905ce6fb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:16.567787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95124c-3dfc-4742-a946-404905ce6fb6 None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=7183a03ddc1c42a1936553d733e1a2af, user.id=0a599c9a250244f6a5597a5961ba5b6e) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:54:16.568099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95124c-3dfc-4742-a946-404905ce6fb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:16.569970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95124c-3dfc-4742-a946-404905ce6fb6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:16.576448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 576/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:54:16 2022] GET /identity/v3/role_assignments?user.id=0a599c9a250244f6a5597a5961ba5b6e&scope.project.id=7183a03ddc1c42a1936553d733e1a2af&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:54:18.569431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf70d6-507f-4958-8361-0409b5962b40 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:18.569979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf70d6-507f-4958-8361-0409b5962b40 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:18.569979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf70d6-507f-4958-8361-0409b5962b40 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:18.571312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 610/1186] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:54:18.576731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083383a0-122a-48a6-9e6e-f3ca56f81cde None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:18.577174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083383a0-122a-48a6-9e6e-f3ca56f81cde None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:18.577270 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083383a0-122a-48a6-9e6e-f3ca56f81cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:18.594806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-083383a0-122a-48a6-9e6e-f3ca56f81cde None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:54:18.596041 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-083383a0-122a-48a6-9e6e-f3ca56f81cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:54:18.638019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:18.665931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 577/1187] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:54:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:54:18.690611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf70d6-507f-4958-8361-0409b5962b40 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:18.803148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf70d6-507f-4958-8361-0409b5962b40 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:18.830780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:18.839358 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01e002-568a-4528-8cd2-8a4169985e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:18.840162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01e002-568a-4528-8cd2-8a4169985e1c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:18.840446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01e002-568a-4528-8cd2-8a4169985e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:18.840722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01e002-568a-4528-8cd2-8a4169985e1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:18.851465 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01e002-568a-4528-8cd2-8a4169985e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-8d01e002-568a-4528-8cd2-8a4169985e1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:54:18.859108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:54:18.860173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:54:18.861298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:54:18.861298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:54:18.861298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:54:18.861298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:54:18.861298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:54:18.861298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:54:18.861298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:54:18.861298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:54:18.861298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:54:18.861298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:54:18.861298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:54:18.861298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:54:18.861298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 611/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:54:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:54:18.867201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083383a0-122a-48a6-9e6e-f3ca56f81cde None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:18.970488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083383a0-122a-48a6-9e6e-f3ca56f81cde None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:19.007228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7352e-09ad-476c-82bb-57e7c40384a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:19.007895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7352e-09ad-476c-82bb-57e7c40384a7 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:19.008181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7352e-09ad-476c-82bb-57e7c40384a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:19.008462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7352e-09ad-476c-82bb-57e7c40384a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:19.009226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7352e-09ad-476c-82bb-57e7c40384a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:54:19.009536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7352e-09ad-476c-82bb-57e7c40384a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:19.010953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7352e-09ad-476c-82bb-57e7c40384a7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:19.019777 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 578/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:54:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:54:19.026023 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01e002-568a-4528-8cd2-8a4169985e1c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:19.128548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01e002-568a-4528-8cd2-8a4169985e1c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:19.162544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf8a26-26e4-4c97-a1cf-89b5ddc47988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:19.163457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf8a26-26e4-4c97-a1cf-89b5ddc47988 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:19.163748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf8a26-26e4-4c97-a1cf-89b5ddc47988 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:19.164024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abf8a26-26e4-4c97-a1cf-89b5ddc47988 None admin] PATH_INFO: `/v3/users/0a599c9a250244f6a5597a5961ba5b6e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:19.165308 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf8a26-26e4-4c97-a1cf-89b5ddc47988 None admin] RBAC: Authorizing `identity:get_user(user_id=0a599c9a250244f6a5597a5961ba5b6e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:19.166756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abf8a26-26e4-4c97-a1cf-89b5ddc47988 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:19.168434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 612/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:54:19 2022] GET /identity/v3/users/0a599c9a250244f6a5597a5961ba5b6e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:54:19.175585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7352e-09ad-476c-82bb-57e7c40384a7 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:19.217285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:19.287337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7352e-09ad-476c-82bb-57e7c40384a7 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:19.321191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dabef6-e8e6-4a49-a989-15a2d2ad7f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:19.322091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dabef6-e8e6-4a49-a989-15a2d2ad7f04 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:19.322371 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dabef6-e8e6-4a49-a989-15a2d2ad7f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:19.322641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dabef6-e8e6-4a49-a989-15a2d2ad7f04 None admin] PATH_INFO: `/v3/projects/7183a03ddc1c42a1936553d733e1a2af` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:19.323880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dabef6-e8e6-4a49-a989-15a2d2ad7f04 None admin] RBAC: Authorizing `identity:get_project(project_id=7183a03ddc1c42a1936553d733e1a2af)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:19.325312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dabef6-e8e6-4a49-a989-15a2d2ad7f04 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:19.327041 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 579/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:54:19 2022] GET /identity/v3/projects/7183a03ddc1c42a1936553d733e1a2af => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:54:19.333453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf8a26-26e4-4c97-a1cf-89b5ddc47988 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:19.392872 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:19.446346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abf8a26-26e4-4c97-a1cf-89b5ddc47988 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:19.482553 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3352808-6f4f-4434-b179-5dd75b2dad2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:19.483513 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3352808-6f4f-4434-b179-5dd75b2dad2e None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:19.483810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3352808-6f4f-4434-b179-5dd75b2dad2e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:19.484097 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3352808-6f4f-4434-b179-5dd75b2dad2e None admin] PATH_INFO: `/v3/projects/7183a03ddc1c42a1936553d733e1a2af/users/0a599c9a250244f6a5597a5961ba5b6e/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:19.486531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3352808-6f4f-4434-b179-5dd75b2dad2e None admin] RBAC: Authorizing `identity:create_grant(project_id=7183a03ddc1c42a1936553d733e1a2af, user_id=0a599c9a250244f6a5597a5961ba5b6e, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:19.488135 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3352808-6f4f-4434-b179-5dd75b2dad2e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:19.502316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 613/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:54:19 2022] PUT /identity/v3/projects/7183a03ddc1c42a1936553d733e1a2af/users/0a599c9a250244f6a5597a5961ba5b6e/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:54:21.501470 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa31f6b-4cd2-4a98-91e6-76b76d06f478 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:21.502014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa31f6b-4cd2-4a98-91e6-76b76d06f478 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:21.502014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa31f6b-4cd2-4a98-91e6-76b76d06f478 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:21.503465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 580/1193] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:54:21.508652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee162c-6614-4bb5-a7a1-74df3d54c3a2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:21.509091 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee162c-6614-4bb5-a7a1-74df3d54c3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:21.509182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee162c-6614-4bb5-a7a1-74df3d54c3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:21.526364 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-33ee162c-6614-4bb5-a7a1-74df3d54c3a2 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:54:21.527582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-33ee162c-6614-4bb5-a7a1-74df3d54c3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:54:21.598835 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 614/1194] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:54:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:54:21.622602 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa31f6b-4cd2-4a98-91e6-76b76d06f478 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:21.727675 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa31f6b-4cd2-4a98-91e6-76b76d06f478 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:21.730058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:21.763809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e30d4-ae9f-4375-89f5-4d17aa86ea8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:21.764529 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e30d4-ae9f-4375-89f5-4d17aa86ea8d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:21.764814 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e30d4-ae9f-4375-89f5-4d17aa86ea8d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:21.765092 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e30d4-ae9f-4375-89f5-4d17aa86ea8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:21.776491 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3e30d4-ae9f-4375-89f5-4d17aa86ea8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-2f3e30d4-ae9f-4375-89f5-4d17aa86ea8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:54:21.784073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:54:21.785086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:54:21.786057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:54:21.786057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:54:21.786057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:54:21.786057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:54:21.786057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:54:21.786057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:54:21.786057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:54:21.786057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:54:21.786057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:54:21.786057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:54:21.786057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:54:21.786057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:54:21.786057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 581/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:54:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:54:21.791650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee162c-6614-4bb5-a7a1-74df3d54c3a2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:21.841231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:21.895774 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee162c-6614-4bb5-a7a1-74df3d54c3a2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:21.930647 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e4599-31f9-4b15-a8cc-41319dc6d18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:21.931343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e4599-31f9-4b15-a8cc-41319dc6d18b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:21.931622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e4599-31f9-4b15-a8cc-41319dc6d18b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:21.931895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e4599-31f9-4b15-a8cc-41319dc6d18b None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:21.932646 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e4599-31f9-4b15-a8cc-41319dc6d18b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:54:21.932948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e4599-31f9-4b15-a8cc-41319dc6d18b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:21.934343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e4599-31f9-4b15-a8cc-41319dc6d18b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:21.942598 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 615/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:54:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:54:21.949019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e30d4-ae9f-4375-89f5-4d17aa86ea8d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:22.050061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e30d4-ae9f-4375-89f5-4d17aa86ea8d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:22.084097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafcee1-e5c0-46a2-8305-4773f50a1604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:22.084974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafcee1-e5c0-46a2-8305-4773f50a1604 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:22.085247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafcee1-e5c0-46a2-8305-4773f50a1604 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:22.085518 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafcee1-e5c0-46a2-8305-4773f50a1604 None admin] PATH_INFO: `/v3/users/0a599c9a250244f6a5597a5961ba5b6e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:22.086743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafcee1-e5c0-46a2-8305-4773f50a1604 None admin] RBAC: Authorizing `identity:get_user(user_id=0a599c9a250244f6a5597a5961ba5b6e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:22.088228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafcee1-e5c0-46a2-8305-4773f50a1604 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:22.089856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 582/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Jul 21 15:54:21 2022] GET /identity/v3/users/0a599c9a250244f6a5597a5961ba5b6e => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:54:22.096316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e4599-31f9-4b15-a8cc-41319dc6d18b None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:22.198716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e4599-31f9-4b15-a8cc-41319dc6d18b None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:22.207879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:22.233489 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555d2cc-a269-47db-bbb6-ba8b9ddaa070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:22.234149 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555d2cc-a269-47db-bbb6-ba8b9ddaa070 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:22.234432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555d2cc-a269-47db-bbb6-ba8b9ddaa070 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:22.234708 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555d2cc-a269-47db-bbb6-ba8b9ddaa070 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:22.302849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555d2cc-a269-47db-bbb6-ba8b9ddaa070 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:22.304293 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555d2cc-a269-47db-bbb6-ba8b9ddaa070 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:22.405919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 616/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:54:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:54:22.412319 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafcee1-e5c0-46a2-8305-4773f50a1604 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:22.445431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:22.520642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafcee1-e5c0-46a2-8305-4773f50a1604 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:22.557314 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9934b97-87d5-4dfd-a28e-08bc491f6951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:22.558087 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9934b97-87d5-4dfd-a28e-08bc491f6951 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:22.558369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9934b97-87d5-4dfd-a28e-08bc491f6951 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:22.558644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9934b97-87d5-4dfd-a28e-08bc491f6951 None admin] PATH_INFO: `/v3/projects/7183a03ddc1c42a1936553d733e1a2af` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:22.559891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9934b97-87d5-4dfd-a28e-08bc491f6951 None admin] RBAC: Authorizing `identity:get_project(project_id=7183a03ddc1c42a1936553d733e1a2af)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:22.561337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9934b97-87d5-4dfd-a28e-08bc491f6951 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:22.563069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 583/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Jul 21 15:54:22 2022] GET /identity/v3/projects/7183a03ddc1c42a1936553d733e1a2af => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:54:22.569562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555d2cc-a269-47db-bbb6-ba8b9ddaa070 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:54:22.580058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:22.671230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555d2cc-a269-47db-bbb6-ba8b9ddaa070 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:54:22.706072 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c199f1-a9f6-44b9-b0b0-8680ec8987a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:54:22.706784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c199f1-a9f6-44b9-b0b0-8680ec8987a3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:54:22.707095 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c199f1-a9f6-44b9-b0b0-8680ec8987a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:54:22.707368 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c199f1-a9f6-44b9-b0b0-8680ec8987a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:54:22.708196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c199f1-a9f6-44b9-b0b0-8680ec8987a3 None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=7183a03ddc1c42a1936553d733e1a2af, user.id=0a599c9a250244f6a5597a5961ba5b6e) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:54:22.708502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c199f1-a9f6-44b9-b0b0-8680ec8987a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:54:22.709920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c199f1-a9f6-44b9-b0b0-8680ec8987a3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:54:22.715948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 617/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:54:22 2022] GET /identity/v3/role_assignments?user.id=0a599c9a250244f6a5597a5961ba5b6e&scope.project.id=7183a03ddc1c42a1936553d733e1a2af&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:54:32.551817 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=50 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:54:32.713199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=64 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:18.720342 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd08d24-dd12-4461-a840-3d76a914e781 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:18.720980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd08d24-dd12-4461-a840-3d76a914e781 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:18.720980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd08d24-dd12-4461-a840-3d76a914e781 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:18.722205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 584/1201] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:55:18.728231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848612f4-d4b6-4022-82b3-17aefa2fcb4f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:18.728733 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848612f4-d4b6-4022-82b3-17aefa2fcb4f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:18.728844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848612f4-d4b6-4022-82b3-17aefa2fcb4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:18.748421 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-848612f4-d4b6-4022-82b3-17aefa2fcb4f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:55:18.749642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-848612f4-d4b6-4022-82b3-17aefa2fcb4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:55:18.842956 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 618/1202] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:55:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:55:18.869410 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd08d24-dd12-4461-a840-3d76a914e781 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:19.017323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd08d24-dd12-4461-a840-3d76a914e781 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:19.061610 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc6dc4-5c08-44e5-98f9-23b87aba1454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:19.062424 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc6dc4-5c08-44e5-98f9-23b87aba1454 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:19.062712 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc6dc4-5c08-44e5-98f9-23b87aba1454 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:19.063016 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc6dc4-5c08-44e5-98f9-23b87aba1454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:19.075557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc6dc4-5c08-44e5-98f9-23b87aba1454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:19.079663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc6dc4-5c08-44e5-98f9-23b87aba1454 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:19.098566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-22bc6dc4-5c08-44e5-98f9-23b87aba1454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:19.098566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:19.098566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:19.098566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:19.098566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:19.098566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:19.098566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:19.098566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:19.098566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:19.098566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:19.098566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:19.098566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:19.098566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:55:19.098566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:55:19.098566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:19.099808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:19.100809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:55:19.100809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:55:19.100809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:19.100809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:19.100809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 585/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:19.110256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848612f4-d4b6-4022-82b3-17aefa2fcb4f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:19.269923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848612f4-d4b6-4022-82b3-17aefa2fcb4f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:19.315470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:19.331251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30445de-146c-4a8b-b28f-8314b9628c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:19.331998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30445de-146c-4a8b-b28f-8314b9628c21 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:19.332737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30445de-146c-4a8b-b28f-8314b9628c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:19.333161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30445de-146c-4a8b-b28f-8314b9628c21 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:19.334253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30445de-146c-4a8b-b28f-8314b9628c21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:19.334702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30445de-146c-4a8b-b28f-8314b9628c21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:19.336941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30445de-146c-4a8b-b28f-8314b9628c21 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:19.353993 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 619/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:55:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:55:19.360332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc6dc4-5c08-44e5-98f9-23b87aba1454 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:19.441416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:19.504868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc6dc4-5c08-44e5-98f9-23b87aba1454 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:19.552207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d1c8ba-81ba-4051-bef4-c13dbf35d2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:19.552822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1c8ba-81ba-4051-bef4-c13dbf35d2a7 None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:19.553148 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1c8ba-81ba-4051-bef4-c13dbf35d2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:19.553425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d1c8ba-81ba-4051-bef4-c13dbf35d2a7 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:19.554167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1c8ba-81ba-4051-bef4-c13dbf35d2a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:19.559640 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d1c8ba-81ba-4051-bef4-c13dbf35d2a7 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:19.589650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 586/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Jul 21 15:55:19 2022] POST /identity/v3/users => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:55:22.093392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344b5a8-a8e6-4244-8d40-dea72779d89e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:22.093948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344b5a8-a8e6-4244-8d40-dea72779d89e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:22.093948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344b5a8-a8e6-4244-8d40-dea72779d89e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:22.095415 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 620/1206] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:55:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:55:22.101301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24870bf-6e75-4b9c-8379-b769beb94568 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:22.101985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24870bf-6e75-4b9c-8379-b769beb94568 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:22.101985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24870bf-6e75-4b9c-8379-b769beb94568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:22.127138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c24870bf-6e75-4b9c-8379-b769beb94568 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:55:22.128659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c24870bf-6e75-4b9c-8379-b769beb94568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:55:22.239468 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 587/1207] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:55:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:55:22.266357 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344b5a8-a8e6-4244-8d40-dea72779d89e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:22.414128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344b5a8-a8e6-4244-8d40-dea72779d89e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:22.455473 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01418a97-57b1-4221-99b0-14faee1ff9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:22.456504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01418a97-57b1-4221-99b0-14faee1ff9ea None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:22.456800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01418a97-57b1-4221-99b0-14faee1ff9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:22.457175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01418a97-57b1-4221-99b0-14faee1ff9ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:22.469412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01418a97-57b1-4221-99b0-14faee1ff9ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-01418a97-57b1-4221-99b0-14faee1ff9ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:55:22.477531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:22.478617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:22.479727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:22.479727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:22.479727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:22.479727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:22.479727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:55:22.479727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:55:22.479727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:55:22.479727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:55:22.479727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:55:22.479727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:55:22.479727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:55:22.479727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:22.479727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 621/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:55:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:22.485845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24870bf-6e75-4b9c-8379-b769beb94568 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:22.536605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:22.616525 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24870bf-6e75-4b9c-8379-b769beb94568 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:22.656661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bbcea-8451-4fd9-86da-d97fd71d65f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:22.657355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bbcea-8451-4fd9-86da-d97fd71d65f4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:22.657698 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bbcea-8451-4fd9-86da-d97fd71d65f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:22.657983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bbcea-8451-4fd9-86da-d97fd71d65f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:22.658749 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bbcea-8451-4fd9-86da-d97fd71d65f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:22.659108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bbcea-8451-4fd9-86da-d97fd71d65f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:22.660665 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2bbcea-8451-4fd9-86da-d97fd71d65f4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:22.670910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 588/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:55:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:22.676435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01418a97-57b1-4221-99b0-14faee1ff9ea None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:22.733827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:22.802325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01418a97-57b1-4221-99b0-14faee1ff9ea None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:22.853092 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5bbfa-549a-4482-a9c9-013cad9610dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:22.854189 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5bbfa-549a-4482-a9c9-013cad9610dd None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:22.854531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5bbfa-549a-4482-a9c9-013cad9610dd None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:22.854765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5bbfa-549a-4482-a9c9-013cad9610dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:22.871582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5bbfa-549a-4482-a9c9-013cad9610dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:22.873812 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5bbfa-549a-4482-a9c9-013cad9610dd None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:22.908323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-dbd5bbfa-549a-4482-a9c9-013cad9610dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:22.908323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:22.908323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:22.908323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:22.908323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:22.908323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:22.908323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:22.908323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:22.908323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:22.908323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:22.908323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:22.908323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:22.908323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:55:22.908323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:55:22.908323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:22.909463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:22.910462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:55:22.910462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:55:22.910462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:22.910462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:22.910462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 622/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:22.921236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bbcea-8451-4fd9-86da-d97fd71d65f4 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:23.081904 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:23.085131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bbcea-8451-4fd9-86da-d97fd71d65f4 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:23.123381 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23065312-8e09-4ca3-9edc-71fd78e8fe80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:23.124406 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23065312-8e09-4ca3-9edc-71fd78e8fe80 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:23.124406 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23065312-8e09-4ca3-9edc-71fd78e8fe80 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:23.124667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23065312-8e09-4ca3-9edc-71fd78e8fe80 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:23.125300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23065312-8e09-4ca3-9edc-71fd78e8fe80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:23.125607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23065312-8e09-4ca3-9edc-71fd78e8fe80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:23.127067 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23065312-8e09-4ca3-9edc-71fd78e8fe80 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:23.141592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 589/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:23.149209 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5bbfa-549a-4482-a9c9-013cad9610dd None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:23.275359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5bbfa-549a-4482-a9c9-013cad9610dd None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:23.277109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:23.318465 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621333a5-7e83-4c8b-abd4-0680f991ac3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:23.319511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621333a5-7e83-4c8b-abd4-0680f991ac3e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:23.319835 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621333a5-7e83-4c8b-abd4-0680f991ac3e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:23.320174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621333a5-7e83-4c8b-abd4-0680f991ac3e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:23.329833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621333a5-7e83-4c8b-abd4-0680f991ac3e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:23.331603 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621333a5-7e83-4c8b-abd4-0680f991ac3e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-621333a5-7e83-4c8b-abd4-0680f991ac3e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:55:23.349376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:23.350496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:23.351523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:23.351523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:23.351523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:55:23.351523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:55:23.351523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:55:23.351523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:55:23.351523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:55:23.351523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:55:23.351523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 15:55:23.351523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:23.357738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 623/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:23.359869 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23065312-8e09-4ca3-9edc-71fd78e8fe80 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:23.480000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23065312-8e09-4ca3-9edc-71fd78e8fe80 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:23.528819 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e582305-ae4d-44b7-8383-4c6d01f56efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:23.529621 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e582305-ae4d-44b7-8383-4c6d01f56efc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:23.529903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e582305-ae4d-44b7-8383-4c6d01f56efc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:23.530191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e582305-ae4d-44b7-8383-4c6d01f56efc None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:23.531147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e582305-ae4d-44b7-8383-4c6d01f56efc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:23.531464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e582305-ae4d-44b7-8383-4c6d01f56efc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:23.533059 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e582305-ae4d-44b7-8383-4c6d01f56efc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:23.552997 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 590/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 21 15:55:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:23.561715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621333a5-7e83-4c8b-abd4-0680f991ac3e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:23.691917 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621333a5-7e83-4c8b-abd4-0680f991ac3e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:23.736463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe98e14-9273-4586-aea5-8f20f0cf5a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:23.737435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe98e14-9273-4586-aea5-8f20f0cf5a57 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:23.737735 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe98e14-9273-4586-aea5-8f20f0cf5a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:23.738034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe98e14-9273-4586-aea5-8f20f0cf5a57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:23.774244 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:23.829883 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe98e14-9273-4586-aea5-8f20f0cf5a57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:23.832685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe98e14-9273-4586-aea5-8f20f0cf5a57 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:23.968322 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 624/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:55:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:55:23.974700 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e582305-ae4d-44b7-8383-4c6d01f56efc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:23.998002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:24.102510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e582305-ae4d-44b7-8383-4c6d01f56efc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:24.144251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509d233-e2a5-4ab6-8e34-bc0242098e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:24.145090 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509d233-e2a5-4ab6-8e34-bc0242098e93 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:24.145388 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509d233-e2a5-4ab6-8e34-bc0242098e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:24.145651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509d233-e2a5-4ab6-8e34-bc0242098e93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:24.158005 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509d233-e2a5-4ab6-8e34-bc0242098e93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:24.159219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509d233-e2a5-4ab6-8e34-bc0242098e93 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:24.180488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f509d233-e2a5-4ab6-8e34-bc0242098e93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:24.180488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:24.180488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:24.180488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:24.180488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:24.180488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:24.180488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:24.180488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:24.180488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:24.180488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:24.180488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:24.180488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:24.180488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:55:24.180488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:55:24.180488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:24.181465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:24.182455 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:55:24.182455 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:55:24.182455 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:24.182455 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:24.182455 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 591/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:55:24.191733 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe98e14-9273-4586-aea5-8f20f0cf5a57 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:24.264137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:24.309097 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe98e14-9273-4586-aea5-8f20f0cf5a57 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:24.358760 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f8c0f-65ec-4ad9-84ff-9906bff4a36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:24.360128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f8c0f-65ec-4ad9-84ff-9906bff4a36d None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:24.360827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f8c0f-65ec-4ad9-84ff-9906bff4a36d None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:24.361393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f8c0f-65ec-4ad9-84ff-9906bff4a36d None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:24.362863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f8c0f-65ec-4ad9-84ff-9906bff4a36d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:24.363440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f8c0f-65ec-4ad9-84ff-9906bff4a36d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:24.365546 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f8c0f-65ec-4ad9-84ff-9906bff4a36d None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:24.380894 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 625/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:24.386751 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509d233-e2a5-4ab6-8e34-bc0242098e93 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:24.462513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:24.508291 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509d233-e2a5-4ab6-8e34-bc0242098e93 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:24.548392 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69897283-e796-4cd6-b2b8-c8b5b05d0577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:24.549108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69897283-e796-4cd6-b2b8-c8b5b05d0577 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:24.549387 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69897283-e796-4cd6-b2b8-c8b5b05d0577 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:24.549657 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69897283-e796-4cd6-b2b8-c8b5b05d0577 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:24.557227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69897283-e796-4cd6-b2b8-c8b5b05d0577 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:24.558875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69897283-e796-4cd6-b2b8-c8b5b05d0577 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:24.576313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-69897283-e796-4cd6-b2b8-c8b5b05d0577 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:55:24.576313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:24.576313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:24.576313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:24.576313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:24.576313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:24.576313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:24.576313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:24.576313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:24.576313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:24.576313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:24.576313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:24.576313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:55:24.576313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:55:24.576313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:24.577425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:24.579970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:55:24.579970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:55:24.579970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:55:24.579970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:55:24.579970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:55:24.579970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:55:24.579970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:55:24.579970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:24.579970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 592/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:55:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:24.583625 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f8c0f-65ec-4ad9-84ff-9906bff4a36d None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:24.708412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f8c0f-65ec-4ad9-84ff-9906bff4a36d None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:24.733492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:24.747875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f064e-d247-4826-a31c-174d0070ce46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:24.748630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f064e-d247-4826-a31c-174d0070ce46 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:24.748938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f064e-d247-4826-a31c-174d0070ce46 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:24.749218 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f064e-d247-4826-a31c-174d0070ce46 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:24.750162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f064e-d247-4826-a31c-174d0070ce46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:24.750405 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f064e-d247-4826-a31c-174d0070ce46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:24.752150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f064e-d247-4826-a31c-174d0070ce46 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:24.766056 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 626/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:55:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:55:24.772433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69897283-e796-4cd6-b2b8-c8b5b05d0577 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:24.894152 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69897283-e796-4cd6-b2b8-c8b5b05d0577 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:24.932583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:24.940203 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7544b960-9122-4519-99fd-c69b99b556db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:24.941917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544b960-9122-4519-99fd-c69b99b556db None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:24.941917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544b960-9122-4519-99fd-c69b99b556db None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:24.941917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7544b960-9122-4519-99fd-c69b99b556db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:24.942239 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544b960-9122-4519-99fd-c69b99b556db None admin] RBAC: Adding query filter params (role.id=ae7cbb39ab61467ba1976a753ba6693c, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=1f4a46a051c241a2a47059052735c930) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:24.942528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544b960-9122-4519-99fd-c69b99b556db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:24.944027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7544b960-9122-4519-99fd-c69b99b556db None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:24.951615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 593/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:55:24 2022] GET /identity/v3/role_assignments?user.id=1f4a46a051c241a2a47059052735c930&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=ae7cbb39ab61467ba1976a753ba6693c => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:55:27.157831 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd143d4-2459-463f-a5a6-c8fa83d4e1a0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:27.158397 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd143d4-2459-463f-a5a6-c8fa83d4e1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:27.158492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd143d4-2459-463f-a5a6-c8fa83d4e1a0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:27.160067 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 627/1220] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:55:27.167839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf62b48-fb18-4ccd-bf0f-23d8d6265c62 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:27.168344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf62b48-fb18-4ccd-bf0f-23d8d6265c62 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:27.168435 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf62b48-fb18-4ccd-bf0f-23d8d6265c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:27.190675 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8bf62b48-fb18-4ccd-bf0f-23d8d6265c62 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:55:27.192012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8bf62b48-fb18-4ccd-bf0f-23d8d6265c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:55:27.277502 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 594/1221] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:55:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:55:27.301274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd143d4-2459-463f-a5a6-c8fa83d4e1a0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:27.422749 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd143d4-2459-463f-a5a6-c8fa83d4e1a0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:27.462098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae6526-4a56-47e6-8cee-f5942f68652a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:27.462944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae6526-4a56-47e6-8cee-f5942f68652a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:27.463224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae6526-4a56-47e6-8cee-f5942f68652a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:27.463494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae6526-4a56-47e6-8cee-f5942f68652a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:27.476252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ae6526-4a56-47e6-8cee-f5942f68652a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-e7ae6526-4a56-47e6-8cee-f5942f68652a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:55:27.484426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:27.485447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:27.486341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:27.486341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:27.486341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:27.486341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:27.486341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:55:27.486341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:55:27.486341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:55:27.486341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:55:27.486341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:55:27.486341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:55:27.486341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:55:27.486341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:27.491268 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 628/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:55:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:55:27.492539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf62b48-fb18-4ccd-bf0f-23d8d6265c62 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:27.601410 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf62b48-fb18-4ccd-bf0f-23d8d6265c62 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:27.629330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:27.641486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09595177-1b93-4f6e-90e0-cc5b0505bd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:27.642219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09595177-1b93-4f6e-90e0-cc5b0505bd43 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:27.642503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09595177-1b93-4f6e-90e0-cc5b0505bd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:27.642779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09595177-1b93-4f6e-90e0-cc5b0505bd43 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:27.643576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09595177-1b93-4f6e-90e0-cc5b0505bd43 None admin] RBAC: Adding query filter params (name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:27.643885 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09595177-1b93-4f6e-90e0-cc5b0505bd43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:27.645299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09595177-1b93-4f6e-90e0-cc5b0505bd43 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:27.654260 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 595/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:55:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:27.660731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae6526-4a56-47e6-8cee-f5942f68652a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:27.717823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:27.783765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ae6526-4a56-47e6-8cee-f5942f68652a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:27.826511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b6274-21c4-445b-9e54-e8c5d1761292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:27.827736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b6274-21c4-445b-9e54-e8c5d1761292 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:27.828181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b6274-21c4-445b-9e54-e8c5d1761292 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:27.828622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b6274-21c4-445b-9e54-e8c5d1761292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:27.843354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b6274-21c4-445b-9e54-e8c5d1761292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:27.844932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b6274-21c4-445b-9e54-e8c5d1761292 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:27.863549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-023b6274-21c4-445b-9e54-e8c5d1761292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:27.863549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:27.863549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:27.863549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:27.863549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:27.863549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:27.863549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:27.863549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:27.863549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:27.863549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:27.863549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:27.863549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:27.863549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:55:27.863549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:55:27.863549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:27.864519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:27.865621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:55:27.865621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:55:27.865621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:27.865621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:27.865621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 629/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:27.871255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09595177-1b93-4f6e-90e0-cc5b0505bd43 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:27.998434 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09595177-1b93-4f6e-90e0-cc5b0505bd43 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:28.038073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46218991-5368-4dbe-931c-9349b227b3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:28.038755 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46218991-5368-4dbe-931c-9349b227b3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:28.039071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46218991-5368-4dbe-931c-9349b227b3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:28.042306 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46218991-5368-4dbe-931c-9349b227b3b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:28.042306 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46218991-5368-4dbe-931c-9349b227b3b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:28.042306 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46218991-5368-4dbe-931c-9349b227b3b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:28.042306 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46218991-5368-4dbe-931c-9349b227b3b9 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:28.062741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 596/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:55:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:28.069187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b6274-21c4-445b-9e54-e8c5d1761292 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:28.184159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:28.193662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b6274-21c4-445b-9e54-e8c5d1761292 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:28.236377 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d355c2-f45c-4ea0-b67a-55d6cda7cb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:28.237476 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d355c2-f45c-4ea0-b67a-55d6cda7cb11 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:28.237810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d355c2-f45c-4ea0-b67a-55d6cda7cb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:28.238083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d355c2-f45c-4ea0-b67a-55d6cda7cb11 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:28.249179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d355c2-f45c-4ea0-b67a-55d6cda7cb11 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:28.249179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d355c2-f45c-4ea0-b67a-55d6cda7cb11 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d7d355c2-f45c-4ea0-b67a-55d6cda7cb11 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:55:28.264538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:28.266009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:28.267586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:28.267586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:28.267586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:55:28.267586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:55:28.267586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:55:28.267586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:55:28.267586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:55:28.267586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:55:28.267586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 15:55:28.267586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:28.267586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 630/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:28.273255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46218991-5368-4dbe-931c-9349b227b3b9 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:28.327844 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:28.393011 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46218991-5368-4dbe-931c-9349b227b3b9 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:28.431300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c9ade-e3ef-4d92-9332-fc6aab35a9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:28.432156 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c9ade-e3ef-4d92-9332-fc6aab35a9eb None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:28.432440 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c9ade-e3ef-4d92-9332-fc6aab35a9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:28.432711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c9ade-e3ef-4d92-9332-fc6aab35a9eb None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:28.433832 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c9ade-e3ef-4d92-9332-fc6aab35a9eb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:28.434096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c9ade-e3ef-4d92-9332-fc6aab35a9eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:28.435927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c9ade-e3ef-4d92-9332-fc6aab35a9eb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:28.457181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 597/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 21 15:55:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:28.463139 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d355c2-f45c-4ea0-b67a-55d6cda7cb11 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:28.581108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d355c2-f45c-4ea0-b67a-55d6cda7cb11 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:28.629397 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282da809-e31e-4159-9466-4fd7383be830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:28.630422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282da809-e31e-4159-9466-4fd7383be830 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:28.630708 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282da809-e31e-4159-9466-4fd7383be830 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:28.631021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282da809-e31e-4159-9466-4fd7383be830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:28.647454 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282da809-e31e-4159-9466-4fd7383be830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:28.648975 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282da809-e31e-4159-9466-4fd7383be830 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:28.671025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-282da809-e31e-4159-9466-4fd7383be830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:28.671025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:28.671025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:28.671025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:28.671025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:28.671025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:28.671025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:28.671025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:28.671025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:28.671025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:28.671025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:28.671025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:28.671025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:55:28.671025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:55:28.671025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:28.672206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:28.678080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:55:28.678080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:55:28.678080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:28.678080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:28.678080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 631/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:28.678517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c9ade-e3ef-4d92-9332-fc6aab35a9eb None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:28.807750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c9ade-e3ef-4d92-9332-fc6aab35a9eb None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:28.811003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:28.847346 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1743b6e-9b55-4914-a1be-f66b9746a84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:28.848227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1743b6e-9b55-4914-a1be-f66b9746a84b None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:28.848629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1743b6e-9b55-4914-a1be-f66b9746a84b None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:28.848910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1743b6e-9b55-4914-a1be-f66b9746a84b None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:28.849726 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1743b6e-9b55-4914-a1be-f66b9746a84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:28.850101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1743b6e-9b55-4914-a1be-f66b9746a84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:28.851751 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1743b6e-9b55-4914-a1be-f66b9746a84b None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:28.866147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 598/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:28.872569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282da809-e31e-4159-9466-4fd7383be830 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:28.883334 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:29.003446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282da809-e31e-4159-9466-4fd7383be830 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:29.046108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae655ce-a369-4fdf-b347-28089683654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:29.047004 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae655ce-a369-4fdf-b347-28089683654a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:29.047261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae655ce-a369-4fdf-b347-28089683654a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:29.047534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae655ce-a369-4fdf-b347-28089683654a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:29.054870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae655ce-a369-4fdf-b347-28089683654a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:29.056330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae655ce-a369-4fdf-b347-28089683654a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:29.071780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-1ae655ce-a369-4fdf-b347-28089683654a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:55:29.071780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:29.071780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:29.071780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:29.071780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:29.071780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:29.071780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:29.071780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:29.071780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:29.071780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:29.071780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:29.071780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:29.071780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:55:29.071780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:55:29.071780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:29.072875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:29.073807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:55:29.073807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:55:29.073807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:55:29.073807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:55:29.073807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:55:29.073807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:55:29.073807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:55:29.073807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:29.073807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 632/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:55:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:29.079046 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1743b6e-9b55-4914-a1be-f66b9746a84b None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:29.190298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1743b6e-9b55-4914-a1be-f66b9746a84b None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:29.231150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a98e4-b452-482c-85a5-38b49927c485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:29.231872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a98e4-b452-482c-85a5-38b49927c485 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:29.232130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a98e4-b452-482c-85a5-38b49927c485 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:29.232426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a98e4-b452-482c-85a5-38b49927c485 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:29.233263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a98e4-b452-482c-85a5-38b49927c485 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:29.233572 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a98e4-b452-482c-85a5-38b49927c485 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:29.235069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a98e4-b452-482c-85a5-38b49927c485 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:29.249920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 599/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:55:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:29.256161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae655ce-a369-4fdf-b347-28089683654a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:29.334518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:29.381588 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae655ce-a369-4fdf-b347-28089683654a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:29.428737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9da41a-da2c-479f-bc79-95fdba3c35a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:29.429889 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9da41a-da2c-479f-bc79-95fdba3c35a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:29.430175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9da41a-da2c-479f-bc79-95fdba3c35a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:29.430566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9da41a-da2c-479f-bc79-95fdba3c35a5 None admin] PATH_INFO: `/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/1f4a46a051c241a2a47059052735c930/roles/ae7cbb39ab61467ba1976a753ba6693c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:29.450016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9da41a-da2c-479f-bc79-95fdba3c35a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d717ed2993d4a3ab21195028a16e747, user_id=1f4a46a051c241a2a47059052735c930, role_id=ae7cbb39ab61467ba1976a753ba6693c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:29.451661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9da41a-da2c-479f-bc79-95fdba3c35a5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:29.467392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 633/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:55:29 2022] PUT /identity/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/1f4a46a051c241a2a47059052735c930/roles/ae7cbb39ab61467ba1976a753ba6693c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:55:31.762789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecb985-46ae-4805-84c4-81bc5c72cfe1 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:31.762789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecb985-46ae-4805-84c4-81bc5c72cfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:31.762789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecb985-46ae-4805-84c4-81bc5c72cfe1 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:31.764455 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 600/1233] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:55:31.770285 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81667f61-8507-4a2f-9fe7-55c1d6b05db7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:31.770748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81667f61-8507-4a2f-9fe7-55c1d6b05db7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:31.770878 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81667f61-8507-4a2f-9fe7-55c1d6b05db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:31.790380 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-81667f61-8507-4a2f-9fe7-55c1d6b05db7 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:55:31.791798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-81667f61-8507-4a2f-9fe7-55c1d6b05db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:55:31.870155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 634/1234] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:55:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:55:31.894270 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecb985-46ae-4805-84c4-81bc5c72cfe1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:31.933048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:32.034541 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecb985-46ae-4805-84c4-81bc5c72cfe1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:32.072610 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d556b-0cb8-4784-a30e-5e98029c8ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:32.073511 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d556b-0cb8-4784-a30e-5e98029c8ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:32.073833 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d556b-0cb8-4784-a30e-5e98029c8ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:32.074108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d556b-0cb8-4784-a30e-5e98029c8ce2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:32.085113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d556b-0cb8-4784-a30e-5e98029c8ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-595d556b-0cb8-4784-a30e-5e98029c8ce2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:55:32.093193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:32.094400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:32.095390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:32.095390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:32.095390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:32.095390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:32.095390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:55:32.095390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:55:32.095390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:55:32.095390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:55:32.095390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:55:32.095390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:55:32.095390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 15:55:32.095390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:32.095390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 601/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Jul 21 15:55:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:32.100840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81667f61-8507-4a2f-9fe7-55c1d6b05db7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:32.147417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:32.204886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81667f61-8507-4a2f-9fe7-55c1d6b05db7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:32.240836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1790d7-bff7-40af-a8d7-29f37bedc6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:32.241512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1790d7-bff7-40af-a8d7-29f37bedc6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:32.241791 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1790d7-bff7-40af-a8d7-29f37bedc6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:32.242066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1790d7-bff7-40af-a8d7-29f37bedc6e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:32.242840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1790d7-bff7-40af-a8d7-29f37bedc6e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:32.243149 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1790d7-bff7-40af-a8d7-29f37bedc6e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:32.244513 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1790d7-bff7-40af-a8d7-29f37bedc6e2 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:32.253216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 635/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Jul 21 15:55:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:55:32.259481 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d556b-0cb8-4784-a30e-5e98029c8ce2 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:32.352624 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:32.370393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d556b-0cb8-4784-a30e-5e98029c8ce2 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:32.404465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ffed4-df35-4778-9c5f-b94ad17b2ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:32.405270 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ffed4-df35-4778-9c5f-b94ad17b2ade None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:32.405551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ffed4-df35-4778-9c5f-b94ad17b2ade None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:32.405829 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ffed4-df35-4778-9c5f-b94ad17b2ade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:32.416948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ffed4-df35-4778-9c5f-b94ad17b2ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:32.418748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ffed4-df35-4778-9c5f-b94ad17b2ade None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:32.439214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-084ffed4-df35-4778-9c5f-b94ad17b2ade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:32.439214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:32.439214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:32.439214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:32.439214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:32.439214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:32.439214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:32.439214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:32.439214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:32.439214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:32.439214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:32.439214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:32.439214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:55:32.439214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:55:32.439214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:32.440336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:32.441290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:55:32.441290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:55:32.441290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:32.441290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:32.441290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 602/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:32.447455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1790d7-bff7-40af-a8d7-29f37bedc6e2 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:32.563085 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1790d7-bff7-40af-a8d7-29f37bedc6e2 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:32.572687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:32.599890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c4fa8-22b0-4de6-875b-52a0dc28485c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:32.600727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c4fa8-22b0-4de6-875b-52a0dc28485c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:32.601151 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c4fa8-22b0-4de6-875b-52a0dc28485c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:32.601481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c4fa8-22b0-4de6-875b-52a0dc28485c None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:32.602286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c4fa8-22b0-4de6-875b-52a0dc28485c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:32.602733 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c4fa8-22b0-4de6-875b-52a0dc28485c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:32.604160 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c4fa8-22b0-4de6-875b-52a0dc28485c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:32.621098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 636/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:55:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:32.627127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ffed4-df35-4778-9c5f-b94ad17b2ade None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:32.735916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ffed4-df35-4778-9c5f-b94ad17b2ade None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:32.775261 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c85f8f-4b08-43b1-be4a-243eaaf443cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:32.776195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c85f8f-4b08-43b1-be4a-243eaaf443cc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:32.776472 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c85f8f-4b08-43b1-be4a-243eaaf443cc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:32.776862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c85f8f-4b08-43b1-be4a-243eaaf443cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:32.780068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:32.786522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c85f8f-4b08-43b1-be4a-243eaaf443cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:32.788175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c85f8f-4b08-43b1-be4a-243eaaf443cc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-e4c85f8f-4b08-43b1-be4a-243eaaf443cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:55:32.804847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:32.806143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:32.807329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:32.807329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:32.807329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:55:32.807329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:55:32.807329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:55:32.807329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:55:32.807329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:55:32.807329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:55:32.807329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 15:55:32.807329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:32.810981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 603/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:32.812870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c4fa8-22b0-4de6-875b-52a0dc28485c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:32.926248 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c4fa8-22b0-4de6-875b-52a0dc28485c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:32.963583 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd10fd-ffb2-4c52-81ee-dd034810e5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:32.964265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd10fd-ffb2-4c52-81ee-dd034810e5da None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:32.964546 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd10fd-ffb2-4c52-81ee-dd034810e5da None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:32.964821 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd10fd-ffb2-4c52-81ee-dd034810e5da None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:32.965666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd10fd-ffb2-4c52-81ee-dd034810e5da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:32.965974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd10fd-ffb2-4c52-81ee-dd034810e5da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:32.967441 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd10fd-ffb2-4c52-81ee-dd034810e5da None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:32.987249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 637/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 21 15:55:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:32.993553 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c85f8f-4b08-43b1-be4a-243eaaf443cc None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:33.108249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c85f8f-4b08-43b1-be4a-243eaaf443cc None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:33.147957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c584c7-a828-4c47-bdde-0448834e6560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:33.148668 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c584c7-a828-4c47-bdde-0448834e6560 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:33.148956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c584c7-a828-4c47-bdde-0448834e6560 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:33.149235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c584c7-a828-4c47-bdde-0448834e6560 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:33.238182 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:33.246033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c584c7-a828-4c47-bdde-0448834e6560 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:33.247837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c584c7-a828-4c47-bdde-0448834e6560 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:33.357285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 604/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:55:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:55:33.363735 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd10fd-ffb2-4c52-81ee-dd034810e5da None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:33.394993 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:33.481587 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd10fd-ffb2-4c52-81ee-dd034810e5da None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:33.519563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578aa91-a5fc-4bec-8433-829b43b10c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:33.520404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578aa91-a5fc-4bec-8433-829b43b10c3f None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:33.520779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578aa91-a5fc-4bec-8433-829b43b10c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:33.521143 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578aa91-a5fc-4bec-8433-829b43b10c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:33.531548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578aa91-a5fc-4bec-8433-829b43b10c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:33.533056 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578aa91-a5fc-4bec-8433-829b43b10c3f None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:33.554895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d578aa91-a5fc-4bec-8433-829b43b10c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:33.554895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:33.554895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:33.554895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:33.554895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:33.554895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:33.554895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:33.554895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:33.554895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:33.554895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:33.554895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:33.554895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:33.554895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:55:33.554895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:55:33.554895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:33.555969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:33.556871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:55:33.556871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:55:33.556871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:33.556871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:33.556871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 638/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:55:33.563776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c584c7-a828-4c47-bdde-0448834e6560 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:33.668849 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:33.677331 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c584c7-a828-4c47-bdde-0448834e6560 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:33.715496 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992d2d1-7bd1-4314-88e1-47139685af69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:33.716385 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992d2d1-7bd1-4314-88e1-47139685af69 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:33.716774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992d2d1-7bd1-4314-88e1-47139685af69 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:33.717141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992d2d1-7bd1-4314-88e1-47139685af69 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:33.718138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992d2d1-7bd1-4314-88e1-47139685af69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:33.718577 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992d2d1-7bd1-4314-88e1-47139685af69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:33.720478 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992d2d1-7bd1-4314-88e1-47139685af69 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:33.732863 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 605/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:55:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:33.739778 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578aa91-a5fc-4bec-8433-829b43b10c3f None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:33.828966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:33.852420 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578aa91-a5fc-4bec-8433-829b43b10c3f None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:33.888933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da91b44-191b-4ffe-9238-478fe836bf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:33.889750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da91b44-191b-4ffe-9238-478fe836bf17 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:33.890202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da91b44-191b-4ffe-9238-478fe836bf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:33.890377 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da91b44-191b-4ffe-9238-478fe836bf17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:33.899009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da91b44-191b-4ffe-9238-478fe836bf17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:33.900472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da91b44-191b-4ffe-9238-478fe836bf17 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:33.914510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-8da91b44-191b-4ffe-9238-478fe836bf17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:55:33.914510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:33.914510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:33.914510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:33.914510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:33.914510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:33.914510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:33.914510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:33.914510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:33.914510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:33.914510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:33.914510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:33.914510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:55:33.914510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:55:33.914510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:33.915661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:33.916834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:55:33.916834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:55:33.916834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:55:33.916834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:55:33.916834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:55:33.916834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:55:33.916834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:55:33.916834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:33.916834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 639/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:55:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:33.921803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992d2d1-7bd1-4314-88e1-47139685af69 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:34.043033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992d2d1-7bd1-4314-88e1-47139685af69 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:34.088745 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522279d7-5941-4b36-8481-422ab2b23dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:34.089734 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522279d7-5941-4b36-8481-422ab2b23dfc None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:34.090154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522279d7-5941-4b36-8481-422ab2b23dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:34.090564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522279d7-5941-4b36-8481-422ab2b23dfc None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:34.092042 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522279d7-5941-4b36-8481-422ab2b23dfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:34.092550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522279d7-5941-4b36-8481-422ab2b23dfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:34.094532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522279d7-5941-4b36-8481-422ab2b23dfc None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:34.108477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 606/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:55:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:34.115382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da91b44-191b-4ffe-9238-478fe836bf17 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:34.226627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da91b44-191b-4ffe-9238-478fe836bf17 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:34.265308 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9c80a-2c07-4dff-951d-3585f163139b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:34.266101 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9c80a-2c07-4dff-951d-3585f163139b None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:34.266398 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9c80a-2c07-4dff-951d-3585f163139b None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:34.266784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9c80a-2c07-4dff-951d-3585f163139b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:34.267945 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9c80a-2c07-4dff-951d-3585f163139b None admin] RBAC: Adding query filter params (role.id=ae7cbb39ab61467ba1976a753ba6693c, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=1f4a46a051c241a2a47059052735c930) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:34.268306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9c80a-2c07-4dff-951d-3585f163139b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:34.269997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd9c80a-2c07-4dff-951d-3585f163139b None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:34.276717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 640/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:55:34 2022] GET /identity/v3/role_assignments?user.id=1f4a46a051c241a2a47059052735c930&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=ae7cbb39ab61467ba1976a753ba6693c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:36.438761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b799d4-b031-425f-9b75-22f8aab92602 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:36.439364 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b799d4-b031-425f-9b75-22f8aab92602 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:36.439364 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b799d4-b031-425f-9b75-22f8aab92602 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:36.440678 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 607/1247] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:55:36.446458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9695a9-5e58-4cb9-872e-d64273ac0a27 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:36.447029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9695a9-5e58-4cb9-872e-d64273ac0a27 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:36.447029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9695a9-5e58-4cb9-872e-d64273ac0a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:36.452458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:36.464926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1a9695a9-5e58-4cb9-872e-d64273ac0a27 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:55:36.466779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1a9695a9-5e58-4cb9-872e-d64273ac0a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:55:36.540593 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 641/1248] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:55:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:55:36.565886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b799d4-b031-425f-9b75-22f8aab92602 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:36.585943 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:36.675274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b799d4-b031-425f-9b75-22f8aab92602 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:36.715892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac889447-478d-48d0-a5a9-a4e74db2e484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:36.716655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac889447-478d-48d0-a5a9-a4e74db2e484 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:36.716905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac889447-478d-48d0-a5a9-a4e74db2e484 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:36.717182 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac889447-478d-48d0-a5a9-a4e74db2e484 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:36.728557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac889447-478d-48d0-a5a9-a4e74db2e484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-ac889447-478d-48d0-a5a9-a4e74db2e484 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:55:36.736956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:36.738957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:36.739985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:36.739985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:36.739985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:36.739985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:36.739985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:55:36.739985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:55:36.739985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:55:36.739985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:55:36.739985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:55:36.739985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:55:36.739985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:55:36.739985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:36.739985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 608/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:55:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:36.744430 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9695a9-5e58-4cb9-872e-d64273ac0a27 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:36.856822 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9695a9-5e58-4cb9-872e-d64273ac0a27 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:36.892012 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:36.899298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24cfb1-85cf-49f4-aa72-8c8437e0fecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:36.900082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24cfb1-85cf-49f4-aa72-8c8437e0fecc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:36.900388 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24cfb1-85cf-49f4-aa72-8c8437e0fecc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:36.900705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24cfb1-85cf-49f4-aa72-8c8437e0fecc None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:36.901548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24cfb1-85cf-49f4-aa72-8c8437e0fecc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:36.901916 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24cfb1-85cf-49f4-aa72-8c8437e0fecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:36.903462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24cfb1-85cf-49f4-aa72-8c8437e0fecc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:36.913583 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 642/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:55:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:36.920239 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac889447-478d-48d0-a5a9-a4e74db2e484 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:37.007009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:37.033560 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac889447-478d-48d0-a5a9-a4e74db2e484 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:37.075566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80302564-5951-4fd2-94c6-7061575662d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:37.078205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80302564-5951-4fd2-94c6-7061575662d1 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:37.078205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80302564-5951-4fd2-94c6-7061575662d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:37.078205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80302564-5951-4fd2-94c6-7061575662d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:37.090916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80302564-5951-4fd2-94c6-7061575662d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:37.092793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80302564-5951-4fd2-94c6-7061575662d1 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:37.112633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-80302564-5951-4fd2-94c6-7061575662d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:37.112633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:37.112633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:37.112633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:37.112633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:37.112633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:37.112633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:37.112633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:37.112633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:37.112633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:37.112633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:37.112633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:37.112633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:55:37.112633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:55:37.112633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:37.113711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:37.114695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:55:37.114695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:55:37.114695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:37.114695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:37.114695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 609/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:37.120252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24cfb1-85cf-49f4-aa72-8c8437e0fecc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:37.231734 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24cfb1-85cf-49f4-aa72-8c8437e0fecc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:37.270229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db476f1-9929-4a7e-931f-a1e502700425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:37.270908 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db476f1-9929-4a7e-931f-a1e502700425 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:37.271192 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db476f1-9929-4a7e-931f-a1e502700425 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:37.271467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db476f1-9929-4a7e-931f-a1e502700425 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:37.272199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db476f1-9929-4a7e-931f-a1e502700425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:37.272511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db476f1-9929-4a7e-931f-a1e502700425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:37.273983 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db476f1-9929-4a7e-931f-a1e502700425 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:37.287099 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 643/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:37.293559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80302564-5951-4fd2-94c6-7061575662d1 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:37.405673 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80302564-5951-4fd2-94c6-7061575662d1 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:37.438744 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:37.448558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe92fc-341b-407d-a314-971f4b184a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:37.449536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe92fc-341b-407d-a314-971f4b184a0d None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:37.449818 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe92fc-341b-407d-a314-971f4b184a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:37.449977 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe92fc-341b-407d-a314-971f4b184a0d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:37.459147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe92fc-341b-407d-a314-971f4b184a0d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:37.460861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe92fc-341b-407d-a314-971f4b184a0d None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8bfe92fc-341b-407d-a314-971f4b184a0d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:55:37.476559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:37.478612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:37.480231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:37.480231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:37.480231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:55:37.480231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:55:37.480231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:55:37.480231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:55:37.480231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:55:37.480231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:55:37.480231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 15:55:37.480231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:37.480231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 610/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:37.484510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db476f1-9929-4a7e-931f-a1e502700425 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:37.552712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:37.606402 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db476f1-9929-4a7e-931f-a1e502700425 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:37.647219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427580e9-6e89-4826-a801-a5e34ada085a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:37.648036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427580e9-6e89-4826-a801-a5e34ada085a None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:37.648497 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427580e9-6e89-4826-a801-a5e34ada085a None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:37.648861 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427580e9-6e89-4826-a801-a5e34ada085a None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:37.649860 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427580e9-6e89-4826-a801-a5e34ada085a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:37.650273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427580e9-6e89-4826-a801-a5e34ada085a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:37.652235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427580e9-6e89-4826-a801-a5e34ada085a None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:37.674553 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 644/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 21 15:55:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:55:37.680391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe92fc-341b-407d-a314-971f4b184a0d None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:37.794408 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe92fc-341b-407d-a314-971f4b184a0d None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:37.832862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a04b3-006a-4807-86ae-79a400698f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:37.833504 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a04b3-006a-4807-86ae-79a400698f99 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:37.833826 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a04b3-006a-4807-86ae-79a400698f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:37.834107 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a04b3-006a-4807-86ae-79a400698f99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:37.895850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:37.914841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a04b3-006a-4807-86ae-79a400698f99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:37.915616 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a04b3-006a-4807-86ae-79a400698f99 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:38.040614 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 611/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:55:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 15:55:38.047074 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427580e9-6e89-4826-a801-a5e34ada085a None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:38.161944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427580e9-6e89-4826-a801-a5e34ada085a None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:38.178873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:38.200487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70e717-48bb-4c91-ad3c-46181b39e8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:38.201295 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70e717-48bb-4c91-ad3c-46181b39e8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:38.201577 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70e717-48bb-4c91-ad3c-46181b39e8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:38.201848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70e717-48bb-4c91-ad3c-46181b39e8b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:38.220061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70e717-48bb-4c91-ad3c-46181b39e8b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:38.221558 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70e717-48bb-4c91-ad3c-46181b39e8b0 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:38.244449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-0a70e717-48bb-4c91-ad3c-46181b39e8b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:38.244449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:38.244449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:38.244449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:38.244449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:38.244449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:38.244449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:38.244449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:38.244449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:38.244449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:38.244449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:38.244449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:38.244449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:55:38.244449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:55:38.244449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:38.245536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:38.246801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:55:38.246801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:55:38.246801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:38.246801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:38.246801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 645/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:38.252285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a04b3-006a-4807-86ae-79a400698f99 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:38.355312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:38.368061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a04b3-006a-4807-86ae-79a400698f99 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:38.412331 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987a88e-b3f8-4005-81e4-c09cac6a00b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:38.412915 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987a88e-b3f8-4005-81e4-c09cac6a00b5 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:38.413192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987a88e-b3f8-4005-81e4-c09cac6a00b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:38.413459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987a88e-b3f8-4005-81e4-c09cac6a00b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:38.414237 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987a88e-b3f8-4005-81e4-c09cac6a00b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:38.414514 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987a88e-b3f8-4005-81e4-c09cac6a00b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:38.415922 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987a88e-b3f8-4005-81e4-c09cac6a00b5 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:38.432388 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 612/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:38.433726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70e717-48bb-4c91-ad3c-46181b39e8b0 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:38.541717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70e717-48bb-4c91-ad3c-46181b39e8b0 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:38.582512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bbcc7-b1a3-4faf-8b60-a244c442a2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:38.583350 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bbcc7-b1a3-4faf-8b60-a244c442a2fb None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:38.583628 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bbcc7-b1a3-4faf-8b60-a244c442a2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:38.583899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bbcc7-b1a3-4faf-8b60-a244c442a2fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:38.591058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bbcc7-b1a3-4faf-8b60-a244c442a2fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:38.592508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bbcc7-b1a3-4faf-8b60-a244c442a2fb None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:38.606589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-4c1bbcc7-b1a3-4faf-8b60-a244c442a2fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:55:38.606589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:38.606589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:38.606589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:38.606589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:38.606589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:38.606589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:38.606589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:38.606589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:38.606589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:38.606589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:38.606589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:38.606589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:55:38.606589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:55:38.606589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:38.607747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:38.608876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:55:38.608876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:55:38.608876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:55:38.608876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:55:38.608876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:55:38.608876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:55:38.608876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:55:38.608876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:38.608876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 646/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:55:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:38.614713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987a88e-b3f8-4005-81e4-c09cac6a00b5 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:38.754190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987a88e-b3f8-4005-81e4-c09cac6a00b5 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:38.789245 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab0bea-e5a7-40f8-b692-d18a43338239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:38.789922 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab0bea-e5a7-40f8-b692-d18a43338239 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:38.790202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab0bea-e5a7-40f8-b692-d18a43338239 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:38.790481 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab0bea-e5a7-40f8-b692-d18a43338239 None admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:38.791317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab0bea-e5a7-40f8-b692-d18a43338239 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:38.791623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab0bea-e5a7-40f8-b692-d18a43338239 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:38.793245 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab0bea-e5a7-40f8-b692-d18a43338239 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:38.807603 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 613/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:55:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:38.814078 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bbcc7-b1a3-4faf-8b60-a244c442a2fb None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:38.843566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:38.940210 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bbcc7-b1a3-4faf-8b60-a244c442a2fb None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:38.986256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb69359-b935-4c20-b9ac-769f112f0f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:38.987296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb69359-b935-4c20-b9ac-769f112f0f07 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:38.987580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb69359-b935-4c20-b9ac-769f112f0f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:38.987858 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb69359-b935-4c20-b9ac-769f112f0f07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:38.988710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb69359-b935-4c20-b9ac-769f112f0f07 None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=1f4a46a051c241a2a47059052735c930) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:38.989026 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb69359-b935-4c20-b9ac-769f112f0f07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:38.990489 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb69359-b935-4c20-b9ac-769f112f0f07 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:39.000240 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 647/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:55:38 2022] GET /identity/v3/role_assignments?user.id=1f4a46a051c241a2a47059052735c930&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:55:41.066162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b244bb-eda9-4a11-87a9-b7137ab3733a None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:41.066762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b244bb-eda9-4a11-87a9-b7137ab3733a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:41.066762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b244bb-eda9-4a11-87a9-b7137ab3733a None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:41.068185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 614/1261] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:55:41.076132 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaefddb-a4cb-465d-9bc2-799102974775 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:41.076628 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaefddb-a4cb-465d-9bc2-799102974775 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:41.076920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaefddb-a4cb-465d-9bc2-799102974775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:41.094388 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ebaefddb-a4cb-465d-9bc2-799102974775 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:55:41.095719 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ebaefddb-a4cb-465d-9bc2-799102974775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:55:41.169181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 648/1262] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:55:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:55:41.195701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b244bb-eda9-4a11-87a9-b7137ab3733a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:41.207581 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:41.320297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b244bb-eda9-4a11-87a9-b7137ab3733a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:41.357027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df6f17-2ecd-4271-a474-1045b8f25e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:41.357849 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df6f17-2ecd-4271-a474-1045b8f25e84 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:41.358126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df6f17-2ecd-4271-a474-1045b8f25e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:41.358394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df6f17-2ecd-4271-a474-1045b8f25e84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:41.377049 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0df6f17-2ecd-4271-a474-1045b8f25e84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-f0df6f17-2ecd-4271-a474-1045b8f25e84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:55:41.384725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:41.385865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:41.386870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:41.386870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:41.386870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:41.386870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:41.386870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:55:41.386870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:55:41.386870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:55:41.386870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:55:41.386870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:55:41.386870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:55:41.386870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:55:41.386870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:41.386870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 615/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:55:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:41.393614 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaefddb-a4cb-465d-9bc2-799102974775 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:41.419713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:41.505442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaefddb-a4cb-465d-9bc2-799102974775 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:41.542038 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed397651-3b35-4915-a23d-11a0e7ab3cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:41.542695 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed397651-3b35-4915-a23d-11a0e7ab3cbc None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:41.543029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed397651-3b35-4915-a23d-11a0e7ab3cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:41.543304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed397651-3b35-4915-a23d-11a0e7ab3cbc None admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:41.544062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed397651-3b35-4915-a23d-11a0e7ab3cbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:41.544374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed397651-3b35-4915-a23d-11a0e7ab3cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:41.545774 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed397651-3b35-4915-a23d-11a0e7ab3cbc None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:41.554625 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 649/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:55:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:41.560652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df6f17-2ecd-4271-a474-1045b8f25e84 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:41.635979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:41.677485 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df6f17-2ecd-4271-a474-1045b8f25e84 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:41.714748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08c71e-c8ef-493e-8263-cc87dae46e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:41.715945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08c71e-c8ef-493e-8263-cc87dae46e9e None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:41.716284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08c71e-c8ef-493e-8263-cc87dae46e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:41.716625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08c71e-c8ef-493e-8263-cc87dae46e9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:41.729423 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08c71e-c8ef-493e-8263-cc87dae46e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:41.730943 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08c71e-c8ef-493e-8263-cc87dae46e9e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:41.749282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-0b08c71e-c8ef-493e-8263-cc87dae46e9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:41.749282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:41.749282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:41.749282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:41.749282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:41.749282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:41.749282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:41.749282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:41.749282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:41.749282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:41.749282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:41.749282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:41.749282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:55:41.749282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:55:41.749282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:41.750395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:41.751592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:55:41.751592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:55:41.751592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:41.751592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:41.751592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 616/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:41.756899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed397651-3b35-4915-a23d-11a0e7ab3cbc None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:41.848312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:41.875472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed397651-3b35-4915-a23d-11a0e7ab3cbc None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:41.914998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21834e31-62a6-4a59-bf73-2e339b3f205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:41.915708 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21834e31-62a6-4a59-bf73-2e339b3f205e None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:41.915998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21834e31-62a6-4a59-bf73-2e339b3f205e None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:41.916270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21834e31-62a6-4a59-bf73-2e339b3f205e None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:41.917011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21834e31-62a6-4a59-bf73-2e339b3f205e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:41.917316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21834e31-62a6-4a59-bf73-2e339b3f205e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:41.918756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21834e31-62a6-4a59-bf73-2e339b3f205e None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:41.932935 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 650/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:41.939402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08c71e-c8ef-493e-8263-cc87dae46e9e None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:42.052314 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08c71e-c8ef-493e-8263-cc87dae46e9e None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:42.072763 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:42.088114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0cbf4-7ee9-4770-a706-32e3da5652db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:42.088929 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0cbf4-7ee9-4770-a706-32e3da5652db None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:42.089208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0cbf4-7ee9-4770-a706-32e3da5652db None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:42.089483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0cbf4-7ee9-4770-a706-32e3da5652db None admin] PATH_INFO: `/v3/users/placement` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:42.097480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0cbf4-7ee9-4770-a706-32e3da5652db None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:42.098963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0cbf4-7ee9-4770-a706-32e3da5652db None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-15f0cbf4-7ee9-4770-a706-32e3da5652db None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:55:42.114153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:42.115215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:42.116263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:42.116263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:42.116263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:55:42.116263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:55:42.116263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:55:42.116263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:55:42.116263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:55:42.116263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:55:42.116263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 15:55:42.116263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:42.116263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 617/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 15:55:42.121671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21834e31-62a6-4a59-bf73-2e339b3f205e None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:42.231302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21834e31-62a6-4a59-bf73-2e339b3f205e None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:42.267492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c806b9-a0c6-481c-a262-d70022b8ad32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:42.268163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c806b9-a0c6-481c-a262-d70022b8ad32 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:42.268447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c806b9-a0c6-481c-a262-d70022b8ad32 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:42.268723 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c806b9-a0c6-481c-a262-d70022b8ad32 None admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:42.269568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c806b9-a0c6-481c-a262-d70022b8ad32 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:42.269878 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c806b9-a0c6-481c-a262-d70022b8ad32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:42.271354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c806b9-a0c6-481c-a262-d70022b8ad32 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:42.280835 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:42.290605 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 651/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 21 15:55:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:42.296680 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0cbf4-7ee9-4770-a706-32e3da5652db None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:42.418296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0cbf4-7ee9-4770-a706-32e3da5652db None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:42.454928 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5da6ab-3527-4ab0-b885-b1b79874e290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:42.455624 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5da6ab-3527-4ab0-b885-b1b79874e290 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:42.455934 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5da6ab-3527-4ab0-b885-b1b79874e290 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:42.456215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5da6ab-3527-4ab0-b885-b1b79874e290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:42.467657 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5da6ab-3527-4ab0-b885-b1b79874e290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:42.469122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5da6ab-3527-4ab0-b885-b1b79874e290 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:42.492719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-8b5da6ab-3527-4ab0-b885-b1b79874e290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:42.492719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:42.492719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:42.492719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:42.492719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:42.492719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:42.492719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:42.492719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:42.492719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:42.492719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:42.492719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:42.492719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:42.492719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:55:42.492719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:55:42.492719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:42.493847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:42.494793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:55:42.494793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:55:42.494793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:42.494793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:42.494793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 618/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:42.500980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c806b9-a0c6-481c-a262-d70022b8ad32 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:42.611852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c806b9-a0c6-481c-a262-d70022b8ad32 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:42.651230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72489fd-981d-447e-a41e-ca25919ba38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:42.651914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72489fd-981d-447e-a41e-ca25919ba38c None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:42.652194 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72489fd-981d-447e-a41e-ca25919ba38c None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:42.652470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72489fd-981d-447e-a41e-ca25919ba38c None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:42.653202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72489fd-981d-447e-a41e-ca25919ba38c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:42.653509 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72489fd-981d-447e-a41e-ca25919ba38c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:42.654888 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72489fd-981d-447e-a41e-ca25919ba38c None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:42.667731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 652/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:42.673657 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5da6ab-3527-4ab0-b885-b1b79874e290 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:42.711216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:42.796685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5da6ab-3527-4ab0-b885-b1b79874e290 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:42.837559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aaa97-e986-4e4d-95c6-083ebde750cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:42.838360 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aaa97-e986-4e4d-95c6-083ebde750cf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:42.838635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aaa97-e986-4e4d-95c6-083ebde750cf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:42.838938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438aaa97-e986-4e4d-95c6-083ebde750cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:42.849825 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aaa97-e986-4e4d-95c6-083ebde750cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:42.851337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438aaa97-e986-4e4d-95c6-083ebde750cf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:42.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-438aaa97-e986-4e4d-95c6-083ebde750cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:55:42.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:42.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:42.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:42.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:42.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:42.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:42.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:42.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:42.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:42.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:42.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:42.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:55:42.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:55:42.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:42.872724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:42.874531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:55:42.874531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:55:42.874531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:55:42.874531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:55:42.874531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:55:42.874531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:55:42.874531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:55:42.874531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:42.874531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 619/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:55:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:42.878783 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72489fd-981d-447e-a41e-ca25919ba38c None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:42.944881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:42.992206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72489fd-981d-447e-a41e-ca25919ba38c None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:43.029174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891904c-4a37-4ea3-9591-e45da5948bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:43.029829 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891904c-4a37-4ea3-9591-e45da5948bba None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:43.030112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891904c-4a37-4ea3-9591-e45da5948bba None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:43.030384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891904c-4a37-4ea3-9591-e45da5948bba None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:43.031208 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891904c-4a37-4ea3-9591-e45da5948bba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:43.031518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891904c-4a37-4ea3-9591-e45da5948bba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:43.033031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891904c-4a37-4ea3-9591-e45da5948bba None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:43.046597 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 653/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:55:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:43.053138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aaa97-e986-4e4d-95c6-083ebde750cf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:43.149076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:43.158469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438aaa97-e986-4e4d-95c6-083ebde750cf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:43.196282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e375b5-7573-45a8-b339-95007ed2438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:43.197190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e375b5-7573-45a8-b339-95007ed2438e None admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:43.197486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e375b5-7573-45a8-b339-95007ed2438e None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:43.197756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e375b5-7573-45a8-b339-95007ed2438e None admin] PATH_INFO: `/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/1f4a46a051c241a2a47059052735c930/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:43.205392 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e375b5-7573-45a8-b339-95007ed2438e None admin] RBAC: Authorizing `identity:create_grant(project_id=0d717ed2993d4a3ab21195028a16e747, user_id=1f4a46a051c241a2a47059052735c930, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:43.207075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e375b5-7573-45a8-b339-95007ed2438e None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:43.227196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 620/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Jul 21 15:55:43 2022] PUT /identity/v3/projects/0d717ed2993d4a3ab21195028a16e747/users/1f4a46a051c241a2a47059052735c930/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 15:55:45.301251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7b790-3bf7-47fa-9d5c-b8d1d1e3675c None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:45.301913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7b790-3bf7-47fa-9d5c-b8d1d1e3675c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:45.301913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7b790-3bf7-47fa-9d5c-b8d1d1e3675c None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:45.303256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 654/1274] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:55:45.309073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e64732-ba50-4dc5-a60c-5f61783a8fd8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:45.309541 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e64732-ba50-4dc5-a60c-5f61783a8fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:45.309652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e64732-ba50-4dc5-a60c-5f61783a8fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:45.327989 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-43e64732-ba50-4dc5-a60c-5f61783a8fd8 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:55:45.329348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-43e64732-ba50-4dc5-a60c-5f61783a8fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:55:45.402234 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 621/1275] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:55:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:55:45.426303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7b790-3bf7-47fa-9d5c-b8d1d1e3675c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:45.544260 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7b790-3bf7-47fa-9d5c-b8d1d1e3675c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:45.562468 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:45.582188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce86983-b331-44fb-b7ae-f7e6a8da7dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:45.583037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce86983-b331-44fb-b7ae-f7e6a8da7dbf None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:45.583321 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce86983-b331-44fb-b7ae-f7e6a8da7dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:45.583595 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce86983-b331-44fb-b7ae-f7e6a8da7dbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:45.595740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce86983-b331-44fb-b7ae-f7e6a8da7dbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-9ce86983-b331-44fb-b7ae-f7e6a8da7dbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 15:55:45.603384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:45.604530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:45.605443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:45.605443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:45.605443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:45.605443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:45.605443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 15:55:45.605443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 15:55:45.605443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 15:55:45.605443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 15:55:45.605443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 15:55:45.605443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 15:55:45.605443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 15:55:45.605443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:45.605443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 655/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Jul 21 15:55:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:45.611560 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e64732-ba50-4dc5-a60c-5f61783a8fd8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:45.695940 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:45.716725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e64732-ba50-4dc5-a60c-5f61783a8fd8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:45.751979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd910189-bf7c-4a48-ad58-1c615f0bec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:45.752644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd910189-bf7c-4a48-ad58-1c615f0bec31 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:45.752924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd910189-bf7c-4a48-ad58-1c615f0bec31 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:45.753190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd910189-bf7c-4a48-ad58-1c615f0bec31 None admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:45.753952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd910189-bf7c-4a48-ad58-1c615f0bec31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:45.754256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd910189-bf7c-4a48-ad58-1c615f0bec31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:45.755707 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd910189-bf7c-4a48-ad58-1c615f0bec31 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:45.764903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 622/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Jul 21 15:55:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:45.771108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce86983-b331-44fb-b7ae-f7e6a8da7dbf None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:45.880933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce86983-b331-44fb-b7ae-f7e6a8da7dbf None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:45.926066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6aee99-8511-4950-a3c1-6088c7b110d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:45.926920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aee99-8511-4950-a3c1-6088c7b110d3 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:45.927235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aee99-8511-4950-a3c1-6088c7b110d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:45.927508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aee99-8511-4950-a3c1-6088c7b110d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:45.939770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6aee99-8511-4950-a3c1-6088c7b110d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:45.941267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6aee99-8511-4950-a3c1-6088c7b110d3 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:45.962077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-0a6aee99-8511-4950-a3c1-6088c7b110d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:45.962077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:45.962077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:45.962077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:45.962077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:45.962077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:45.962077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:45.962077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:45.962077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:45.962077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:45.962077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:45.962077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:45.962077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:55:45.962077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:55:45.962077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:45.963949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:45.965484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:55:45.965484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:55:45.965484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:45.965484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:45.965484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 656/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:45.969650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd910189-bf7c-4a48-ad58-1c615f0bec31 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:46.087496 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd910189-bf7c-4a48-ad58-1c615f0bec31 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:46.124895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160cff1-f1cb-49f2-b09a-0ddd22b85040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:46.126418 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160cff1-f1cb-49f2-b09a-0ddd22b85040 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:46.127137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160cff1-f1cb-49f2-b09a-0ddd22b85040 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:46.127740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160cff1-f1cb-49f2-b09a-0ddd22b85040 None admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:46.128481 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160cff1-f1cb-49f2-b09a-0ddd22b85040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:46.128882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160cff1-f1cb-49f2-b09a-0ddd22b85040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:46.130374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160cff1-f1cb-49f2-b09a-0ddd22b85040 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:46.143127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 623/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:46.149083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6aee99-8511-4950-a3c1-6088c7b110d3 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:46.192337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:46.280578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6aee99-8511-4950-a3c1-6088c7b110d3 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:46.316717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdf987-d8f3-4dd1-8caf-a93d64696402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:46.317528 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdf987-d8f3-4dd1-8caf-a93d64696402 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:46.317809 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdf987-d8f3-4dd1-8caf-a93d64696402 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:46.318079 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdf987-d8f3-4dd1-8caf-a93d64696402 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:46.326351 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdf987-d8f3-4dd1-8caf-a93d64696402 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:46.327827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fdf987-d8f3-4dd1-8caf-a93d64696402 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-d5fdf987-d8f3-4dd1-8caf-a93d64696402 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 15:55:46.342569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:46.343730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:46.344834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:46.344834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:46.344834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 15:55:46.344834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 15:55:46.344834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 15:55:46.344834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 15:55:46.344834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 15:55:46.344834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 15:55:46.344834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 15:55:46.344834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:46.344834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 657/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:46.350087 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160cff1-f1cb-49f2-b09a-0ddd22b85040 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:46.354308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:46.466970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160cff1-f1cb-49f2-b09a-0ddd22b85040 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:46.503217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c48c0c-ec6a-4bd8-a79a-8608232fb6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:46.503903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c48c0c-ec6a-4bd8-a79a-8608232fb6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:46.504181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c48c0c-ec6a-4bd8-a79a-8608232fb6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:46.504461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c48c0c-ec6a-4bd8-a79a-8608232fb6d6 None admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:46.505356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c48c0c-ec6a-4bd8-a79a-8608232fb6d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:46.505795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c48c0c-ec6a-4bd8-a79a-8608232fb6d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:46.507606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c48c0c-ec6a-4bd8-a79a-8608232fb6d6 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:46.530153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 624/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Jul 21 15:55:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:46.536258 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdf987-d8f3-4dd1-8caf-a93d64696402 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:46.639059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:46.649863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fdf987-d8f3-4dd1-8caf-a93d64696402 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:46.686227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7de8d-25a6-4b3c-9355-5a3b0be75a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:46.686922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7de8d-25a6-4b3c-9355-5a3b0be75a09 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:46.687207 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7de8d-25a6-4b3c-9355-5a3b0be75a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:46.687488 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7de8d-25a6-4b3c-9355-5a3b0be75a09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:46.776489 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7de8d-25a6-4b3c-9355-5a3b0be75a09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:46.778572 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7de8d-25a6-4b3c-9355-5a3b0be75a09 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:46.876204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:46.888841 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 658/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Jul 21 15:55:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 15:55:46.896309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c48c0c-ec6a-4bd8-a79a-8608232fb6d6 None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:46.971755 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:47.014353 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c48c0c-ec6a-4bd8-a79a-8608232fb6d6 None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:47.051413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8286529-3f70-47ec-8ebd-5b2845c7982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:47.052117 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8286529-3f70-47ec-8ebd-5b2845c7982c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:47.052396 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8286529-3f70-47ec-8ebd-5b2845c7982c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:47.052666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8286529-3f70-47ec-8ebd-5b2845c7982c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:47.067209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8286529-3f70-47ec-8ebd-5b2845c7982c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:47.068700 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8286529-3f70-47ec-8ebd-5b2845c7982c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:47.088014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-d8286529-3f70-47ec-8ebd-5b2845c7982c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:47.088014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:47.088014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:47.088014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:47.088014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:47.088014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:47.088014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:47.088014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:47.088014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:47.088014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:47.088014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:47.088014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:47.088014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 15:55:47.088014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 15:55:47.088014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:47.089164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:47.090336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 15:55:47.090336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 15:55:47.090336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 15:55:47.090336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:47.090336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 625/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:55:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:47.096010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7de8d-25a6-4b3c-9355-5a3b0be75a09 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:47.207698 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7de8d-25a6-4b3c-9355-5a3b0be75a09 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:47.247446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c846b5-a7ca-41b5-99bb-1c4c12cc4253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:47.248127 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c846b5-a7ca-41b5-99bb-1c4c12cc4253 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:47.248405 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c846b5-a7ca-41b5-99bb-1c4c12cc4253 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:47.248677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c846b5-a7ca-41b5-99bb-1c4c12cc4253 None admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:47.249404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c846b5-a7ca-41b5-99bb-1c4c12cc4253 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:47.249709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c846b5-a7ca-41b5-99bb-1c4c12cc4253 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:47.251142 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c846b5-a7ca-41b5-99bb-1c4c12cc4253 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:47.268259 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 659/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Jul 21 15:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:47.274304 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8286529-3f70-47ec-8ebd-5b2845c7982c None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:47.382870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8286529-3f70-47ec-8ebd-5b2845c7982c None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:47.397939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:47.424103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb361673-75fb-4327-871d-ec09edc6a7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:47.424911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb361673-75fb-4327-871d-ec09edc6a7cf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:47.425172 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb361673-75fb-4327-871d-ec09edc6a7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:47.425451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb361673-75fb-4327-871d-ec09edc6a7cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:47.432726 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb361673-75fb-4327-871d-ec09edc6a7cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:47.434185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb361673-75fb-4327-871d-ec09edc6a7cf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:47.448248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application [None req-fb361673-75fb-4327-871d-ec09edc6a7cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:55:47.448248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:47.448248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:47.448248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:47.448248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:47.448248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:47.448248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:47.448248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:47.448248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:47.448248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:47.448248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:47.448248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:47.448248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 15:55:47.448248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 15:55:47.448248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:47.449316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:47.450672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 15:55:47.450672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 15:55:47.450672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 15:55:47.450672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 15:55:47.450672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 15:55:47.450672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 15:55:47.450672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 15:55:47.450672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: ERROR keystone.server.flask.application Jul 21 15:55:47.450672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 626/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Jul 21 15:55:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:47.455825 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c846b5-a7ca-41b5-99bb-1c4c12cc4253 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:47.507694 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:47.568665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c846b5-a7ca-41b5-99bb-1c4c12cc4253 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:47.604622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5cef8-ded3-46b8-b23f-fbe466de5c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:47.605300 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5cef8-ded3-46b8-b23f-fbe466de5c70 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:47.605583 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5cef8-ded3-46b8-b23f-fbe466de5c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:47.605859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5cef8-ded3-46b8-b23f-fbe466de5c70 None admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:47.606665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5cef8-ded3-46b8-b23f-fbe466de5c70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:47.607004 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5cef8-ded3-46b8-b23f-fbe466de5c70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:47.608443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5cef8-ded3-46b8-b23f-fbe466de5c70 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:47.621263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 660/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Jul 21 15:55:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:47.629086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb361673-75fb-4327-871d-ec09edc6a7cf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:47.740164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb361673-75fb-4327-871d-ec09edc6a7cf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:47.775443 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1d912e-bebf-44b1-807a-3e3b6d6022e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:47.776077 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d912e-bebf-44b1-807a-3e3b6d6022e4 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:47.776370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d912e-bebf-44b1-807a-3e3b6d6022e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:47.776629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1d912e-bebf-44b1-807a-3e3b6d6022e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:47.777463 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d912e-bebf-44b1-807a-3e3b6d6022e4 None admin] RBAC: Adding query filter params (role.id=2f14a93ae652476f8bc01915f4fd4f93, scope.project.id=0d717ed2993d4a3ab21195028a16e747, user.id=1f4a46a051c241a2a47059052735c930) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:47.777775 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d912e-bebf-44b1-807a-3e3b6d6022e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:47.779242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1d912e-bebf-44b1-807a-3e3b6d6022e4 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:47.792582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 627/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Jul 21 15:55:47 2022] GET /identity/v3/role_assignments?user.id=1f4a46a051c241a2a47059052735c930&scope.project.id=0d717ed2993d4a3ab21195028a16e747&role.id=2f14a93ae652476f8bc01915f4fd4f93 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:49.837288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc2693-6ab8-447b-a7ed-94fb78c90057 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:49.837859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc2693-6ab8-447b-a7ed-94fb78c90057 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:49.837859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc2693-6ab8-447b-a7ed-94fb78c90057 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:49.839263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 661/1288] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:55:49.844979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3543d8-f51b-4dc2-83f9-336146202050 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:49.845458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3543d8-f51b-4dc2-83f9-336146202050 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:49.845557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3543d8-f51b-4dc2-83f9-336146202050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:49.863896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4d3543d8-f51b-4dc2-83f9-336146202050 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:55:49.865133 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4d3543d8-f51b-4dc2-83f9-336146202050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:55:49.900027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:49.946994 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 628/1289] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:55:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:55:49.969880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc2693-6ab8-447b-a7ed-94fb78c90057 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:50.082082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc2693-6ab8-447b-a7ed-94fb78c90057 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:50.094623 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:50.121543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd16ee-32d3-4856-9ba5-4c268ad2ae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:50.122353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd16ee-32d3-4856-9ba5-4c268ad2ae11 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:50.122632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd16ee-32d3-4856-9ba5-4c268ad2ae11 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:50.122947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd16ee-32d3-4856-9ba5-4c268ad2ae11 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:50.123607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd16ee-32d3-4856-9ba5-4c268ad2ae11 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:50.124989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd16ee-32d3-4856-9ba5-4c268ad2ae11 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-f4dd16ee-32d3-4856-9ba5-4c268ad2ae11 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:50.137543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:50.138842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:50.139757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:50.139757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:50.139757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:50.139757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:50.139757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:50.139757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:50.139757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:50.139757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:50.139757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:50.139757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:50.139757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:55:50.139757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:55:50.139757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 15:55:50.139757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:50.139757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 662/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 15:55:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:50.145387 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3543d8-f51b-4dc2-83f9-336146202050 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:50.251456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3543d8-f51b-4dc2-83f9-336146202050 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:50.291511 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096ec6ad-e0e1-4631-b80e-b8a442bd71ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:50.292174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ec6ad-e0e1-4631-b80e-b8a442bd71ff None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:50.292450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ec6ad-e0e1-4631-b80e-b8a442bd71ff None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:50.292721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096ec6ad-e0e1-4631-b80e-b8a442bd71ff None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:50.293427 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ec6ad-e0e1-4631-b80e-b8a442bd71ff None admin] RBAC: Adding query filter params (name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:50.293728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ec6ad-e0e1-4631-b80e-b8a442bd71ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:50.295136 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096ec6ad-e0e1-4631-b80e-b8a442bd71ff None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:50.300262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 629/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 21 15:55:50 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:50.306427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd16ee-32d3-4856-9ba5-4c268ad2ae11 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:50.417567 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd16ee-32d3-4856-9ba5-4c268ad2ae11 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:50.459318 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a35428-ea41-4b61-944a-60ab78662a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:50.460002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a35428-ea41-4b61-944a-60ab78662a85 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:50.460280 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a35428-ea41-4b61-944a-60ab78662a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:50.460555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a35428-ea41-4b61-944a-60ab78662a85 None admin] PATH_INFO: `/v3/services` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:50.461291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a35428-ea41-4b61-944a-60ab78662a85 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:50.461600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a35428-ea41-4b61-944a-60ab78662a85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:50.463052 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a35428-ea41-4b61-944a-60ab78662a85 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:50.468817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 663/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 21 15:55:50 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:52.465539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503c0fc-3525-4b42-8fcc-fddc773ae19e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:52.466074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503c0fc-3525-4b42-8fcc-fddc773ae19e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:52.466074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503c0fc-3525-4b42-8fcc-fddc773ae19e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:52.467537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 630/1293] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:55:52.473804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f1de-aea1-449b-84fc-da7d14e81e2a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:52.474248 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f1de-aea1-449b-84fc-da7d14e81e2a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:52.474369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f1de-aea1-449b-84fc-da7d14e81e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:52.492714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a588f1de-aea1-449b-84fc-da7d14e81e2a None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:55:52.493930 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a588f1de-aea1-449b-84fc-da7d14e81e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:55:52.524122 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:52.565524 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 664/1294] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:55:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 15:55:52.589885 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503c0fc-3525-4b42-8fcc-fddc773ae19e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:52.624581 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:52.709034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503c0fc-3525-4b42-8fcc-fddc773ae19e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:52.745628 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0886a4-27bf-4b4e-afe4-0a97cf90b4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:52.746102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0886a4-27bf-4b4e-afe4-0a97cf90b4bb None admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:52.746387 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0886a4-27bf-4b4e-afe4-0a97cf90b4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:52.746663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0886a4-27bf-4b4e-afe4-0a97cf90b4bb None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:52.747427 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0886a4-27bf-4b4e-afe4-0a97cf90b4bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:52.748819 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0886a4-27bf-4b4e-afe4-0a97cf90b4bb None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:52.763557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 631/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Jul 21 15:55:52 2022] POST /identity/v3/services => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:55:54.828483 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e89df-bec5-46f9-a3df-c2f11afb7c07 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:54.829079 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e89df-bec5-46f9-a3df-c2f11afb7c07 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:54.829079 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e89df-bec5-46f9-a3df-c2f11afb7c07 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:54.830422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 665/1296] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:55:54.836023 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481d5fd-f4cb-40e6-b531-9a205f2bb7bb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:54.836491 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481d5fd-f4cb-40e6-b531-9a205f2bb7bb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:54.836582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481d5fd-f4cb-40e6-b531-9a205f2bb7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:54.854742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a481d5fd-f4cb-40e6-b531-9a205f2bb7bb None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:55:54.856005 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a481d5fd-f4cb-40e6-b531-9a205f2bb7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:55:54.953407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 632/1297] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:55:54 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:55:54.983077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e89df-bec5-46f9-a3df-c2f11afb7c07 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:55.097954 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e89df-bec5-46f9-a3df-c2f11afb7c07 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:55.133599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68aef1-e42c-42b6-a770-a47270f79730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:55.134414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68aef1-e42c-42b6-a770-a47270f79730 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:55.134694 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68aef1-e42c-42b6-a770-a47270f79730 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:55.134986 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68aef1-e42c-42b6-a770-a47270f79730 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:55.135644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68aef1-e42c-42b6-a770-a47270f79730 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:55.137076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68aef1-e42c-42b6-a770-a47270f79730 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-be68aef1-e42c-42b6-a770-a47270f79730 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:55.151922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:55.153110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:55.154001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:55.154001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:55.154001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:55.154001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:55.154001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:55.154001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:55.154001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:55.154001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:55.154001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:55.154001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:55.154001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:55:55.154001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:55:55.154001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 15:55:55.154001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:55.154001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 666/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 15:55:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:55.159551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481d5fd-f4cb-40e6-b531-9a205f2bb7bb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:55.178153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:55.283478 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481d5fd-f4cb-40e6-b531-9a205f2bb7bb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:55.320919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1d008-e826-40a9-9886-405bfce27bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:55.321591 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1d008-e826-40a9-9886-405bfce27bbf None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:55.321867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1d008-e826-40a9-9886-405bfce27bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:55.322143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1d008-e826-40a9-9886-405bfce27bbf None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:55.322848 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1d008-e826-40a9-9886-405bfce27bbf None admin] RBAC: Adding query filter params (name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:55.323190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1d008-e826-40a9-9886-405bfce27bbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:55.324596 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d1d008-e826-40a9-9886-405bfce27bbf None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:55.330430 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 633/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 21 15:55:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 15:55:55.336726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68aef1-e42c-42b6-a770-a47270f79730 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:55.371540 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:55.448348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68aef1-e42c-42b6-a770-a47270f79730 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:55.484119 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496dbb70-843e-4477-ab22-95f9f4ea4fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:55.484970 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dbb70-843e-4477-ab22-95f9f4ea4fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:55.485116 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dbb70-843e-4477-ab22-95f9f4ea4fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:55.485342 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496dbb70-843e-4477-ab22-95f9f4ea4fd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:55.486461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496dbb70-843e-4477-ab22-95f9f4ea4fd9 None admin] RBAC: Adding query filter params (interface=public, service_id=05c55d6285f944a8af5e6790711daa0b, region_id=RegionOne) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:55.486765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496dbb70-843e-4477-ab22-95f9f4ea4fd9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:55.488193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496dbb70-843e-4477-ab22-95f9f4ea4fd9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:55.495969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 667/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Jul 21 15:55:55 2022] GET /identity/v3/endpoints?service_id=05c55d6285f944a8af5e6790711daa0b&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:55.501968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1d008-e826-40a9-9886-405bfce27bbf None admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:55.589009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:55.608196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1d008-e826-40a9-9886-405bfce27bbf None admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:55.645257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3a6bd-1d04-4c7b-9752-3f95932e633c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:55.646195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3a6bd-1d04-4c7b-9752-3f95932e633c None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:55.646518 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3a6bd-1d04-4c7b-9752-3f95932e633c None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:55.646790 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3a6bd-1d04-4c7b-9752-3f95932e633c None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:55.647510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3a6bd-1d04-4c7b-9752-3f95932e633c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:55.648906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3a6bd-1d04-4c7b-9752-3f95932e633c None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:55.656099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 634/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Jul 21 15:55:55 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 15:55:57.653889 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259ce18-2771-450a-bfbf-8ce560878bbe None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:57.654444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259ce18-2771-450a-bfbf-8ce560878bbe None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:57.654444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259ce18-2771-450a-bfbf-8ce560878bbe None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:57.655812 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 668/1302] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:55:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:55:57.662076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e24ed2-708d-49b7-ad50-e1bc43353d35 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:57.662522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e24ed2-708d-49b7-ad50-e1bc43353d35 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:57.662635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e24ed2-708d-49b7-ad50-e1bc43353d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:57.680190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-13e24ed2-708d-49b7-ad50-e1bc43353d35 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:55:57.681399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-13e24ed2-708d-49b7-ad50-e1bc43353d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:55:57.753366 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 635/1303] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:55:57 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 15:55:57.776840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259ce18-2771-450a-bfbf-8ce560878bbe None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:57.887735 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:57.897556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259ce18-2771-450a-bfbf-8ce560878bbe None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:57.934338 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67267318-042f-4b98-8bc8-70aaa50ef4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:57.935179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67267318-042f-4b98-8bc8-70aaa50ef4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:57.935467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67267318-042f-4b98-8bc8-70aaa50ef4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:57.935733 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67267318-042f-4b98-8bc8-70aaa50ef4a9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:57.936396 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67267318-042f-4b98-8bc8-70aaa50ef4a9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:57.937824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67267318-042f-4b98-8bc8-70aaa50ef4a9 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application [None req-67267318-042f-4b98-8bc8-70aaa50ef4a9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 15:55:57.950100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 15:55:57.951353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 15:55:57.952529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 15:55:57.952529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application with Lock( Jul 21 15:55:57.952529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 15:55:57.952529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self._enter() Jul 21 15:55:57.952529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 15:55:57.952529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 15:55:57.952529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 15:55:57.952529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application return self.creator() Jul 21 15:55:57.952529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 15:55:57.952529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application created_value = creator( Jul 21 15:55:57.952529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 15:55:57.952529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 15:55:57.952529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 15:55:57.952529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: ERROR keystone.server.flask.application Jul 21 15:55:57.952529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 669/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Jul 21 15:55:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 15:55:57.957640 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e24ed2-708d-49b7-ad50-e1bc43353d35 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:58.042271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:55:58.072982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e24ed2-708d-49b7-ad50-e1bc43353d35 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:58.110155 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cde020-5555-4cdf-a9f4-237bffa0bd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:58.111215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cde020-5555-4cdf-a9f4-237bffa0bd72 None admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:58.111502 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cde020-5555-4cdf-a9f4-237bffa0bd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:58.111777 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cde020-5555-4cdf-a9f4-237bffa0bd72 None admin] PATH_INFO: `/v3/services` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:58.112493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cde020-5555-4cdf-a9f4-237bffa0bd72 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 15:55:58.112802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cde020-5555-4cdf-a9f4-237bffa0bd72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:58.114195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cde020-5555-4cdf-a9f4-237bffa0bd72 None admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:58.119701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 636/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Jul 21 15:55:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 15:55:58.125811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67267318-042f-4b98-8bc8-70aaa50ef4a9 None admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:55:58.238581 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67267318-042f-4b98-8bc8-70aaa50ef4a9 None admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:55:58.275501 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01ca71-16dd-4def-ad4d-899832cb82f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:55:58.276162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01ca71-16dd-4def-ad4d-899832cb82f5 None admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:55:58.276439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01ca71-16dd-4def-ad4d-899832cb82f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:55:58.276711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01ca71-16dd-4def-ad4d-899832cb82f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:55:58.277447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01ca71-16dd-4def-ad4d-899832cb82f5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:55:58.278852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01ca71-16dd-4def-ad4d-899832cb82f5 None admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:55:58.298837 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 670/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Jul 21 15:55:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 15:56:08.116499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=30 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:56:08.294223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:01.632799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4c0f2-fd45-4f8b-a01e-da02bb1f62cc None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:01.633388 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4c0f2-fd45-4f8b-a01e-da02bb1f62cc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:01.633388 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4c0f2-fd45-4f8b-a01e-da02bb1f62cc None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:01.634699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 637/1307] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:01.639919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e88ae3-3378-47e8-9027-cd270dfde7fc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:01.640366 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e88ae3-3378-47e8-9027-cd270dfde7fc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:01.640457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e88ae3-3378-47e8-9027-cd270dfde7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:01.789241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d2e88ae3-3378-47e8-9027-cd270dfde7fc None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:01.790775 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d2e88ae3-3378-47e8-9027-cd270dfde7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:02.011113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 671/1308] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:02.053953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299cd14-0c48-43d1-a26e-627da9736029 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:02.054316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299cd14-0c48-43d1-a26e-627da9736029 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:02.054544 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299cd14-0c48-43d1-a26e-627da9736029 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:02.056338 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 638/1309] 10.222.0.64 () {54 vars in 965 bytes} [Thu Jul 21 15:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:02.062621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b550c63-9fa3-42a1-8e29-a0c9ab8c9af3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:02.062997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b550c63-9fa3-42a1-8e29-a0c9ab8c9af3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:02.063344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b550c63-9fa3-42a1-8e29-a0c9ab8c9af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:02.142647 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8b550c63-9fa3-42a1-8e29-a0c9ab8c9af3 None None] MFA Rules not processed for user `1b46a82ffe92437fb8205bd186a8b05e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:02.143910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8b550c63-9fa3-42a1-8e29-a0c9ab8c9af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:02.165566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:02.232273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 672/1310] 10.222.0.64 () {58 vars in 1062 bytes} [Thu Jul 21 15:57:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:02.241886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299cd14-0c48-43d1-a26e-627da9736029 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:57:02.243662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6299cd14-0c48-43d1-a26e-627da9736029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:02.357305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299cd14-0c48-43d1-a26e-627da9736029 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:57:02.438523 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d55382-32a9-4706-9f79-0c20af388cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:57:02.439232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55382-32a9-4706-9f79-0c20af388cae service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:02.439511 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55382-32a9-4706-9f79-0c20af388cae service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:02.439786 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d55382-32a9-4706-9f79-0c20af388cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:02.441422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-85d55382-32a9-4706-9f79-0c20af388cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:02.501255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:02.562073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d55382-32a9-4706-9f79-0c20af388cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:57:02.563628 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d55382-32a9-4706-9f79-0c20af388cae service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:57:02.583645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 639/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:57:04.982857 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be924237-c485-4ba5-906a-4d30e5e8ed6f None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:04.983432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be924237-c485-4ba5-906a-4d30e5e8ed6f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:04.983432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be924237-c485-4ba5-906a-4d30e5e8ed6f None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:04.985562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 673/1312] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:57:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:04.991263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bab78-8e4e-4858-aa36-079db2d74ab2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:04.991816 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bab78-8e4e-4858-aa36-079db2d74ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:04.991816 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bab78-8e4e-4858-aa36-079db2d74ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:05.072887 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d62bab78-8e4e-4858-aa36-079db2d74ab2 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:05.074160 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d62bab78-8e4e-4858-aa36-079db2d74ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:05.203448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 640/1313] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:05.233042 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be924237-c485-4ba5-906a-4d30e5e8ed6f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:57:05.235172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-be924237-c485-4ba5-906a-4d30e5e8ed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:05.346491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be924237-c485-4ba5-906a-4d30e5e8ed6f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:57:05.424229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:05.426843 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0337766-52dc-4d38-80e3-ef5e2c35932b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:57:05.427534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0337766-52dc-4d38-80e3-ef5e2c35932b service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:05.429052 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0337766-52dc-4d38-80e3-ef5e2c35932b service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:05.429355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0337766-52dc-4d38-80e3-ef5e2c35932b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:05.431503 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c0337766-52dc-4d38-80e3-ef5e2c35932b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:05.546331 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0337766-52dc-4d38-80e3-ef5e2c35932b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:57:05.547818 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0337766-52dc-4d38-80e3-ef5e2c35932b service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:57:05.567705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 674/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 15:57:07.920053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d69c8-8617-45f9-90c6-b38ba9a36e1c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:07.920609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d69c8-8617-45f9-90c6-b38ba9a36e1c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:07.920609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d69c8-8617-45f9-90c6-b38ba9a36e1c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:07.922198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 641/1315] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:07.927609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee475f-a4f0-4524-a936-47e9f0ec546e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:07.928039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee475f-a4f0-4524-a936-47e9f0ec546e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:07.928149 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee475f-a4f0-4524-a936-47e9f0ec546e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:07.995804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b4ee475f-a4f0-4524-a936-47e9f0ec546e None None] MFA Rules not processed for user `8925da3e911a4d87957cf78bccc842b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:07.997007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b4ee475f-a4f0-4524-a936-47e9f0ec546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:08.052454 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:08.099724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 675/1316] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:57:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:08.143871 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d69c8-8617-45f9-90c6-b38ba9a36e1c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:57:08.145391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6d3d69c8-8617-45f9-90c6-b38ba9a36e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:08.155294 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:08.267038 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3d69c8-8617-45f9-90c6-b38ba9a36e1c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:57:08.341204 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41609a-1f16-4623-ae2a-fc10f21f0865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:57:08.341850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41609a-1f16-4623-ae2a-fc10f21f0865 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:08.342123 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41609a-1f16-4623-ae2a-fc10f21f0865 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:08.342376 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41609a-1f16-4623-ae2a-fc10f21f0865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:08.344057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5d41609a-1f16-4623-ae2a-fc10f21f0865 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:08.417976 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:08.488414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41609a-1f16-4623-ae2a-fc10f21f0865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:57:08.489951 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41609a-1f16-4623-ae2a-fc10f21f0865 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:57:08.511223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 642/1317] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:57:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:57:11.186636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcddb62-27a0-434c-8541-3c767785146d None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:11.187279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcddb62-27a0-434c-8541-3c767785146d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:11.187279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcddb62-27a0-434c-8541-3c767785146d None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:11.188614 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 676/1318] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:11.194043 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d4d66-3c6a-4494-abf1-f982d9bba885 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:11.194481 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d4d66-3c6a-4494-abf1-f982d9bba885 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:11.194568 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d4d66-3c6a-4494-abf1-f982d9bba885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:11.259304 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-310d4d66-3c6a-4494-abf1-f982d9bba885 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:11.260522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-310d4d66-3c6a-4494-abf1-f982d9bba885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:11.362158 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 643/1319] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:57:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:11.401380 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcddb62-27a0-434c-8541-3c767785146d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:57:11.403013 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7fcddb62-27a0-434c-8541-3c767785146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:11.512100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcddb62-27a0-434c-8541-3c767785146d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:57:11.587106 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b7645-3113-46a3-b6f5-3ce7945d2b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:57:11.587787 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b7645-3113-46a3-b6f5-3ce7945d2b56 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:11.588067 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b7645-3113-46a3-b6f5-3ce7945d2b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:11.588348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b7645-3113-46a3-b6f5-3ce7945d2b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:11.590006 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-360b7645-3113-46a3-b6f5-3ce7945d2b56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:11.598085 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:11.708241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b7645-3113-46a3-b6f5-3ce7945d2b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:57:11.709699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b7645-3113-46a3-b6f5-3ce7945d2b56 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:57:11.729632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 677/1320] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:57:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:57:14.479198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfcdf8-8b95-42b8-a872-068f604cb8ca None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:14.479756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfcdf8-8b95-42b8-a872-068f604cb8ca None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:14.479756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfcdf8-8b95-42b8-a872-068f604cb8ca None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:14.481054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 644/1321] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:14.487010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3932e1-8fc0-499a-babb-264fc88ef209 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:14.487416 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3932e1-8fc0-499a-babb-264fc88ef209 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:14.487615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3932e1-8fc0-499a-babb-264fc88ef209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:14.558434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7c3932e1-8fc0-499a-babb-264fc88ef209 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:14.559747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7c3932e1-8fc0-499a-babb-264fc88ef209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:14.619691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:14.667127 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 678/1322] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:14.704392 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfcdf8-8b95-42b8-a872-068f604cb8ca None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:57:14.706007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b7bfcdf8-8b95-42b8-a872-068f604cb8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:14.727342 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:14.819701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfcdf8-8b95-42b8-a872-068f604cb8ca None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:57:14.896637 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec350f7-ee7a-423d-bd93-3e72c9648f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:57:14.897598 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec350f7-ee7a-423d-bd93-3e72c9648f72 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:14.897943 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec350f7-ee7a-423d-bd93-3e72c9648f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:14.898151 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec350f7-ee7a-423d-bd93-3e72c9648f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:14.900255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cec350f7-ee7a-423d-bd93-3e72c9648f72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:14.977837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:15.021654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec350f7-ee7a-423d-bd93-3e72c9648f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:57:15.023224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec350f7-ee7a-423d-bd93-3e72c9648f72 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:57:15.043870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 645/1323] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:57:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:57:17.128836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532f8d0-22ca-4b2c-aef3-c2d5738e182b None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:17.129501 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532f8d0-22ca-4b2c-aef3-c2d5738e182b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:17.129501 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532f8d0-22ca-4b2c-aef3-c2d5738e182b None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:17.130650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 679/1324] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:17.136064 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50652d1a-c3d3-47f7-aa02-f743633e45c3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:17.136535 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50652d1a-c3d3-47f7-aa02-f743633e45c3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:17.136640 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50652d1a-c3d3-47f7-aa02-f743633e45c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:17.214692 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-50652d1a-c3d3-47f7-aa02-f743633e45c3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:17.216332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-50652d1a-c3d3-47f7-aa02-f743633e45c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:17.317809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 646/1325] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:17.369063 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883c7a3-08ef-43bf-8af6-06dbaa23cc3e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:17.369377 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883c7a3-08ef-43bf-8af6-06dbaa23cc3e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:17.369781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883c7a3-08ef-43bf-8af6-06dbaa23cc3e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:17.371431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 680/1326] 10.222.0.64 () {54 vars in 965 bytes} [Thu Jul 21 15:57:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:17.377756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9079daf-9cf8-492a-abe8-03b25c27e578 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:17.378039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9079daf-9cf8-492a-abe8-03b25c27e578 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:17.378317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9079daf-9cf8-492a-abe8-03b25c27e578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:17.408517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:17.461328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d9079daf-9cf8-492a-abe8-03b25c27e578 None None] MFA Rules not processed for user `1b46a82ffe92437fb8205bd186a8b05e`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:17.462532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d9079daf-9cf8-492a-abe8-03b25c27e578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:17.542249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 647/1327] 10.222.0.64 () {58 vars in 1062 bytes} [Thu Jul 21 15:57:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:17.551641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883c7a3-08ef-43bf-8af6-06dbaa23cc3e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:57:17.553234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f883c7a3-08ef-43bf-8af6-06dbaa23cc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:17.666253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883c7a3-08ef-43bf-8af6-06dbaa23cc3e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:57:17.748026 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f74e8a-ad11-46e2-ad9f-ad4fcc9f1164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:57:17.748687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f74e8a-ad11-46e2-ad9f-ad4fcc9f1164 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:17.748975 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f74e8a-ad11-46e2-ad9f-ad4fcc9f1164 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:17.749212 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f74e8a-ad11-46e2-ad9f-ad4fcc9f1164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:17.750967 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-48f74e8a-ad11-46e2-ad9f-ad4fcc9f1164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:17.767926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:17.862665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f74e8a-ad11-46e2-ad9f-ad4fcc9f1164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:57:17.864130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f74e8a-ad11-46e2-ad9f-ad4fcc9f1164 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:57:17.882905 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 681/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:57:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:57:20.166599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940c4b5-a149-4ec2-b08d-9eda55c5a4ed None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:20.167137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940c4b5-a149-4ec2-b08d-9eda55c5a4ed None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:20.167242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940c4b5-a149-4ec2-b08d-9eda55c5a4ed None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:20.168575 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 648/1329] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:57:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:20.173848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b2578-373a-4c71-bb0f-2ae7c6b0d2e7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:20.174314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b2578-373a-4c71-bb0f-2ae7c6b0d2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:20.174406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b2578-373a-4c71-bb0f-2ae7c6b0d2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:20.241925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-160b2578-373a-4c71-bb0f-2ae7c6b0d2e7 None None] MFA Rules not processed for user `8925da3e911a4d87957cf78bccc842b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:20.243224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-160b2578-373a-4c71-bb0f-2ae7c6b0d2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:20.329281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:20.368084 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 682/1330] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:57:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:20.406024 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940c4b5-a149-4ec2-b08d-9eda55c5a4ed None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:57:20.407725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3940c4b5-a149-4ec2-b08d-9eda55c5a4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:20.514429 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940c4b5-a149-4ec2-b08d-9eda55c5a4ed None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:57:20.535305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:20.595701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25dd6d6-01ef-4621-ba81-15c8e163a993 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:57:20.596277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd6d6-01ef-4621-ba81-15c8e163a993 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:20.596559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd6d6-01ef-4621-ba81-15c8e163a993 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:20.596831 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25dd6d6-01ef-4621-ba81-15c8e163a993 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:20.598491 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a25dd6d6-01ef-4621-ba81-15c8e163a993 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:20.713154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dd6d6-01ef-4621-ba81-15c8e163a993 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:57:20.714622 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25dd6d6-01ef-4621-ba81-15c8e163a993 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:57:20.733457 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 649/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:57:20 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:57:23.238885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de36ef3-4ae3-4029-8a94-5f0952c722dd None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:23.239442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de36ef3-4ae3-4029-8a94-5f0952c722dd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:23.239442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de36ef3-4ae3-4029-8a94-5f0952c722dd None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:23.240926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 683/1332] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:23.246394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d0598-fc85-4790-a993-75c513da9416 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:23.246913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d0598-fc85-4790-a993-75c513da9416 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:23.247035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d0598-fc85-4790-a993-75c513da9416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:23.313097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:23.316286 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7b9d0598-fc85-4790-a993-75c513da9416 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:23.317907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7b9d0598-fc85-4790-a993-75c513da9416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:23.418803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 650/1333] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:23.455121 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de36ef3-4ae3-4029-8a94-5f0952c722dd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:57:23.456715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3de36ef3-4ae3-4029-8a94-5f0952c722dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:23.569830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de36ef3-4ae3-4029-8a94-5f0952c722dd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:57:23.656697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe43b5-ffb6-4f75-abe1-89fcf9ee489d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:57:23.657580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe43b5-ffb6-4f75-abe1-89fcf9ee489d service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:23.658013 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe43b5-ffb6-4f75-abe1-89fcf9ee489d service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:23.658307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe43b5-ffb6-4f75-abe1-89fcf9ee489d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:23.660082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8abe43b5-ffb6-4f75-abe1-89fcf9ee489d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:23.691276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:23.774940 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe43b5-ffb6-4f75-abe1-89fcf9ee489d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:57:23.776308 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe43b5-ffb6-4f75-abe1-89fcf9ee489d service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:57:23.795494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 684/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:57:25.959242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20b95b-f39f-4ce4-a04f-653b6ef48341 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:25.959829 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20b95b-f39f-4ce4-a04f-653b6ef48341 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:25.959829 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20b95b-f39f-4ce4-a04f-653b6ef48341 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:25.961313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 651/1335] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:25.966900 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45d47c-cd37-419b-b405-7b3c15b616c7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:25.967365 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45d47c-cd37-419b-b405-7b3c15b616c7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:25.967538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e45d47c-cd37-419b-b405-7b3c15b616c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:26.034385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5e45d47c-cd37-419b-b405-7b3c15b616c7 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:26.035653 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5e45d47c-cd37-419b-b405-7b3c15b616c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:26.117164 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:26.141393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 685/1336] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:57:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:26.182576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20b95b-f39f-4ce4-a04f-653b6ef48341 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:57:26.185258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2a20b95b-f39f-4ce4-a04f-653b6ef48341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:26.320565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20b95b-f39f-4ce4-a04f-653b6ef48341 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:57:26.353791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:26.401686 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04268010-bf0e-49ac-9dbb-9cd34d31a4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:57:26.402353 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04268010-bf0e-49ac-9dbb-9cd34d31a4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:26.402636 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04268010-bf0e-49ac-9dbb-9cd34d31a4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:26.402930 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04268010-bf0e-49ac-9dbb-9cd34d31a4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:26.404659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-04268010-bf0e-49ac-9dbb-9cd34d31a4b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:26.523542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04268010-bf0e-49ac-9dbb-9cd34d31a4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:57:26.524987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04268010-bf0e-49ac-9dbb-9cd34d31a4b6 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:57:26.543979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 652/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:57:28.905757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b8524-27a0-4f31-a570-371ce3ccbcbf None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:28.906297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b8524-27a0-4f31-a570-371ce3ccbcbf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:28.906297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b8524-27a0-4f31-a570-371ce3ccbcbf None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:28.907729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 686/1338] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:28.912998 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d59b3-99e3-4aa4-a885-d74bbdf009e7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:28.913460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d59b3-99e3-4aa4-a885-d74bbdf009e7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:28.913576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d59b3-99e3-4aa4-a885-d74bbdf009e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:28.989484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cb1d59b3-99e3-4aa4-a885-d74bbdf009e7 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:28.990704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cb1d59b3-99e3-4aa4-a885-d74bbdf009e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:28.999504 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:29.102788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 653/1339] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:57:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:29.139471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b8524-27a0-4f31-a570-371ce3ccbcbf None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:57:29.141045 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d71b8524-27a0-4f31-a570-371ce3ccbcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:29.257647 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b8524-27a0-4f31-a570-371ce3ccbcbf None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:57:29.337440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8098986-5a0f-4919-9bef-7e1c47bca483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:57:29.338105 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8098986-5a0f-4919-9bef-7e1c47bca483 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:29.338388 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8098986-5a0f-4919-9bef-7e1c47bca483 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:29.338666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8098986-5a0f-4919-9bef-7e1c47bca483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:29.340407 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f8098986-5a0f-4919-9bef-7e1c47bca483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:29.377197 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:29.457626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8098986-5a0f-4919-9bef-7e1c47bca483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:57:29.459028 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8098986-5a0f-4919-9bef-7e1c47bca483 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:57:29.478169 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 687/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:57:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:57:33.533488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f81b8e-7191-4627-b64b-c70b6131a60c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:33.534020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f81b8e-7191-4627-b64b-c70b6131a60c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:33.534020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f81b8e-7191-4627-b64b-c70b6131a60c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:33.535448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 654/1341] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:33.541941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612e90c-77f6-4b8a-8f36-bf3e0f2005d9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:33.542486 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612e90c-77f6-4b8a-8f36-bf3e0f2005d9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:33.542836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612e90c-77f6-4b8a-8f36-bf3e0f2005d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:33.619199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b612e90c-77f6-4b8a-8f36-bf3e0f2005d9 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:33.620655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b612e90c-77f6-4b8a-8f36-bf3e0f2005d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:33.711845 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:33.724742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 688/1342] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:33.764445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f81b8e-7191-4627-b64b-c70b6131a60c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:57:33.766048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-91f81b8e-7191-4627-b64b-c70b6131a60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:33.882351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f81b8e-7191-4627-b64b-c70b6131a60c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:57:33.925159 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:33.964005 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08858eb5-e42c-4ff9-93c2-f365900e9da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:57:33.964666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08858eb5-e42c-4ff9-93c2-f365900e9da9 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:33.964949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08858eb5-e42c-4ff9-93c2-f365900e9da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:33.965224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08858eb5-e42c-4ff9-93c2-f365900e9da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:33.966882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-08858eb5-e42c-4ff9-93c2-f365900e9da9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:34.079632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08858eb5-e42c-4ff9-93c2-f365900e9da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:57:34.081000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08858eb5-e42c-4ff9-93c2-f365900e9da9 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:57:34.100322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 655/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:57:37.023148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cee08-68d1-4388-8a31-ecd2e2b2f9d4 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:37.023729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cee08-68d1-4388-8a31-ecd2e2b2f9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:37.023729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cee08-68d1-4388-8a31-ecd2e2b2f9d4 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:37.025107 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 689/1344] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:57:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:37.030486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf469f9-9349-49c6-8371-4a3aa1092006 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:37.031032 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf469f9-9349-49c6-8371-4a3aa1092006 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:37.031128 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf469f9-9349-49c6-8371-4a3aa1092006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:37.103244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-faf469f9-9349-49c6-8371-4a3aa1092006 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:37.104495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-faf469f9-9349-49c6-8371-4a3aa1092006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:37.124822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:37.218254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 656/1345] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:57:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:37.256551 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cee08-68d1-4388-8a31-ecd2e2b2f9d4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:57:37.258193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3d5cee08-68d1-4388-8a31-ecd2e2b2f9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:37.371530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cee08-68d1-4388-8a31-ecd2e2b2f9d4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:57:37.454896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c07664-98d4-444c-bbb5-bcf694e476c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:57:37.455593 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c07664-98d4-444c-bbb5-bcf694e476c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:37.455883 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c07664-98d4-444c-bbb5-bcf694e476c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:37.456190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c07664-98d4-444c-bbb5-bcf694e476c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:37.457882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-03c07664-98d4-444c-bbb5-bcf694e476c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:37.506760 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:37.582561 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c07664-98d4-444c-bbb5-bcf694e476c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:57:37.584057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c07664-98d4-444c-bbb5-bcf694e476c4 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:57:37.604931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 690/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:57:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:57:41.867188 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e80237-c492-41e0-946c-78ed0d247aad None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:41.867707 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e80237-c492-41e0-946c-78ed0d247aad None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:41.867791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e80237-c492-41e0-946c-78ed0d247aad None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:41.869102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 657/1347] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:41.874786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642cb24-5d33-43cf-9087-abb1dd8f5721 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:41.875366 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642cb24-5d33-43cf-9087-abb1dd8f5721 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:41.875485 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642cb24-5d33-43cf-9087-abb1dd8f5721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:41.944616 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0642cb24-5d33-43cf-9087-abb1dd8f5721 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:41.945866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0642cb24-5d33-43cf-9087-abb1dd8f5721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:42.049437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:42.052505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 691/1348] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:42.090974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e80237-c492-41e0-946c-78ed0d247aad None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:57:42.092764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-98e80237-c492-41e0-946c-78ed0d247aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:42.202643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e80237-c492-41e0-946c-78ed0d247aad None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:57:42.252851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:42.279219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f1a6c-3c16-4d99-b922-192e88d6a963 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:57:42.279879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f1a6c-3c16-4d99-b922-192e88d6a963 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:42.280162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f1a6c-3c16-4d99-b922-192e88d6a963 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:42.280444 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f1a6c-3c16-4d99-b922-192e88d6a963 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:42.282183 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-137f1a6c-3c16-4d99-b922-192e88d6a963 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:42.397369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f1a6c-3c16-4d99-b922-192e88d6a963 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:57:42.398828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f1a6c-3c16-4d99-b922-192e88d6a963 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:57:42.418103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 658/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:57:47.337968 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01250fca-42f7-43cf-8e32-a89d92622aeb None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:47.338847 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01250fca-42f7-43cf-8e32-a89d92622aeb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:47.339365 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01250fca-42f7-43cf-8e32-a89d92622aeb None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:47.341207 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 692/1350] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 15:57:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:47.346425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12321a8f-58f1-4032-bb0e-3992626b8309 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:47.346891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12321a8f-58f1-4032-bb0e-3992626b8309 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:47.347029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12321a8f-58f1-4032-bb0e-3992626b8309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:47.432363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-12321a8f-58f1-4032-bb0e-3992626b8309 None None] MFA Rules not processed for user `1f4a46a051c241a2a47059052735c930`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:47.433564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-12321a8f-58f1-4032-bb0e-3992626b8309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:47.452148 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:47.553584 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 659/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 15:57:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:51.557377 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d64687-5679-4ad3-93df-d0a3ef2c66a2 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:51.558298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d64687-5679-4ad3-93df-d0a3ef2c66a2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:51.558730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d64687-5679-4ad3-93df-d0a3ef2c66a2 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:51.560313 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 693/1352] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 15:57:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:51.565583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505553b0-5e75-4550-b729-292403ed99ab None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:51.566059 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505553b0-5e75-4550-b729-292403ed99ab None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:51.566161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505553b0-5e75-4550-b729-292403ed99ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:51.651300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-505553b0-5e75-4550-b729-292403ed99ab None None] MFA Rules not processed for user `1f4a46a051c241a2a47059052735c930`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:51.652575 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-505553b0-5e75-4550-b729-292403ed99ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:51.731216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:51.772924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 660/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 15:57:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:53.170697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c996f8-7831-488a-887f-c026a9834a69 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:53.171388 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c996f8-7831-488a-887f-c026a9834a69 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:53.171388 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c996f8-7831-488a-887f-c026a9834a69 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:53.173213 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 694/1354] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 15:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:53.178001 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585103b9-58b9-45fc-af43-cee153a28969 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:53.178477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585103b9-58b9-45fc-af43-cee153a28969 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:53.178728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585103b9-58b9-45fc-af43-cee153a28969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:53.259235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-585103b9-58b9-45fc-af43-cee153a28969 None None] MFA Rules not processed for user `1f4a46a051c241a2a47059052735c930`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:53.260323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-585103b9-58b9-45fc-af43-cee153a28969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:53.384720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 661/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 15:57:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:56.981586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a97efe-4c8b-40bb-8734-99f2f79bb5e0 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:56.982442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a97efe-4c8b-40bb-8734-99f2f79bb5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:56.982932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a97efe-4c8b-40bb-8734-99f2f79bb5e0 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:56.989839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 695/1356] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:57:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:56.991476 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf210f36-33c3-48dd-b820-40e777296adc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:56.991941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf210f36-33c3-48dd-b820-40e777296adc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:56.992213 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf210f36-33c3-48dd-b820-40e777296adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:57.045007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:57.082580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cf210f36-33c3-48dd-b820-40e777296adc None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:57.084122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cf210f36-33c3-48dd-b820-40e777296adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:57.202857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 662/1357] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:57.263667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ccd77-7b8f-40be-858d-6147bcca0ead None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:57.265660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ccd77-7b8f-40be-858d-6147bcca0ead None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:57.266168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ccd77-7b8f-40be-858d-6147bcca0ead None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:57.268167 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 696/1358] 10.222.0.64 () {54 vars in 962 bytes} [Thu Jul 21 15:57:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:57:57.284619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3b437-38fb-41a6-881b-f681dc6da030 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:57.285293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3b437-38fb-41a6-881b-f681dc6da030 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:57.287186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3b437-38fb-41a6-881b-f681dc6da030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:57.374123 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9db3b437-38fb-41a6-881b-f681dc6da030 None None] MFA Rules not processed for user `e9a1ec1f6bb7467dbd63ad1da36d48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:57:57.375465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9db3b437-38fb-41a6-881b-f681dc6da030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:57.426667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:57.502986 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 663/1359] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Jul 21 15:57:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:57:57.510745 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ccd77-7b8f-40be-858d-6147bcca0ead None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:57:57.512420 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-935ccd77-7b8f-40be-858d-6147bcca0ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:57.671683 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ccd77-7b8f-40be-858d-6147bcca0ead None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:57:57.749033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:57:57.791554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f73aa5-416e-446b-ab07-32a1585a3613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:57:57.792141 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f73aa5-416e-446b-ab07-32a1585a3613 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:57:57.792470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f73aa5-416e-446b-ab07-32a1585a3613 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:57:57.792866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f73aa5-416e-446b-ab07-32a1585a3613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:57:57.794608 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a3f73aa5-416e-446b-ab07-32a1585a3613 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:57:57.895515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f73aa5-416e-446b-ab07-32a1585a3613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:57:57.897315 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f73aa5-416e-446b-ab07-32a1585a3613 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:57:57.916790 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 697/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:57:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 15:58:00.155674 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e1322-f8ce-4341-9628-acf73ed8d083 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:00.156233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e1322-f8ce-4341-9628-acf73ed8d083 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:00.156233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e1322-f8ce-4341-9628-acf73ed8d083 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:00.157664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 664/1361] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:00.163068 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9641d-e341-46d7-a248-1c62789b717e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:00.163558 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9641d-e341-46d7-a248-1c62789b717e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:00.163655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9641d-e341-46d7-a248-1c62789b717e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:00.237897 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-81b9641d-e341-46d7-a248-1c62789b717e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:00.239133 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-81b9641d-e341-46d7-a248-1c62789b717e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:00.286914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:00.366309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 698/1362] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:00.411030 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e1322-f8ce-4341-9628-acf73ed8d083 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:00.412542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-505e1322-f8ce-4341-9628-acf73ed8d083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:00.597787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e1322-f8ce-4341-9628-acf73ed8d083 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:00.607766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:00.728316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5457a92d-0bcf-4006-a1b5-7c4a7b622ae8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:00.729007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457a92d-0bcf-4006-a1b5-7c4a7b622ae8 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:00.729293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457a92d-0bcf-4006-a1b5-7c4a7b622ae8 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:00.729568 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5457a92d-0bcf-4006-a1b5-7c4a7b622ae8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:00.731673 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5457a92d-0bcf-4006-a1b5-7c4a7b622ae8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:00.833726 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457a92d-0bcf-4006-a1b5-7c4a7b622ae8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:00.835427 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5457a92d-0bcf-4006-a1b5-7c4a7b622ae8 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:00.855261 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 665/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:03.234609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdd07b-89de-465b-ac79-0714d210a5a4 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:03.235233 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdd07b-89de-465b-ac79-0714d210a5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:03.235233 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffdd07b-89de-465b-ac79-0714d210a5a4 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:03.236603 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 699/1364] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:03.244241 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7a166-c420-47f3-9498-8febf2ff6a48 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:03.244787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7a166-c420-47f3-9498-8febf2ff6a48 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:03.244948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7a166-c420-47f3-9498-8febf2ff6a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:03.264074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:03.321507 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ebb7a166-c420-47f3-9498-8febf2ff6a48 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:03.322745 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ebb7a166-c420-47f3-9498-8febf2ff6a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:03.436117 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 666/1365] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:03.488162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9b7aa-017b-4435-9ff7-bb75624d3128 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:03.488834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9b7aa-017b-4435-9ff7-bb75624d3128 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:03.489261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff9b7aa-017b-4435-9ff7-bb75624d3128 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:03.490883 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 700/1366] 10.222.0.64 () {54 vars in 962 bytes} [Thu Jul 21 15:58:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:03.498132 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0b8ab-e0d5-4a3b-b57a-9bd6f3c4b4f1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:03.498804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0b8ab-e0d5-4a3b-b57a-9bd6f3c4b4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:03.499277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e0b8ab-e0d5-4a3b-b57a-9bd6f3c4b4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:03.600923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-19e0b8ab-e0d5-4a3b-b57a-9bd6f3c4b4f1 None None] MFA Rules not processed for user `e9a1ec1f6bb7467dbd63ad1da36d48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:03.602358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-19e0b8ab-e0d5-4a3b-b57a-9bd6f3c4b4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:03.659002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:03.769019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 667/1367] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Jul 21 15:58:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:03.778979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9b7aa-017b-4435-9ff7-bb75624d3128 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:03.780505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7ff9b7aa-017b-4435-9ff7-bb75624d3128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:03.980333 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff9b7aa-017b-4435-9ff7-bb75624d3128 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:04.006264 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:04.121872 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41394b0-aa28-472c-890b-0c5415d1839b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:04.123308 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41394b0-aa28-472c-890b-0c5415d1839b service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:04.124624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41394b0-aa28-472c-890b-0c5415d1839b service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:04.125025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41394b0-aa28-472c-890b-0c5415d1839b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:04.127397 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b41394b0-aa28-472c-890b-0c5415d1839b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:04.240812 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41394b0-aa28-472c-890b-0c5415d1839b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:04.243403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41394b0-aa28-472c-890b-0c5415d1839b service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:04.265083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 701/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:05.353497 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b0e1-c1d1-4fa4-a651-3ffc4f2e7555 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:05.354191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b0e1-c1d1-4fa4-a651-3ffc4f2e7555 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:05.354191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b0e1-c1d1-4fa4-a651-3ffc4f2e7555 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:05.356074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 668/1369] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:05.363025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c9567-b788-46f7-b11b-fcd860147da4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:05.363618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c9567-b788-46f7-b11b-fcd860147da4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:05.363878 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797c9567-b788-46f7-b11b-fcd860147da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:05.404317 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:05.445875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-797c9567-b788-46f7-b11b-fcd860147da4 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:05.447067 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-797c9567-b788-46f7-b11b-fcd860147da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:05.566881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 702/1370] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:05.914134 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3111219-9aa4-4424-aa42-cfcf09569c20 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:05.914490 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3111219-9aa4-4424-aa42-cfcf09569c20 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:05.914915 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3111219-9aa4-4424-aa42-cfcf09569c20 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:05.918882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 669/1371] 10.222.0.64 () {54 vars in 964 bytes} [Thu Jul 21 15:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:58:05.921798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b155a-1d78-4e3d-94cd-011593601068 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:05.922262 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b155a-1d78-4e3d-94cd-011593601068 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:05.922609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b155a-1d78-4e3d-94cd-011593601068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:06.001684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d79b155a-1d78-4e3d-94cd-011593601068 None None] MFA Rules not processed for user `d8c629ecd4014e2b8051b853a0b4c18a`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:06.003012 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d79b155a-1d78-4e3d-94cd-011593601068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:06.052808 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:06.085212 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 703/1372] 10.222.0.64 () {58 vars in 1061 bytes} [Thu Jul 21 15:58:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:06.092853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3111219-9aa4-4424-aa42-cfcf09569c20 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:06.094551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b3111219-9aa4-4424-aa42-cfcf09569c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:06.214704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3111219-9aa4-4424-aa42-cfcf09569c20 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:06.280864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:06.326357 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802423d-c4d0-4d82-8bf4-fe1af391c43f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:06.327306 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802423d-c4d0-4d82-8bf4-fe1af391c43f service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:06.327836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802423d-c4d0-4d82-8bf4-fe1af391c43f service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:06.328228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802423d-c4d0-4d82-8bf4-fe1af391c43f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:06.330453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1802423d-c4d0-4d82-8bf4-fe1af391c43f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:06.399412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce8857-bb05-4865-8cea-6da42ba1a005 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:06.400037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce8857-bb05-4865-8cea-6da42ba1a005 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:06.400037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce8857-bb05-4865-8cea-6da42ba1a005 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:06.401648 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 704/1373] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:06.406345 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59760ac-7fbc-40dc-a494-f93535311887 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:06.406661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59760ac-7fbc-40dc-a494-f93535311887 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:06.406992 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59760ac-7fbc-40dc-a494-f93535311887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:06.464451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802423d-c4d0-4d82-8bf4-fe1af391c43f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:06.466345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1802423d-c4d0-4d82-8bf4-fe1af391c43f service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:06.474591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f59760ac-7fbc-40dc-a494-f93535311887 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:06.476120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f59760ac-7fbc-40dc-a494-f93535311887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:06.499122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 670/1374] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:06.589176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 705/1375] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 15:58:06.633223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802423d-c4d0-4d82-8bf4-fe1af391c43f service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:06.634359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1802423d-c4d0-4d82-8bf4-fe1af391c43f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:06.701242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:06.734723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802423d-c4d0-4d82-8bf4-fe1af391c43f service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:06.856853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a54dc61-77e5-4973-a628-d946cc1755c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:06.857513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54dc61-77e5-4973-a628-d946cc1755c3 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:06.857797 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54dc61-77e5-4973-a628-d946cc1755c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:06.858072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a54dc61-77e5-4973-a628-d946cc1755c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:06.859819 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1a54dc61-77e5-4973-a628-d946cc1755c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:06.958068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:06.970576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54dc61-77e5-4973-a628-d946cc1755c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:06.972216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a54dc61-77e5-4973-a628-d946cc1755c3 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:06.990651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 671/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:09.054252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fd4b5-9dd3-4487-86d7-48f8d035fd76 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:09.054748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fd4b5-9dd3-4487-86d7-48f8d035fd76 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:09.054928 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60fd4b5-9dd3-4487-86d7-48f8d035fd76 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:09.056472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 706/1377] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:09.061824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c51ff5-334d-4f0d-a5dd-979fbbdc5306 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:09.062270 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c51ff5-334d-4f0d-a5dd-979fbbdc5306 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:09.062364 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c51ff5-334d-4f0d-a5dd-979fbbdc5306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:09.133953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-78c51ff5-334d-4f0d-a5dd-979fbbdc5306 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:09.135105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-78c51ff5-334d-4f0d-a5dd-979fbbdc5306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:09.245028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 672/1378] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:09.288864 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fd4b5-9dd3-4487-86d7-48f8d035fd76 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:09.290431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f60fd4b5-9dd3-4487-86d7-48f8d035fd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:09.344248 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:09.445837 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60fd4b5-9dd3-4487-86d7-48f8d035fd76 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:09.582914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a15c8-d0b0-463a-90b1-22156d69195a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:09.583586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a15c8-d0b0-463a-90b1-22156d69195a service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:09.583870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a15c8-d0b0-463a-90b1-22156d69195a service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:09.584146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a15c8-d0b0-463a-90b1-22156d69195a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:09.585804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e12a15c8-d0b0-463a-90b1-22156d69195a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:09.598494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:09.680405 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a15c8-d0b0-463a-90b1-22156d69195a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:09.682022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a15c8-d0b0-463a-90b1-22156d69195a service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:09.700149 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 707/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:11.790333 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0526e1-517d-4b88-9e33-7e36b08ee2c4 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:11.790950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0526e1-517d-4b88-9e33-7e36b08ee2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:11.790950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0526e1-517d-4b88-9e33-7e36b08ee2c4 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:11.792325 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 673/1380] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:11.797754 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a472c-d9dd-489b-96f5-1aab16474233 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:11.798314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a472c-d9dd-489b-96f5-1aab16474233 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:11.798314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a472c-d9dd-489b-96f5-1aab16474233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:11.867090 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4d0a472c-d9dd-489b-96f5-1aab16474233 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:11.868246 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4d0a472c-d9dd-489b-96f5-1aab16474233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:11.962582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:11.976395 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 708/1381] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:12.023818 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0526e1-517d-4b88-9e33-7e36b08ee2c4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:12.025373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bb0526e1-517d-4b88-9e33-7e36b08ee2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:12.101307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:12.213815 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0526e1-517d-4b88-9e33-7e36b08ee2c4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:12.331932 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a701392f-f332-4ba7-adde-1b7f6f578c6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:12.332603 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701392f-f332-4ba7-adde-1b7f6f578c6f service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:12.332890 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701392f-f332-4ba7-adde-1b7f6f578c6f service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:12.333193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a701392f-f332-4ba7-adde-1b7f6f578c6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:12.334827 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a701392f-f332-4ba7-adde-1b7f6f578c6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:12.358145 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:12.439645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701392f-f332-4ba7-adde-1b7f6f578c6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:12.441292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a701392f-f332-4ba7-adde-1b7f6f578c6f service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:12.460397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 674/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 15:58:14.688920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc2c37-3c1d-4fd0-94ee-7fc8163d2bb2 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:14.689633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc2c37-3c1d-4fd0-94ee-7fc8163d2bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:14.689633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc2c37-3c1d-4fd0-94ee-7fc8163d2bb2 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:14.691166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 709/1383] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:58:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:14.697531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065be2e-32f2-461d-8705-6f280652214d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:14.698122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065be2e-32f2-461d-8705-6f280652214d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:14.698122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a065be2e-32f2-461d-8705-6f280652214d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:14.773053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a065be2e-32f2-461d-8705-6f280652214d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:14.774321 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a065be2e-32f2-461d-8705-6f280652214d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:14.888763 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:14.892462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 675/1384] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:14.935708 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc2c37-3c1d-4fd0-94ee-7fc8163d2bb2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:14.937314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-30dc2c37-3c1d-4fd0-94ee-7fc8163d2bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:15.109914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc2c37-3c1d-4fd0-94ee-7fc8163d2bb2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:15.177266 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:15.228227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be6d98-f6ee-4bb5-98a1-1f5f4aeff73f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:15.228227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be6d98-f6ee-4bb5-98a1-1f5f4aeff73f service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:15.228227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be6d98-f6ee-4bb5-98a1-1f5f4aeff73f service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:15.228227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be6d98-f6ee-4bb5-98a1-1f5f4aeff73f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:15.231226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-88be6d98-f6ee-4bb5-98a1-1f5f4aeff73f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:15.347244 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be6d98-f6ee-4bb5-98a1-1f5f4aeff73f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:15.349267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be6d98-f6ee-4bb5-98a1-1f5f4aeff73f service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:15.371632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 710/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:17.487015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb227154-e4f2-47b6-b813-4bba1d3e4b3f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:17.487581 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb227154-e4f2-47b6-b813-4bba1d3e4b3f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:17.487581 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb227154-e4f2-47b6-b813-4bba1d3e4b3f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:17.489097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 676/1386] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:17.494527 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a220efd-2ce2-4dad-823a-1daa6d444de1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:17.495125 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a220efd-2ce2-4dad-823a-1daa6d444de1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:17.495233 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a220efd-2ce2-4dad-823a-1daa6d444de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:17.585744 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4a220efd-2ce2-4dad-823a-1daa6d444de1 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:17.587496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4a220efd-2ce2-4dad-823a-1daa6d444de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:17.625939 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:17.722226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 711/1387] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:17.770760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb227154-e4f2-47b6-b813-4bba1d3e4b3f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:17.772600 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eb227154-e4f2-47b6-b813-4bba1d3e4b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:17.961770 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb227154-e4f2-47b6-b813-4bba1d3e4b3f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:18.051607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:18.098510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b401d218-5146-4c39-96c8-93479c240ab1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:18.099264 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401d218-5146-4c39-96c8-93479c240ab1 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:18.099619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401d218-5146-4c39-96c8-93479c240ab1 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:18.099835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401d218-5146-4c39-96c8-93479c240ab1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:18.101633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b401d218-5146-4c39-96c8-93479c240ab1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:18.200099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401d218-5146-4c39-96c8-93479c240ab1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:18.202339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b401d218-5146-4c39-96c8-93479c240ab1 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:18.226207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 677/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:20.361131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a7d05-deb2-472c-b9e5-ec7a706e511e None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:20.361748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a7d05-deb2-472c-b9e5-ec7a706e511e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:20.361748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a7d05-deb2-472c-b9e5-ec7a706e511e None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:20.363135 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 712/1389] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:20.368958 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e19c77-e3be-49ec-a602-4faa1c061c3a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:20.369514 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e19c77-e3be-49ec-a602-4faa1c061c3a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:20.369514 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e19c77-e3be-49ec-a602-4faa1c061c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:20.442514 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-21e19c77-e3be-49ec-a602-4faa1c061c3a None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:20.443830 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-21e19c77-e3be-49ec-a602-4faa1c061c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:20.480923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:20.545962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 678/1390] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 15:58:20.591380 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a7d05-deb2-472c-b9e5-ec7a706e511e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:20.592907 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2d7a7d05-deb2-472c-b9e5-ec7a706e511e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:20.772283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a7d05-deb2-472c-b9e5-ec7a706e511e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:20.782672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:20.889749 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73253c9-1d9f-4750-9c89-32a82a30941e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:20.890412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73253c9-1d9f-4750-9c89-32a82a30941e service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:20.890657 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73253c9-1d9f-4750-9c89-32a82a30941e service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:20.891001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73253c9-1d9f-4750-9c89-32a82a30941e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:20.892646 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e73253c9-1d9f-4750-9c89-32a82a30941e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:20.989336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73253c9-1d9f-4750-9c89-32a82a30941e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:20.991019 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73253c9-1d9f-4750-9c89-32a82a30941e service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:21.011079 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 713/1391] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:21.759370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f286a-6c74-4adf-bf7b-8e557808e72f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:21.760083 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f286a-6c74-4adf-bf7b-8e557808e72f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:21.760083 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f286a-6c74-4adf-bf7b-8e557808e72f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:21.761419 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 679/1392] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:21.767339 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3c21e-59e9-4e86-9322-fcc5991d5e10 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:21.767888 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3c21e-59e9-4e86-9322-fcc5991d5e10 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:21.767888 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3c21e-59e9-4e86-9322-fcc5991d5e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:21.782937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:21.836198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d0f3c21e-59e9-4e86-9322-fcc5991d5e10 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:21.837430 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d0f3c21e-59e9-4e86-9322-fcc5991d5e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:21.939221 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 714/1393] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:21.995605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff839e-8fa1-427b-9fad-31558d082b9c None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:21.995888 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff839e-8fa1-427b-9fad-31558d082b9c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:21.996160 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff839e-8fa1-427b-9fad-31558d082b9c None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:21.997648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 680/1394] 10.222.0.64 () {54 vars in 966 bytes} [Thu Jul 21 15:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:22.003038 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4f19-ef5d-4143-8e18-8a90d49279dc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:22.003336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4f19-ef5d-4143-8e18-8a90d49279dc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:22.003677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e4f19-ef5d-4143-8e18-8a90d49279dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:22.086212 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ac8e4f19-ef5d-4143-8e18-8a90d49279dc None None] MFA Rules not processed for user `1a3418c0b46c404c8ca445cce9db632d`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:22.087384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ac8e4f19-ef5d-4143-8e18-8a90d49279dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:22.127393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:22.176368 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 715/1395] 10.222.0.64 () {58 vars in 1063 bytes} [Thu Jul 21 15:58:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:22.184348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff839e-8fa1-427b-9fad-31558d082b9c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:22.186029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-77ff839e-8fa1-427b-9fad-31558d082b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:22.298408 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff839e-8fa1-427b-9fad-31558d082b9c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:22.362876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:22.375548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dd714-0561-4f69-a325-abd2caa28b1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3418c0b46c404c8ca445cce9db632d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:22.376199 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dd714-0561-4f69-a325-abd2caa28b1d service glance] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:22.376484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dd714-0561-4f69-a325-abd2caa28b1d service glance] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:22.376757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dd714-0561-4f69-a325-abd2caa28b1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:22.378415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cf5dd714-0561-4f69-a325-abd2caa28b1d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:22.502120 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dd714-0561-4f69-a325-abd2caa28b1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:22.503613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dd714-0561-4f69-a325-abd2caa28b1d service glance] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:22.523138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 681/1396] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:23.084067 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff975adc-ff35-4531-8721-56a4d51171df None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:23.084718 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff975adc-ff35-4531-8721-56a4d51171df None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:23.084718 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff975adc-ff35-4531-8721-56a4d51171df None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:23.086226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 716/1397] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:23.092910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe88f8-409e-49ea-8892-78cd7b3b95b4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:23.093434 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe88f8-409e-49ea-8892-78cd7b3b95b4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:23.093738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe88f8-409e-49ea-8892-78cd7b3b95b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:23.170319 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8fbe88f8-409e-49ea-8892-78cd7b3b95b4 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:23.171616 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8fbe88f8-409e-49ea-8892-78cd7b3b95b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:23.217006 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:23.269151 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715c5e4-4f27-4feb-bdd8-355e47583d8d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:23.269441 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715c5e4-4f27-4feb-bdd8-355e47583d8d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:23.269756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715c5e4-4f27-4feb-bdd8-355e47583d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:23.275751 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 682/1398] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:23.320426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe88f8-409e-49ea-8892-78cd7b3b95b4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:23.321715 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8fbe88f8-409e-49ea-8892-78cd7b3b95b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:23.340427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8715c5e4-4f27-4feb-bdd8-355e47583d8d None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:23.341685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8715c5e4-4f27-4feb-bdd8-355e47583d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:23.436269 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 717/1399] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 15:58:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 15:58:23.449164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe88f8-409e-49ea-8892-78cd7b3b95b4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:23.483680 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818f337-3748-4884-ac82-cffa40f1c431 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:23.483973 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818f337-3748-4884-ac82-cffa40f1c431 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:23.484256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818f337-3748-4884-ac82-cffa40f1c431 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:23.485785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 718/1400] 10.222.0.64 () {54 vars in 943 bytes} [Thu Jul 21 15:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:58:23.491657 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd280e6-0950-46fa-b9ac-93b259bc4f51 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:23.491948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd280e6-0950-46fa-b9ac-93b259bc4f51 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:23.492230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd280e6-0950-46fa-b9ac-93b259bc4f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:23.516039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:23.551484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:23.571197 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1cd280e6-0950-46fa-b9ac-93b259bc4f51 None None] MFA Rules not processed for user `dcee349bdb2640609cc71fb1c65794f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:23.572478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1cd280e6-0950-46fa-b9ac-93b259bc4f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:23.574418 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17656e7f-5819-43d7-9f62-ebb829a43c31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:23.575119 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656e7f-5819-43d7-9f62-ebb829a43c31 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:23.575644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656e7f-5819-43d7-9f62-ebb829a43c31 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:23.575644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656e7f-5819-43d7-9f62-ebb829a43c31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:23.577309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-17656e7f-5819-43d7-9f62-ebb829a43c31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:23.671832 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17656e7f-5819-43d7-9f62-ebb829a43c31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:23.673454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17656e7f-5819-43d7-9f62-ebb829a43c31 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:23.680886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 719/1401] 10.222.0.64 () {58 vars in 1040 bytes} [Thu Jul 21 15:58:23 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 15:58:23.690724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd280e6-0950-46fa-b9ac-93b259bc4f51 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:23.693414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 683/1402] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:23.700910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd280e6-0950-46fa-b9ac-93b259bc4f51 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:23.819658 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:23.827489 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f1d48-e90c-4686-8145-e7a142358ed8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:23.828193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f1d48-e90c-4686-8145-e7a142358ed8 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:23.828484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f1d48-e90c-4686-8145-e7a142358ed8 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:23.828756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f1d48-e90c-4686-8145-e7a142358ed8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:23.830575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-015f1d48-e90c-4686-8145-e7a142358ed8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:23.923736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f1d48-e90c-4686-8145-e7a142358ed8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:23.925362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f1d48-e90c-4686-8145-e7a142358ed8 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:23.934062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 720/1403] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 15:58:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 15:58:25.790175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2be921-ad5a-47a4-804b-f00c18da9fd6 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:25.790739 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2be921-ad5a-47a4-804b-f00c18da9fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:25.790858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2be921-ad5a-47a4-804b-f00c18da9fd6 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:25.796683 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 684/1404] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:25.798475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f602e8d-112b-432b-b2a1-bd0812a92966 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:25.798959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f602e8d-112b-432b-b2a1-bd0812a92966 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:25.799147 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f602e8d-112b-432b-b2a1-bd0812a92966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:25.885226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7f602e8d-112b-432b-b2a1-bd0812a92966 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:25.887201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7f602e8d-112b-432b-b2a1-bd0812a92966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:26.023668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:26.038771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 721/1405] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:26.090728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2be921-ad5a-47a4-804b-f00c18da9fd6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:26.092284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6c2be921-ad5a-47a4-804b-f00c18da9fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:26.183064 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:26.291471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2be921-ad5a-47a4-804b-f00c18da9fd6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:26.433787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60bb4a-66a0-4e15-afa0-308c0ec53316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:26.434450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60bb4a-66a0-4e15-afa0-308c0ec53316 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:26.434728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60bb4a-66a0-4e15-afa0-308c0ec53316 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:26.435031 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60bb4a-66a0-4e15-afa0-308c0ec53316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:26.436705 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3b60bb4a-66a0-4e15-afa0-308c0ec53316 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:26.469793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:26.542020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60bb4a-66a0-4e15-afa0-308c0ec53316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:26.543834 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60bb4a-66a0-4e15-afa0-308c0ec53316 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:26.564645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 685/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:28.707694 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11522c63-8919-40a0-b3ad-772ef3f07663 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:28.708312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11522c63-8919-40a0-b3ad-772ef3f07663 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:28.708551 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11522c63-8919-40a0-b3ad-772ef3f07663 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:28.710904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 722/1407] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:58:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:28.716539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e11da-1872-4211-9708-5273ad37d4a4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:28.717597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e11da-1872-4211-9708-5273ad37d4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:28.717597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e11da-1872-4211-9708-5273ad37d4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:28.807433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-907e11da-1872-4211-9708-5273ad37d4a4 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:28.809167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-907e11da-1872-4211-9708-5273ad37d4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:28.916174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 686/1408] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:28.960486 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11522c63-8919-40a0-b3ad-772ef3f07663 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:28.962403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-11522c63-8919-40a0-b3ad-772ef3f07663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:29.130801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11522c63-8919-40a0-b3ad-772ef3f07663 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:29.209856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:29.269370 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08012fa-0f21-42fe-bbef-8a35c00f7f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:29.270028 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08012fa-0f21-42fe-bbef-8a35c00f7f05 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:29.270320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08012fa-0f21-42fe-bbef-8a35c00f7f05 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:29.270597 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08012fa-0f21-42fe-bbef-8a35c00f7f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:29.272304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e08012fa-0f21-42fe-bbef-8a35c00f7f05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:29.370187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08012fa-0f21-42fe-bbef-8a35c00f7f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:29.371836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08012fa-0f21-42fe-bbef-8a35c00f7f05 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:29.393728 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 723/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:38.914025 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:39.388673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=67 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:46.244694 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaf335-1c17-4200-84c7-f9ba48f10ef0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:46.245290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaf335-1c17-4200-84c7-f9ba48f10ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:46.245290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaf335-1c17-4200-84c7-f9ba48f10ef0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:46.246579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 687/1410] 10.222.0.64 () {54 vars in 918 bytes} [Thu Jul 21 15:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:58:46.251991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5406e-caf2-4716-b995-e49db5ba103f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:46.252445 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5406e-caf2-4716-b995-e49db5ba103f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:46.252550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5406e-caf2-4716-b995-e49db5ba103f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:46.328995 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-93b5406e-caf2-4716-b995-e49db5ba103f None None] MFA Rules not processed for user `1f4a46a051c241a2a47059052735c930`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:46.330414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-93b5406e-caf2-4716-b995-e49db5ba103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:46.444514 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 724/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Jul 21 15:58:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:46.460788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2936a-6695-44dd-92d7-5936aa0cedc2 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:46.461075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2936a-6695-44dd-92d7-5936aa0cedc2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:46.461351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2936a-6695-44dd-92d7-5936aa0cedc2 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:46.462728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 688/1412] 10.222.0.64 () {54 vars in 918 bytes} [Thu Jul 21 15:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:46.468336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ee19f-fdcc-47dc-9222-8c0fee989def None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:46.468626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ee19f-fdcc-47dc-9222-8c0fee989def None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:46.468909 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ee19f-fdcc-47dc-9222-8c0fee989def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:46.551474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:46.555417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-412ee19f-fdcc-47dc-9222-8c0fee989def None None] MFA Rules not processed for user `e9a1ec1f6bb7467dbd63ad1da36d48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:46.557241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-412ee19f-fdcc-47dc-9222-8c0fee989def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:46.677940 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 725/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Jul 21 15:58:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:49.168789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed45880-2125-49cd-956f-714c0efd4f72 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:49.169382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed45880-2125-49cd-956f-714c0efd4f72 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:49.169382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed45880-2125-49cd-956f-714c0efd4f72 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:49.170744 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 689/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 15:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:49.176386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724b540-fab9-4eca-b594-c677f5620fa3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:49.176903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724b540-fab9-4eca-b594-c677f5620fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:49.176903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724b540-fab9-4eca-b594-c677f5620fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:49.243306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d724b540-fab9-4eca-b594-c677f5620fa3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:49.244512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d724b540-fab9-4eca-b594-c677f5620fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:49.301199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:49.345462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 726/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 15:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:49.388880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed45880-2125-49cd-956f-714c0efd4f72 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:49.390643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5ed45880-2125-49cd-956f-714c0efd4f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:49.548127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed45880-2125-49cd-956f-714c0efd4f72 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:49.623863 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:49.664980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb79d72-3a59-4265-aa9e-11c1e6436e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:49.665628 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb79d72-3a59-4265-aa9e-11c1e6436e89 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:49.665904 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb79d72-3a59-4265-aa9e-11c1e6436e89 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:49.666178 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb79d72-3a59-4265-aa9e-11c1e6436e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:49.667855 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-acb79d72-3a59-4265-aa9e-11c1e6436e89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:49.757192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb79d72-3a59-4265-aa9e-11c1e6436e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:49.758806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb79d72-3a59-4265-aa9e-11c1e6436e89 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:49.777129 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 690/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:50.675272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62acb41-4575-4b68-b8d2-d931e09c1aa6 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:50.675853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62acb41-4575-4b68-b8d2-d931e09c1aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:50.675853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62acb41-4575-4b68-b8d2-d931e09c1aa6 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:50.677272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 727/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 15:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:50.682426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e8c9c-fbdc-43a8-a62e-433d879d3709 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:50.682894 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e8c9c-fbdc-43a8-a62e-433d879d3709 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:50.683013 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e8c9c-fbdc-43a8-a62e-433d879d3709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:50.759432 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ac3e8c9c-fbdc-43a8-a62e-433d879d3709 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:50.760655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ac3e8c9c-fbdc-43a8-a62e-433d879d3709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:50.788135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:50.859672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 691/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 15:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:51.009250 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62acb41-4575-4b68-b8d2-d931e09c1aa6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:51.010658 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b62acb41-4575-4b68-b8d2-d931e09c1aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:51.170859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62acb41-4575-4b68-b8d2-d931e09c1aa6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:51.220501 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:51.297359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba93411-2fad-49f6-8d04-427ffbadb832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:51.297937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba93411-2fad-49f6-8d04-427ffbadb832 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:51.298220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba93411-2fad-49f6-8d04-427ffbadb832 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:51.298491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba93411-2fad-49f6-8d04-427ffbadb832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:51.300209 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4ba93411-2fad-49f6-8d04-427ffbadb832 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:51.393186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba93411-2fad-49f6-8d04-427ffbadb832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:51.394842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba93411-2fad-49f6-8d04-427ffbadb832 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:51.414456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 728/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:52.283619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050102-18e2-4403-88e7-a98c051ba298 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:52.284169 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050102-18e2-4403-88e7-a98c051ba298 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:52.284169 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050102-18e2-4403-88e7-a98c051ba298 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:52.285577 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 692/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 15:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:52.290712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692a8d1-5b3f-4768-b511-cd0d28ee7a58 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:52.291179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692a8d1-5b3f-4768-b511-cd0d28ee7a58 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:52.291290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692a8d1-5b3f-4768-b511-cd0d28ee7a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:52.347117 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:52.370679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a692a8d1-5b3f-4768-b511-cd0d28ee7a58 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:52.371980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a692a8d1-5b3f-4768-b511-cd0d28ee7a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:52.467403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 729/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 15:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:52.626806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050102-18e2-4403-88e7-a98c051ba298 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:52.628338 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-27050102-18e2-4403-88e7-a98c051ba298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:52.780895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050102-18e2-4403-88e7-a98c051ba298 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:52.793337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:52.912631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e6876e-f7b8-4752-8aec-999ebc326421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:52.913288 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6876e-f7b8-4752-8aec-999ebc326421 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:52.913566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6876e-f7b8-4752-8aec-999ebc326421 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:52.913839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e6876e-f7b8-4752-8aec-999ebc326421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:52.915529 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f6e6876e-f7b8-4752-8aec-999ebc326421 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:53.012119 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6876e-f7b8-4752-8aec-999ebc326421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:53.013774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e6876e-f7b8-4752-8aec-999ebc326421 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:53.032841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 693/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:53.891349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376d902-eadb-4105-9d52-b36a1aac1d5d None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:53.891898 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376d902-eadb-4105-9d52-b36a1aac1d5d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:53.891898 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376d902-eadb-4105-9d52-b36a1aac1d5d None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:53.893315 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 730/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 15:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:53.898556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7586be-57b8-4cf2-8185-408ee2cf61ff None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:53.899032 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7586be-57b8-4cf2-8185-408ee2cf61ff None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:53.899130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7586be-57b8-4cf2-8185-408ee2cf61ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:53.919308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:53.978836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8e7586be-57b8-4cf2-8185-408ee2cf61ff None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:53.980080 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8e7586be-57b8-4cf2-8185-408ee2cf61ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:54.079365 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 694/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 15:58:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:54.228104 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376d902-eadb-4105-9d52-b36a1aac1d5d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:54.229657 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4376d902-eadb-4105-9d52-b36a1aac1d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:54.339943 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:54.376533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376d902-eadb-4105-9d52-b36a1aac1d5d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:54.500135 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbaafd5-e8d4-4bea-b897-ef0c1d77ba81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:54.500720 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaafd5-e8d4-4bea-b897-ef0c1d77ba81 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:54.501011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaafd5-e8d4-4bea-b897-ef0c1d77ba81 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:54.501281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbaafd5-e8d4-4bea-b897-ef0c1d77ba81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:54.502984 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1bbaafd5-e8d4-4bea-b897-ef0c1d77ba81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:54.592417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:54.607473 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbaafd5-e8d4-4bea-b897-ef0c1d77ba81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:54.609087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbaafd5-e8d4-4bea-b897-ef0c1d77ba81 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:54.628065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 731/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:55.482531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1f255-d5f1-4fc9-8946-6873d2630c04 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:55.483127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1f255-d5f1-4fc9-8946-6873d2630c04 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:55.483127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1f255-d5f1-4fc9-8946-6873d2630c04 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:55.484422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 695/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 15:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:55.489581 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746717a1-86c9-4fd7-affb-171501fb6e78 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:55.490057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746717a1-86c9-4fd7-affb-171501fb6e78 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:55.490168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746717a1-86c9-4fd7-affb-171501fb6e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:55.568031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-746717a1-86c9-4fd7-affb-171501fb6e78 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:55.569263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-746717a1-86c9-4fd7-affb-171501fb6e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:55.671739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 732/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 15:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:55.818614 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1f255-d5f1-4fc9-8946-6873d2630c04 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:55.820098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-72c1f255-d5f1-4fc9-8946-6873d2630c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:55.905714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:55.969857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1f255-d5f1-4fc9-8946-6873d2630c04 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:56.095797 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f524e52-5119-4ca8-b694-e1bca5b55cf1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:56.096676 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f524e52-5119-4ca8-b694-e1bca5b55cf1 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:56.096945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f524e52-5119-4ca8-b694-e1bca5b55cf1 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:56.097219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f524e52-5119-4ca8-b694-e1bca5b55cf1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:56.098889 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f524e52-5119-4ca8-b694-e1bca5b55cf1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:56.150611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:56.194641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f524e52-5119-4ca8-b694-e1bca5b55cf1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:56.196459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f524e52-5119-4ca8-b694-e1bca5b55cf1 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:56.215854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 696/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:57.013251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a6018-ebd8-4df3-a90a-b7fa23345796 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:57.013871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a6018-ebd8-4df3-a90a-b7fa23345796 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:57.013871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a6018-ebd8-4df3-a90a-b7fa23345796 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:57.015214 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 733/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 15:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:57.020329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b05307-7720-4110-bde1-f42e37d01a8d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:57.020749 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b05307-7720-4110-bde1-f42e37d01a8d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:57.020870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b05307-7720-4110-bde1-f42e37d01a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:57.099369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c9b05307-7720-4110-bde1-f42e37d01a8d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:57.100584 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c9b05307-7720-4110-bde1-f42e37d01a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:57.202555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 697/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 15:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:57.350725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a6018-ebd8-4df3-a90a-b7fa23345796 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:57.352190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4a8a6018-ebd8-4df3-a90a-b7fa23345796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:57.409690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:57.523073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a6018-ebd8-4df3-a90a-b7fa23345796 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:57.645725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3317ad-8de3-4db3-9075-7b05f39ff769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:57.646298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3317ad-8de3-4db3-9075-7b05f39ff769 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:57.646581 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3317ad-8de3-4db3-9075-7b05f39ff769 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:57.646865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3317ad-8de3-4db3-9075-7b05f39ff769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:57.648541 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4f3317ad-8de3-4db3-9075-7b05f39ff769 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:57.655855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:57.746365 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3317ad-8de3-4db3-9075-7b05f39ff769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:57.748027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3317ad-8de3-4db3-9075-7b05f39ff769 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:57.768618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 734/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:58:58.581364 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5b621-08c2-4c08-b3a9-3eda1a82ca6f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:58.581999 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5b621-08c2-4c08-b3a9-3eda1a82ca6f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:58.581999 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5b621-08c2-4c08-b3a9-3eda1a82ca6f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:58.583262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 698/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 15:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:58:58.588408 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc9aa5-dca4-453b-9c14-2ed7f25feb37 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:58.588869 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc9aa5-dca4-453b-9c14-2ed7f25feb37 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:58.588971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc9aa5-dca4-453b-9c14-2ed7f25feb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:58.671452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-90cc9aa5-dca4-453b-9c14-2ed7f25feb37 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:58:58.672697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-90cc9aa5-dca4-453b-9c14-2ed7f25feb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:58.744800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:58.777195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 735/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 15:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:58:58.926547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5b621-08c2-4c08-b3a9-3eda1a82ca6f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:58:58.928114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d0e5b621-08c2-4c08-b3a9-3eda1a82ca6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:58.946283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:59.078727 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5b621-08c2-4c08-b3a9-3eda1a82ca6f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:58:59.172417 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:58:59.202189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c189f-87d6-4715-a629-8cdce85b9b0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:58:59.202844 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c189f-87d6-4715-a629-8cdce85b9b0d service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:58:59.203179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c189f-87d6-4715-a629-8cdce85b9b0d service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:58:59.203450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c189f-87d6-4715-a629-8cdce85b9b0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:58:59.205135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-898c189f-87d6-4715-a629-8cdce85b9b0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:58:59.299863 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c189f-87d6-4715-a629-8cdce85b9b0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:58:59.301598 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c189f-87d6-4715-a629-8cdce85b9b0d service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:58:59.320336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 699/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:00.120985 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b6f10-52a6-40b4-b90c-b77db63e3307 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:00.121588 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b6f10-52a6-40b4-b90c-b77db63e3307 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:00.121588 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b6f10-52a6-40b4-b90c-b77db63e3307 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:00.122956 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 736/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 15:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:00.128129 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fe1b6-b850-4a8f-8cc3-7e12edb4f7b1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:00.128601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fe1b6-b850-4a8f-8cc3-7e12edb4f7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:00.128713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fe1b6-b850-4a8f-8cc3-7e12edb4f7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:00.208290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-342fe1b6-b850-4a8f-8cc3-7e12edb4f7b1 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:00.209499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-342fe1b6-b850-4a8f-8cc3-7e12edb4f7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:00.252200 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:00.314717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 700/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 15:59:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:00.466654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b6f10-52a6-40b4-b90c-b77db63e3307 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:00.468207 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9b7b6f10-52a6-40b4-b90c-b77db63e3307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:00.620727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b6f10-52a6-40b4-b90c-b77db63e3307 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:00.681529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:00.742475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13cdc0-9db8-45c5-9596-ec423c6cb557 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:00.743108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13cdc0-9db8-45c5-9596-ec423c6cb557 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:00.743396 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13cdc0-9db8-45c5-9596-ec423c6cb557 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:00.743669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13cdc0-9db8-45c5-9596-ec423c6cb557 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:00.745363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ba13cdc0-9db8-45c5-9596-ec423c6cb557 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:00.840741 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13cdc0-9db8-45c5-9596-ec423c6cb557 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:00.842381 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13cdc0-9db8-45c5-9596-ec423c6cb557 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:00.862140 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 737/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:01.658796 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3da734-3215-4ef1-a8ba-57c61a738275 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:01.659380 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3da734-3215-4ef1-a8ba-57c61a738275 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:01.659380 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3da734-3215-4ef1-a8ba-57c61a738275 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:01.660848 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 701/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 15:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:01.666035 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc704ac-6e6e-4859-b7b3-81eeeb2074dd None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:01.666460 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc704ac-6e6e-4859-b7b3-81eeeb2074dd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:01.666591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc704ac-6e6e-4859-b7b3-81eeeb2074dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:01.744063 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7cc704ac-6e6e-4859-b7b3-81eeeb2074dd None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:01.745322 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7cc704ac-6e6e-4859-b7b3-81eeeb2074dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:01.747381 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:01.846667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 738/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 15:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:01.998234 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3da734-3215-4ef1-a8ba-57c61a738275 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:01.999773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3e3da734-3215-4ef1-a8ba-57c61a738275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:02.146226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3da734-3215-4ef1-a8ba-57c61a738275 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:02.175566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:02.264733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588674ea-27c2-4e41-9c96-876002bcd14b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:02.265379 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588674ea-27c2-4e41-9c96-876002bcd14b service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:02.265658 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588674ea-27c2-4e41-9c96-876002bcd14b service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:02.265926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588674ea-27c2-4e41-9c96-876002bcd14b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:02.267617 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-588674ea-27c2-4e41-9c96-876002bcd14b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:02.370699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588674ea-27c2-4e41-9c96-876002bcd14b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:02.372367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588674ea-27c2-4e41-9c96-876002bcd14b service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:02.394208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 702/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:04.311461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e160736-b31b-4497-b6dd-66df366e5d66 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:04.312070 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e160736-b31b-4497-b6dd-66df366e5d66 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:04.312070 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e160736-b31b-4497-b6dd-66df366e5d66 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:04.313509 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 739/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 15:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:04.319299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c26ba8-d9d6-44b5-a0bd-6a60bb6ea777 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:04.319777 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c26ba8-d9d6-44b5-a0bd-6a60bb6ea777 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:04.319881 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c26ba8-d9d6-44b5-a0bd-6a60bb6ea777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:04.363503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:04.390498 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a0c26ba8-d9d6-44b5-a0bd-6a60bb6ea777 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:04.392075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a0c26ba8-d9d6-44b5-a0bd-6a60bb6ea777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:04.495054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 703/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 15:59:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:04.534055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e160736-b31b-4497-b6dd-66df366e5d66 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:04.535704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3e160736-b31b-4497-b6dd-66df366e5d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:04.648159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e160736-b31b-4497-b6dd-66df366e5d66 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:04.682768 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:04.727161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7b206-bc0d-4ad5-a6f1-54ff324de038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:04.727825 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7b206-bc0d-4ad5-a6f1-54ff324de038 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:04.728112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7b206-bc0d-4ad5-a6f1-54ff324de038 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:04.728394 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7b206-bc0d-4ad5-a6f1-54ff324de038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:04.730062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-aab7b206-bc0d-4ad5-a6f1-54ff324de038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:04.853624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7b206-bc0d-4ad5-a6f1-54ff324de038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:04.855826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7b206-bc0d-4ad5-a6f1-54ff324de038 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:04.884738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 740/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:59:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:07.103436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b1911-a3db-4457-82c6-19418748fd67 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:07.104048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b1911-a3db-4457-82c6-19418748fd67 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:07.104048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b1911-a3db-4457-82c6-19418748fd67 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:07.105564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 704/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 15:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:07.113637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba8643-6beb-459c-9f48-7881476a70bf None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:07.113637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba8643-6beb-459c-9f48-7881476a70bf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:07.113637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba8643-6beb-459c-9f48-7881476a70bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:07.181417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-78ba8643-6beb-459c-9f48-7881476a70bf None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:07.182664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-78ba8643-6beb-459c-9f48-7881476a70bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:07.196876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:07.294543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 741/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 15:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 15:59:07.337533 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b1911-a3db-4457-82c6-19418748fd67 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:07.339149 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5e0b1911-a3db-4457-82c6-19418748fd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:07.455357 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b1911-a3db-4457-82c6-19418748fd67 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:07.470443 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:07.538881 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351ad42-52b3-4584-a466-d81bcd5ba145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:07.539551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ad42-52b3-4584-a466-d81bcd5ba145 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:07.539829 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ad42-52b3-4584-a466-d81bcd5ba145 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:07.540101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351ad42-52b3-4584-a466-d81bcd5ba145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:07.541882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a351ad42-52b3-4584-a466-d81bcd5ba145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:07.682292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351ad42-52b3-4584-a466-d81bcd5ba145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:07.683807 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351ad42-52b3-4584-a466-d81bcd5ba145 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:07.702538 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 705/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:59:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:10.170767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af53dc-fa4e-4ef1-a42d-32e89860ca7d None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:10.171403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af53dc-fa4e-4ef1-a42d-32e89860ca7d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:10.171403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af53dc-fa4e-4ef1-a42d-32e89860ca7d None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:10.172766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 742/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 15:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:10.179182 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e827178-99e4-449a-b952-4abc88952947 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:10.179684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e827178-99e4-449a-b952-4abc88952947 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:10.179789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e827178-99e4-449a-b952-4abc88952947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:10.231382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:10.251966 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0e827178-99e4-449a-b952-4abc88952947 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:10.253200 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0e827178-99e4-449a-b952-4abc88952947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:10.351891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 706/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 15:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:10.390963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af53dc-fa4e-4ef1-a42d-32e89860ca7d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:10.392598 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b0af53dc-fa4e-4ef1-a42d-32e89860ca7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:10.504230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af53dc-fa4e-4ef1-a42d-32e89860ca7d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:10.548511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:10.585520 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37dec8-9070-4c47-9e74-0027df0580bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:10.586224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37dec8-9070-4c47-9e74-0027df0580bd service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:10.586506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37dec8-9070-4c47-9e74-0027df0580bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:10.586782 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37dec8-9070-4c47-9e74-0027df0580bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:10.589079 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7b37dec8-9070-4c47-9e74-0027df0580bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:10.705307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37dec8-9070-4c47-9e74-0027df0580bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:10.706775 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b37dec8-9070-4c47-9e74-0027df0580bd service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:10.725843 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 743/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:12.847193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd235a3-87e6-434e-9bcb-0b20bfa36eae None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:12.847763 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd235a3-87e6-434e-9bcb-0b20bfa36eae None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:12.847763 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd235a3-87e6-434e-9bcb-0b20bfa36eae None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:12.849155 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 707/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 15:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:12.855087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbd389-fa62-4f0d-adf7-4a650b24ec6e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:12.855579 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbd389-fa62-4f0d-adf7-4a650b24ec6e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:12.855682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cbd389-fa62-4f0d-adf7-4a650b24ec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:13.045692 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e9cbd389-fa62-4f0d-adf7-4a650b24ec6e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:13.046952 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e9cbd389-fa62-4f0d-adf7-4a650b24ec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:13.067909 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:13.150563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 744/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 15:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:13.189116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd235a3-87e6-434e-9bcb-0b20bfa36eae None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:13.190658 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1fd235a3-87e6-434e-9bcb-0b20bfa36eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:13.308853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd235a3-87e6-434e-9bcb-0b20bfa36eae None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:13.329657 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:13.389372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178577c4-4f47-45d0-8401-f714ace4ac86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:13.390036 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178577c4-4f47-45d0-8401-f714ace4ac86 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:13.390317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178577c4-4f47-45d0-8401-f714ace4ac86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:13.390588 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178577c4-4f47-45d0-8401-f714ace4ac86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:13.392348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-178577c4-4f47-45d0-8401-f714ace4ac86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:13.504645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178577c4-4f47-45d0-8401-f714ace4ac86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:13.506105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178577c4-4f47-45d0-8401-f714ace4ac86 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:13.524882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 708/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:15.654104 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c03fe-f798-4013-8621-96052c86e181 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:15.654690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c03fe-f798-4013-8621-96052c86e181 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:15.654690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c03fe-f798-4013-8621-96052c86e181 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:15.656100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 745/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 15:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:15.661776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfda52c-4fea-4082-a128-0e06789d7f77 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:15.662523 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfda52c-4fea-4082-a128-0e06789d7f77 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:15.662695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfda52c-4fea-4082-a128-0e06789d7f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:15.739918 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:15.743256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2dfda52c-4fea-4082-a128-0e06789d7f77 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:15.745193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2dfda52c-4fea-4082-a128-0e06789d7f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:15.861899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 709/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 15:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:15.902279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c03fe-f798-4013-8621-96052c86e181 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:15.903914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e76c03fe-f798-4013-8621-96052c86e181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:16.019477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c03fe-f798-4013-8621-96052c86e181 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:16.071061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:16.098112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97042b3-8132-4993-9257-c33d4861d295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:16.098770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97042b3-8132-4993-9257-c33d4861d295 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:16.099094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97042b3-8132-4993-9257-c33d4861d295 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:16.099373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97042b3-8132-4993-9257-c33d4861d295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:16.101022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c97042b3-8132-4993-9257-c33d4861d295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:16.218198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97042b3-8132-4993-9257-c33d4861d295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:16.219690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97042b3-8132-4993-9257-c33d4861d295 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:16.238302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 746/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:18.317212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff2042-e3f8-4cd6-9a8c-99941c6338c7 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:18.317758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff2042-e3f8-4cd6-9a8c-99941c6338c7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:18.317758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff2042-e3f8-4cd6-9a8c-99941c6338c7 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:18.319163 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 710/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 15:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:18.324575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa206f53-04e3-451d-b7d5-bb4a702021fe None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:18.325008 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa206f53-04e3-451d-b7d5-bb4a702021fe None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:18.325100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa206f53-04e3-451d-b7d5-bb4a702021fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:18.396793 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-aa206f53-04e3-451d-b7d5-bb4a702021fe None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:18.398034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-aa206f53-04e3-451d-b7d5-bb4a702021fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:18.428905 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:18.498110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 747/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 15:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:18.537135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff2042-e3f8-4cd6-9a8c-99941c6338c7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:18.538697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c2ff2042-e3f8-4cd6-9a8c-99941c6338c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:18.647147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff2042-e3f8-4cd6-9a8c-99941c6338c7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:18.677186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:18.725907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770de0b-af81-4c08-ace5-0cb8948a2e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:18.726561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770de0b-af81-4c08-ace5-0cb8948a2e4c service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:18.726851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770de0b-af81-4c08-ace5-0cb8948a2e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:18.727130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770de0b-af81-4c08-ace5-0cb8948a2e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:18.728795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9770de0b-af81-4c08-ace5-0cb8948a2e4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:18.848722 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770de0b-af81-4c08-ace5-0cb8948a2e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:18.850159 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9770de0b-af81-4c08-ace5-0cb8948a2e4c service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:18.868783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 711/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:20.994437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2504b0e-b83f-4014-a532-d7289b560162 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:20.995036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2504b0e-b83f-4014-a532-d7289b560162 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:20.995036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2504b0e-b83f-4014-a532-d7289b560162 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:20.996399 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 748/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 15:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:21.002157 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4668d10-d3bf-40e7-9b68-3250d7c49c40 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:21.002639 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4668d10-d3bf-40e7-9b68-3250d7c49c40 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:21.002747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4668d10-d3bf-40e7-9b68-3250d7c49c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:21.072141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f4668d10-d3bf-40e7-9b68-3250d7c49c40 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:21.073372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f4668d10-d3bf-40e7-9b68-3250d7c49c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:21.082531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:21.179389 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 712/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 15:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:21.217679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2504b0e-b83f-4014-a532-d7289b560162 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:21.219292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a2504b0e-b83f-4014-a532-d7289b560162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:21.330538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2504b0e-b83f-4014-a532-d7289b560162 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:21.388881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:21.408222 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76ab80-341c-4433-b34c-a0e39cd74a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:21.408886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76ab80-341c-4433-b34c-a0e39cd74a7d service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:21.409171 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76ab80-341c-4433-b34c-a0e39cd74a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:21.409451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76ab80-341c-4433-b34c-a0e39cd74a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:21.411182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ad76ab80-341c-4433-b34c-a0e39cd74a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:21.528704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76ab80-341c-4433-b34c-a0e39cd74a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:21.530193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76ab80-341c-4433-b34c-a0e39cd74a7d service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:21.549024 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 749/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:23.603963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b03f-804a-41d5-b301-521863b9a57f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:23.604493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b03f-804a-41d5-b301-521863b9a57f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:23.604493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6b03f-804a-41d5-b301-521863b9a57f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:23.606034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 713/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 15:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:23.611665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad22df-d40b-44f3-ba95-2830e6868e15 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:23.612096 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad22df-d40b-44f3-ba95-2830e6868e15 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:23.612215 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad22df-d40b-44f3-ba95-2830e6868e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:23.685171 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c4ad22df-d40b-44f3-ba95-2830e6868e15 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:23.686400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c4ad22df-d40b-44f3-ba95-2830e6868e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:23.724432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:23.784524 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 750/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 15:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:23.822484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b03f-804a-41d5-b301-521863b9a57f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:23.824138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-55c6b03f-804a-41d5-b301-521863b9a57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:23.935934 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6b03f-804a-41d5-b301-521863b9a57f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:23.974375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:24.013576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21542d-9e69-4cce-82bc-337845c78204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:24.014235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21542d-9e69-4cce-82bc-337845c78204 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:24.014522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21542d-9e69-4cce-82bc-337845c78204 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:24.014802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21542d-9e69-4cce-82bc-337845c78204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:24.016551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6a21542d-9e69-4cce-82bc-337845c78204 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:24.131663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21542d-9e69-4cce-82bc-337845c78204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:24.133031 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21542d-9e69-4cce-82bc-337845c78204 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:24.151962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 714/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:59:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:26.276477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3fa49-c836-45c7-bb57-4c91f2fb6ccc None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:26.277041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3fa49-c836-45c7-bb57-4c91f2fb6ccc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:26.277041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae3fa49-c836-45c7-bb57-4c91f2fb6ccc None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:26.278374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 751/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 15:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 15:59:26.284134 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe12054-5676-46fe-becf-2ef5f1b85c6b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:26.284565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe12054-5676-46fe-becf-2ef5f1b85c6b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:26.284676 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe12054-5676-46fe-becf-2ef5f1b85c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:26.355961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8fe12054-5676-46fe-becf-2ef5f1b85c6b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:26.357203 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8fe12054-5676-46fe-becf-2ef5f1b85c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:26.375819 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:26.458511 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 715/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 15:59:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:26.495714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3fa49-c836-45c7-bb57-4c91f2fb6ccc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:26.497248 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2ae3fa49-c836-45c7-bb57-4c91f2fb6ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:26.614588 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae3fa49-c836-45c7-bb57-4c91f2fb6ccc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:26.685052 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:26.692776 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7221175-8ec5-4099-a43d-dab2e9db9af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:26.693444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7221175-8ec5-4099-a43d-dab2e9db9af7 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:26.693728 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7221175-8ec5-4099-a43d-dab2e9db9af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:26.694007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7221175-8ec5-4099-a43d-dab2e9db9af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:26.695697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a7221175-8ec5-4099-a43d-dab2e9db9af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:26.811544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7221175-8ec5-4099-a43d-dab2e9db9af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:26.812986 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7221175-8ec5-4099-a43d-dab2e9db9af7 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:26.832300 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 752/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:59:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:28.880416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189101f-653b-40fa-bf72-a7370b40f804 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:28.881017 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189101f-653b-40fa-bf72-a7370b40f804 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:28.881017 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189101f-653b-40fa-bf72-a7370b40f804 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:28.882269 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 716/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 15:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:28.887965 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae2a39-1706-4b51-9244-8d182f28f414 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:28.888407 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae2a39-1706-4b51-9244-8d182f28f414 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:28.888515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae2a39-1706-4b51-9244-8d182f28f414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:28.963248 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e2ae2a39-1706-4b51-9244-8d182f28f414 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:28.964494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e2ae2a39-1706-4b51-9244-8d182f28f414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:29.018489 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:29.068939 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 753/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 15:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:29.106312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189101f-653b-40fa-bf72-a7370b40f804 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:29.107999 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d189101f-653b-40fa-bf72-a7370b40f804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:29.219711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d189101f-653b-40fa-bf72-a7370b40f804 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:29.267975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:29.296289 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dad650-f649-4c8a-8c1f-71d761af1924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:29.296976 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dad650-f649-4c8a-8c1f-71d761af1924 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:29.297296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dad650-f649-4c8a-8c1f-71d761af1924 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:29.297613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dad650-f649-4c8a-8c1f-71d761af1924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:29.299394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a1dad650-f649-4c8a-8c1f-71d761af1924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:29.414638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dad650-f649-4c8a-8c1f-71d761af1924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:29.416114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dad650-f649-4c8a-8c1f-71d761af1924 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:29.434682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 717/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:39.067173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=22 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:39.432185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=66 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:48.903636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55e1ad-9ee0-45da-9320-ea9079d126aa None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:48.904229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55e1ad-9ee0-45da-9320-ea9079d126aa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:48.904229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55e1ad-9ee0-45da-9320-ea9079d126aa None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:48.905539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 754/1471] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:48.910845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eefb8-5af2-4286-874a-320ac5fe4faa None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:48.911285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eefb8-5af2-4286-874a-320ac5fe4faa None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:48.911397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eefb8-5af2-4286-874a-320ac5fe4faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:48.979144 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1a6eefb8-5af2-4286-874a-320ac5fe4faa None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:48.980364 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1a6eefb8-5af2-4286-874a-320ac5fe4faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:49.079572 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 718/1472] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:49.164742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc4520-0527-4b35-800a-7b356714c4c7 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:49.165032 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc4520-0527-4b35-800a-7b356714c4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:49.165303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc4520-0527-4b35-800a-7b356714c4c7 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:49.166714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 755/1473] 10.222.0.64 () {54 vars in 966 bytes} [Thu Jul 21 15:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:49.171675 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8ada3-b2d9-4822-bdba-30215157e0fd None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:49.171967 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8ada3-b2d9-4822-bdba-30215157e0fd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:49.172246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe8ada3-b2d9-4822-bdba-30215157e0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:49.253654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-efe8ada3-b2d9-4822-bdba-30215157e0fd None None] MFA Rules not processed for user `1a3418c0b46c404c8ca445cce9db632d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:49.254912 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-efe8ada3-b2d9-4822-bdba-30215157e0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:49.282494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:49.344882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 719/1474] 10.222.0.64 () {58 vars in 1063 bytes} [Thu Jul 21 15:59:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:49.352364 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc4520-0527-4b35-800a-7b356714c4c7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:49.353876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4adc4520-0527-4b35-800a-7b356714c4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:49.460755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc4520-0527-4b35-800a-7b356714c4c7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:49.538154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0306a-7b3d-4357-8c07-ecad6361775c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3418c0b46c404c8ca445cce9db632d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:49.538848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0306a-7b3d-4357-8c07-ecad6361775c service glance] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:49.539137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0306a-7b3d-4357-8c07-ecad6361775c service glance] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:49.539409 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0306a-7b3d-4357-8c07-ecad6361775c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:49.541066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8ba0306a-7b3d-4357-8c07-ecad6361775c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:49.598408 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:49.657034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0306a-7b3d-4357-8c07-ecad6361775c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:49.658589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0306a-7b3d-4357-8c07-ecad6361775c service glance] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:49.677464 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 756/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:51.765976 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87049b-546b-4431-a4ee-8783b03c18bd None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:51.766565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87049b-546b-4431-a4ee-8783b03c18bd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:51.766565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87049b-546b-4431-a4ee-8783b03c18bd None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:51.767904 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 720/1476] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:51.773352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe6b55-da1a-4e53-af4a-e868a825918d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:51.773838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe6b55-da1a-4e53-af4a-e868a825918d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:51.773951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe6b55-da1a-4e53-af4a-e868a825918d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:51.839159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-edfe6b55-da1a-4e53-af4a-e868a825918d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:51.840350 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-edfe6b55-da1a-4e53-af4a-e868a825918d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:51.941289 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 757/1477] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:59:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:51.965429 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87049b-546b-4431-a4ee-8783b03c18bd None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:51.967007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0d87049b-546b-4431-a4ee-8783b03c18bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:52.100409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87049b-546b-4431-a4ee-8783b03c18bd None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:52.153439 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:52.201052 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309e96c-fd43-4c3b-bfff-da2b6545470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:52.201762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e96c-fd43-4c3b-bfff-da2b6545470c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:52.202043 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e96c-fd43-4c3b-bfff-da2b6545470c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:52.202316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e96c-fd43-4c3b-bfff-da2b6545470c admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:52.203086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309e96c-fd43-4c3b-bfff-da2b6545470c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:52.204935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-8309e96c-fd43-4c3b-bfff-da2b6545470c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 15:59:52.204935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: warnings.warn(msg) Jul 21 15:59:52.204935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: Jul 21 15:59:52.206092 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309e96c-fd43-4c3b-bfff-da2b6545470c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:52.226590 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 721/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Jul 21 15:59:51 2022] GET /identity/v3/projects => generated 2553 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 15:59:54.257972 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86087aa-8453-4104-b52f-3f7442608a0a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:54.258602 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86087aa-8453-4104-b52f-3f7442608a0a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:54.258602 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86087aa-8453-4104-b52f-3f7442608a0a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:54.259958 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 758/1479] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:54.266108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f4310-04c8-4ed8-a721-b2bfa45b292c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:54.266630 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f4310-04c8-4ed8-a721-b2bfa45b292c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:54.266740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f4310-04c8-4ed8-a721-b2bfa45b292c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:54.338474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8f5f4310-04c8-4ed8-a721-b2bfa45b292c None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:54.339781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8f5f4310-04c8-4ed8-a721-b2bfa45b292c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:54.443143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 722/1480] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:59:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:54.486438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86087aa-8453-4104-b52f-3f7442608a0a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:54.488037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c86087aa-8453-4104-b52f-3f7442608a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:54.498182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:54.639226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86087aa-8453-4104-b52f-3f7442608a0a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:54.719612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:54.753235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05994a7-2d18-4db6-ade1-df43c3363e82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:54.753805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05994a7-2d18-4db6-ade1-df43c3363e82 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:54.754083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05994a7-2d18-4db6-ade1-df43c3363e82 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:54.754354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05994a7-2d18-4db6-ade1-df43c3363e82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:54.756128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e05994a7-2d18-4db6-ade1-df43c3363e82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:54.846670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05994a7-2d18-4db6-ade1-df43c3363e82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:54.848290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05994a7-2d18-4db6-ade1-df43c3363e82 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:54.866771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 759/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:57.089197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea28aa-a009-403c-9ae1-d6c4026dbf36 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:57.089803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea28aa-a009-403c-9ae1-d6c4026dbf36 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:57.089803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ea28aa-a009-403c-9ae1-d6c4026dbf36 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:57.091222 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 723/1482] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:57.096682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84f3d0-666d-450b-b983-38784d0ffcce None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:57.097185 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84f3d0-666d-450b-b983-38784d0ffcce None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:57.097293 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84f3d0-666d-450b-b983-38784d0ffcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:57.168217 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3b84f3d0-666d-450b-b983-38784d0ffcce None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:57.169453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3b84f3d0-666d-450b-b983-38784d0ffcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:57.219747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:57.277724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 760/1483] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 15:59:57.315569 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea28aa-a009-403c-9ae1-d6c4026dbf36 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 15:59:57.317209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e7ea28aa-a009-403c-9ae1-d6c4026dbf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:57.345585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:57.446624 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ea28aa-a009-403c-9ae1-d6c4026dbf36 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 15:59:57.526648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d6122-8666-4ade-a276-8b1407cb94bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 15:59:57.527324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d6122-8666-4ade-a276-8b1407cb94bd service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:57.527603 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d6122-8666-4ade-a276-8b1407cb94bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:57.527891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d6122-8666-4ade-a276-8b1407cb94bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:57.529557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ae2d6122-8666-4ade-a276-8b1407cb94bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 15:59:57.613557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 15:59:57.654955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d6122-8666-4ade-a276-8b1407cb94bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 15:59:57.656416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d6122-8666-4ade-a276-8b1407cb94bd service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 15:59:57.677445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 724/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 15:59:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 15:59:59.816592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207a334-c0b0-498b-a93b-6f6e1491879a None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:59.817253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207a334-c0b0-498b-a93b-6f6e1491879a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:59.817253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207a334-c0b0-498b-a93b-6f6e1491879a None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:59.818582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 761/1485] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 15:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 15:59:59.824636 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082f481-46e6-4f84-8f9b-6cb8f7196577 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 15:59:59.825152 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082f481-46e6-4f84-8f9b-6cb8f7196577 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 15:59:59.825152 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082f481-46e6-4f84-8f9b-6cb8f7196577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 15:59:59.897719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a082f481-46e6-4f84-8f9b-6cb8f7196577 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 15:59:59.898884 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a082f481-46e6-4f84-8f9b-6cb8f7196577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:00:00.015849 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 725/1486] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 15:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:00:00.055116 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207a334-c0b0-498b-a93b-6f6e1491879a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:00:00.056678 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2207a334-c0b0-498b-a93b-6f6e1491879a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:00:00.172610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207a334-c0b0-498b-a93b-6f6e1491879a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:00:00.256542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:00:00.258578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1c178-0418-49d3-944a-2a224df3b624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:00:00.259388 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1c178-0418-49d3-944a-2a224df3b624 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:00:00.259672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1c178-0418-49d3-944a-2a224df3b624 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:00:00.259946 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1c178-0418-49d3-944a-2a224df3b624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:00:00.262235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1ca1c178-0418-49d3-944a-2a224df3b624 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:00:00.385409 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1c178-0418-49d3-944a-2a224df3b624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:00:00.386879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1c178-0418-49d3-944a-2a224df3b624 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:00:00.405790 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 762/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:00:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:00:02.595111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce818f5-1338-4b86-ac68-71640e42a358 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:00:02.595727 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce818f5-1338-4b86-ac68-71640e42a358 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:00:02.595727 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce818f5-1338-4b86-ac68-71640e42a358 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:00:02.597037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 726/1488] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 16:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:00:02.602439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fdab1-4393-434f-86b3-2b6965745eea None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:00:02.602911 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fdab1-4393-434f-86b3-2b6965745eea None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:00:02.603007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638fdab1-4393-434f-86b3-2b6965745eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:00:02.671216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-638fdab1-4393-434f-86b3-2b6965745eea None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:00:02.672481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-638fdab1-4393-434f-86b3-2b6965745eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:00:02.727566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:00:02.776276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 763/1489] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 16:00:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:00:02.816856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce818f5-1338-4b86-ac68-71640e42a358 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:00:02.818423 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bce818f5-1338-4b86-ac68-71640e42a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:00:02.857285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:00:02.928754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce818f5-1338-4b86-ac68-71640e42a358 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:00:03.008220 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c96cc2-fa9c-41b6-b19d-0790f7f64870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:00:03.008879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c96cc2-fa9c-41b6-b19d-0790f7f64870 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:00:03.009163 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c96cc2-fa9c-41b6-b19d-0790f7f64870 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:00:03.009434 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c96cc2-fa9c-41b6-b19d-0790f7f64870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:00:03.011244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-01c96cc2-fa9c-41b6-b19d-0790f7f64870 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:00:03.100111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:00:03.129550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c96cc2-fa9c-41b6-b19d-0790f7f64870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:00:03.130945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c96cc2-fa9c-41b6-b19d-0790f7f64870 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:00:03.149994 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 727/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:00:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:00:05.455759 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd3e1-2029-4379-839e-c071678bc194 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:00:05.456311 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd3e1-2029-4379-839e-c071678bc194 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:00:05.456311 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bd3e1-2029-4379-839e-c071678bc194 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:00:05.457609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 764/1491] 10.222.0.64 () {54 vars in 926 bytes} [Thu Jul 21 16:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:00:05.463465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6888f7f-75ce-4860-828a-0efbf2f7d4de None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:00:05.463916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6888f7f-75ce-4860-828a-0efbf2f7d4de None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:00:05.464020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6888f7f-75ce-4860-828a-0efbf2f7d4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:00:05.530613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b6888f7f-75ce-4860-828a-0efbf2f7d4de None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:00:05.531858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b6888f7f-75ce-4860-828a-0efbf2f7d4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:00:05.636625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 728/1492] 10.222.0.64 () {58 vars in 1023 bytes} [Thu Jul 21 16:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:00:05.679614 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bd3e1-2029-4379-839e-c071678bc194 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:00:05.681198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e71bd3e1-2029-4379-839e-c071678bc194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:00:05.789288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bd3e1-2029-4379-839e-c071678bc194 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:00:05.870544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a6368-ddb9-4094-9a88-7c247e90f44c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:00:05.871239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a6368-ddb9-4094-9a88-7c247e90f44c service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:00:05.871516 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a6368-ddb9-4094-9a88-7c247e90f44c service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:00:05.871764 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a6368-ddb9-4094-9a88-7c247e90f44c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:00:05.873444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0a0a6368-ddb9-4094-9a88-7c247e90f44c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:00:05.884051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:00:05.998873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a6368-ddb9-4094-9a88-7c247e90f44c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:00:06.000355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a6368-ddb9-4094-9a88-7c247e90f44c service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:00:06.019655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 765/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:00:15.634649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=82 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:00:16.016687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=50 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:01:31.447226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db20d9-e933-4eac-ac9f-8a156f8ac48f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:31.447805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db20d9-e933-4eac-ac9f-8a156f8ac48f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:31.447805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17db20d9-e933-4eac-ac9f-8a156f8ac48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:31.523329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-17db20d9-e933-4eac-ac9f-8a156f8ac48f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:01:31.525961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-17db20d9-e933-4eac-ac9f-8a156f8ac48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:31.625958 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 729/1494] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:01:31.634218 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b8421-ec8d-490d-8927-35aeae6bae92 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:31.634691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b8421-ec8d-490d-8927-35aeae6bae92 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:31.634836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b8421-ec8d-490d-8927-35aeae6bae92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:31.718414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c04b8421-ec8d-490d-8927-35aeae6bae92 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:01:31.719536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c04b8421-ec8d-490d-8927-35aeae6bae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:31.820328 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 766/1495] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:01:31.825393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db20d9-e933-4eac-ac9f-8a156f8ac48f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:01:31.826984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-17db20d9-e933-4eac-ac9f-8a156f8ac48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:31.839066 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17db20d9-e933-4eac-ac9f-8a156f8ac48f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:01:31.902780 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:01:31.937860 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a54f6-3866-4e6a-90dc-0515aa71ba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:01:31.938524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a54f6-3866-4e6a-90dc-0515aa71ba62 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:31.938808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a54f6-3866-4e6a-90dc-0515aa71ba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:31.939115 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a54f6-3866-4e6a-90dc-0515aa71ba62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:31.939846 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a54f6-3866-4e6a-90dc-0515aa71ba62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:01:31.940155 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a54f6-3866-4e6a-90dc-0515aa71ba62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:01:31.941190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-d67a54f6-3866-4e6a-90dc-0515aa71ba62 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 16:01:31.941190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: warnings.warn(msg) Jul 21 16:01:31.941190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: Jul 21 16:01:31.942086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a54f6-3866-4e6a-90dc-0515aa71ba62 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:01:31.953955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 730/1496] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:01:31.962289 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b8421-ec8d-490d-8927-35aeae6bae92 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:01:31.972108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b8421-ec8d-490d-8927-35aeae6bae92 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:01:32.036944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:01:32.072479 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee02c5-63be-4400-b142-5c72a5ffdc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:01:32.073153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee02c5-63be-4400-b142-5c72a5ffdc85 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:32.073441 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee02c5-63be-4400-b142-5c72a5ffdc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:32.073722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee02c5-63be-4400-b142-5c72a5ffdc85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:32.074419 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee02c5-63be-4400-b142-5c72a5ffdc85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:01:32.076552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: WARNING py.warnings [None req-0cee02c5-63be-4400-b142-5c72a5ffdc85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 16:01:32.076552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: warnings.warn(msg) Jul 21 16:01:32.076552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: Jul 21 16:01:32.077867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cee02c5-63be-4400-b142-5c72a5ffdc85 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:01:32.136826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 767/1497] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:01:31 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:01:32.141479 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a54f6-3866-4e6a-90dc-0515aa71ba62 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:01:32.143212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d67a54f6-3866-4e6a-90dc-0515aa71ba62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:32.179129 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a54f6-3866-4e6a-90dc-0515aa71ba62 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:01:32.278013 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f9274-1873-40bb-bf0f-e658248ae0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:01:32.278601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f9274-1873-40bb-bf0f-e658248ae0e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:32.278916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f9274-1873-40bb-bf0f-e658248ae0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:32.279191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f9274-1873-40bb-bf0f-e658248ae0e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:32.279871 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f9274-1873-40bb-bf0f-e658248ae0e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:01:32.280946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-353f9274-1873-40bb-bf0f-e658248ae0e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 16:01:32.280946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: warnings.warn(msg) Jul 21 16:01:32.280946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: Jul 21 16:01:32.282134 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f9274-1873-40bb-bf0f-e658248ae0e5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:01:32.323532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 731/1498] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:01:32 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:01:32.328553 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee02c5-63be-4400-b142-5c72a5ffdc85 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:01:32.330308 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0cee02c5-63be-4400-b142-5c72a5ffdc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:32.395524 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee02c5-63be-4400-b142-5c72a5ffdc85 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:01:32.481664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:01:32.493203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c99ab8-6e78-43fe-87e9-306e2bd22afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:01:32.493873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c99ab8-6e78-43fe-87e9-306e2bd22afc admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:32.494154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c99ab8-6e78-43fe-87e9-306e2bd22afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:32.494426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c99ab8-6e78-43fe-87e9-306e2bd22afc admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:32.495189 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c99ab8-6e78-43fe-87e9-306e2bd22afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:01:32.496206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: WARNING py.warnings [None req-22c99ab8-6e78-43fe-87e9-306e2bd22afc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 16:01:32.496206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: warnings.warn(msg) Jul 21 16:01:32.496206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: Jul 21 16:01:32.497081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c99ab8-6e78-43fe-87e9-306e2bd22afc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:01:32.509683 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 768/1499] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:01:32.514678 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f9274-1873-40bb-bf0f-e658248ae0e5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:01:32.517553 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-353f9274-1873-40bb-bf0f-e658248ae0e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:32.536905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f9274-1873-40bb-bf0f-e658248ae0e5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:01:32.562442 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:01:32.635933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb89b3b-c686-4fe3-92a8-1909fd75886c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:01:32.636615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb89b3b-c686-4fe3-92a8-1909fd75886c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:32.636899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb89b3b-c686-4fe3-92a8-1909fd75886c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:32.637173 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb89b3b-c686-4fe3-92a8-1909fd75886c admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:32.637903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb89b3b-c686-4fe3-92a8-1909fd75886c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:01:32.638964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-cfb89b3b-c686-4fe3-92a8-1909fd75886c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 16:01:32.638964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: warnings.warn(msg) Jul 21 16:01:32.638964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: Jul 21 16:01:32.639901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb89b3b-c686-4fe3-92a8-1909fd75886c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:01:32.652536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 732/1500] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:01:32.656901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c99ab8-6e78-43fe-87e9-306e2bd22afc admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:01:32.658439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-22c99ab8-6e78-43fe-87e9-306e2bd22afc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:32.691432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c99ab8-6e78-43fe-87e9-306e2bd22afc admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:01:32.786187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f15910-2a58-41f0-b5d9-32c663997cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:01:32.787199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15910-2a58-41f0-b5d9-32c663997cd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:32.787390 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15910-2a58-41f0-b5d9-32c663997cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:32.787687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f15910-2a58-41f0-b5d9-32c663997cd3 admin admin] PATH_INFO: `/v3/projects/11bbd57a0391474ba8dda9ae6ef92592/users/2fd84f1f82c74ba796f8288d19320310/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:32.810227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f15910-2a58-41f0-b5d9-32c663997cd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11bbd57a0391474ba8dda9ae6ef92592, user_id=2fd84f1f82c74ba796f8288d19320310, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:01:32.811299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: WARNING py.warnings [None req-66f15910-2a58-41f0-b5d9-32c663997cd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 16:01:32.811299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: warnings.warn(msg) Jul 21 16:01:32.811299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: Jul 21 16:01:32.813283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f15910-2a58-41f0-b5d9-32c663997cd3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:01:32.840380 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 769/1501] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:01:32 2022] PUT /identity/v3/projects/11bbd57a0391474ba8dda9ae6ef92592/users/2fd84f1f82c74ba796f8288d19320310/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:01:32.852714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fdfa3-0ee2-4b5f-860e-6b548080f7ca None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:32.853089 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fdfa3-0ee2-4b5f-860e-6b548080f7ca None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:32.853439 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fdfa3-0ee2-4b5f-860e-6b548080f7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:32.910698 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5a0fdfa3-0ee2-4b5f-860e-6b548080f7ca None None] MFA Rules not processed for user `2fd84f1f82c74ba796f8288d19320310`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:01:32.911965 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5a0fdfa3-0ee2-4b5f-860e-6b548080f7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:32.996486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 733/1502] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:01:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:01:33.010527 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50852f-73f4-49b8-bda1-efcff56b7eab None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:33.010845 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50852f-73f4-49b8-bda1-efcff56b7eab None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:33.011140 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50852f-73f4-49b8-bda1-efcff56b7eab None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:33.012618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 770/1503] 10.222.0.64 () {54 vars in 964 bytes} [Thu Jul 21 16:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:01:33.017566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45022147-a5e8-4805-a54f-1afaf1122669 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:33.017847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45022147-a5e8-4805-a54f-1afaf1122669 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:33.018080 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45022147-a5e8-4805-a54f-1afaf1122669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:33.047956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:01:33.092901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-45022147-a5e8-4805-a54f-1afaf1122669 None None] MFA Rules not processed for user `d8c629ecd4014e2b8051b853a0b4c18a`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:01:33.094112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-45022147-a5e8-4805-a54f-1afaf1122669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:33.173624 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 734/1504] 10.222.0.64 () {58 vars in 1061 bytes} [Thu Jul 21 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:01:33.181416 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50852f-73f4-49b8-bda1-efcff56b7eab None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:01:33.183052 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fb50852f-73f4-49b8-bda1-efcff56b7eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:33.238584 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:01:33.294599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50852f-73f4-49b8-bda1-efcff56b7eab None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:01:33.370141 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99959c11-759f-4774-9be3-b936b3f8013e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:01:33.370738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99959c11-759f-4774-9be3-b936b3f8013e service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:33.371044 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99959c11-759f-4774-9be3-b936b3f8013e service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:33.371316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99959c11-759f-4774-9be3-b936b3f8013e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:33.373319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-99959c11-759f-4774-9be3-b936b3f8013e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:33.477744 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99959c11-759f-4774-9be3-b936b3f8013e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:01:33.479223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99959c11-759f-4774-9be3-b936b3f8013e service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:01:33.482725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:01:33.497916 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 771/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:01:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:01:33.539775 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd789c-faa8-4ecd-938c-8f38eff642a8 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:33.541473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd789c-faa8-4ecd-938c-8f38eff642a8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:33.541473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd789c-faa8-4ecd-938c-8f38eff642a8 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:33.542162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 735/1506] 10.222.0.64 () {52 vars in 829 bytes} [Thu Jul 21 16:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:01:33.546136 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99959c11-759f-4774-9be3-b936b3f8013e service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:01:33.547435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-99959c11-759f-4774-9be3-b936b3f8013e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:33.649511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99959c11-759f-4774-9be3-b936b3f8013e service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:01:33.753434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ee5a0-d130-4dba-982a-4378d93ac2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:01:33.754322 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ee5a0-d130-4dba-982a-4378d93ac2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:33.754596 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ee5a0-d130-4dba-982a-4378d93ac2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:33.754867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ee5a0-d130-4dba-982a-4378d93ac2d9 admin admin] PATH_INFO: `/v3/users/2fd84f1f82c74ba796f8288d19320310` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:33.768172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ee5a0-d130-4dba-982a-4378d93ac2d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fd84f1f82c74ba796f8288d19320310)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:01:33.769185 dv-cinder-850668-1-smb devstack@keystone.service[80252]: WARNING py.warnings [None req-a48ee5a0-d130-4dba-982a-4378d93ac2d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 16:01:33.769185 dv-cinder-850668-1-smb devstack@keystone.service[80252]: warnings.warn(msg) Jul 21 16:01:33.769185 dv-cinder-850668-1-smb devstack@keystone.service[80252]: Jul 21 16:01:33.770440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ee5a0-d130-4dba-982a-4378d93ac2d9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:01:33.780572 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:01:33.834496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a48ee5a0-d130-4dba-982a-4378d93ac2d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fd84f1f82c74ba796f8288d19320310'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:01:33.855801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a48ee5a0-d130-4dba-982a-4378d93ac2d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fd84f1f82c74ba796f8288d19320310'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:01:33.865714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a48ee5a0-d130-4dba-982a-4378d93ac2d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fd84f1f82c74ba796f8288d19320310'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:01:33.866196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a48ee5a0-d130-4dba-982a-4378d93ac2d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fd84f1f82c74ba796f8288d19320310'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:01:33.881630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a48ee5a0-d130-4dba-982a-4378d93ac2d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fd84f1f82c74ba796f8288d19320310'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:01:33.887733 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 772/1507] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:01:33 2022] DELETE /identity/v3/users/2fd84f1f82c74ba796f8288d19320310 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:01:33.892289 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7c7fb-f9bb-4948-bb2d-556189678ad6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:33.892677 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7c7fb-f9bb-4948-bb2d-556189678ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:33.892960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7c7fb-f9bb-4948-bb2d-556189678ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:33.952237 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f4f7c7fb-f9bb-4948-bb2d-556189678ad6 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:01:33.953452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f4f7c7fb-f9bb-4948-bb2d-556189678ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:34.027515 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:01:34.040824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 736/1508] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:01:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:01:34.050669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ee5a0-d130-4dba-982a-4378d93ac2d9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:01:34.051970 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a48ee5a0-d130-4dba-982a-4378d93ac2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:34.161058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ee5a0-d130-4dba-982a-4378d93ac2d9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:01:34.226061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:01:34.248985 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2edc7-09f3-4813-a2f9-fea5990bbc49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:01:34.249647 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2edc7-09f3-4813-a2f9-fea5990bbc49 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:34.249931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2edc7-09f3-4813-a2f9-fea5990bbc49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:34.250202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2edc7-09f3-4813-a2f9-fea5990bbc49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:34.251875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-32a2edc7-09f3-4813-a2f9-fea5990bbc49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:34.364740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2edc7-09f3-4813-a2f9-fea5990bbc49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:01:34.366184 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2edc7-09f3-4813-a2f9-fea5990bbc49 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:01:34.386086 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 773/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:01:34.759209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7c7fb-f9bb-4948-bb2d-556189678ad6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:01:34.760478 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f4f7c7fb-f9bb-4948-bb2d-556189678ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:01:34.772650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7c7fb-f9bb-4948-bb2d-556189678ad6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:01:34.878618 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d019d1-59d6-41c0-b18c-3ad51257145e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:01:34.879532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d019d1-59d6-41c0-b18c-3ad51257145e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:01:34.879810 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d019d1-59d6-41c0-b18c-3ad51257145e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:01:34.880076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d019d1-59d6-41c0-b18c-3ad51257145e admin admin] PATH_INFO: `/v3/projects/11bbd57a0391474ba8dda9ae6ef92592` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:01:34.890932 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d019d1-59d6-41c0-b18c-3ad51257145e admin admin] RBAC: Authorizing `identity:delete_project(project_id=11bbd57a0391474ba8dda9ae6ef92592)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:01:34.891998 dv-cinder-850668-1-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-41d019d1-59d6-41c0-b18c-3ad51257145e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 16:01:34.891998 dv-cinder-850668-1-smb devstack@keystone.service[80253]: warnings.warn(msg) Jul 21 16:01:34.891998 dv-cinder-850668-1-smb devstack@keystone.service[80253]: Jul 21 16:01:34.893208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d019d1-59d6-41c0-b18c-3ad51257145e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:01:34.957664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-41d019d1-59d6-41c0-b18c-3ad51257145e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11bbd57a0391474ba8dda9ae6ef92592', 'request_id': 'req-41d019d1-59d6-41c0-b18c-3ad51257145e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:01:34.971693 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-41d019d1-59d6-41c0-b18c-3ad51257145e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11bbd57a0391474ba8dda9ae6ef92592', 'request_id': 'req-41d019d1-59d6-41c0-b18c-3ad51257145e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:01:34.978279 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-41d019d1-59d6-41c0-b18c-3ad51257145e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11bbd57a0391474ba8dda9ae6ef92592', 'request_id': 'req-41d019d1-59d6-41c0-b18c-3ad51257145e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:01:35.005325 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-41d019d1-59d6-41c0-b18c-3ad51257145e admin admin] The token cache is being invalidate because project 11bbd57a0391474ba8dda9ae6ef92592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:01:35.005553 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-41d019d1-59d6-41c0-b18c-3ad51257145e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:01:35.005945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-41d019d1-59d6-41c0-b18c-3ad51257145e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:01:35.007462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 737/1510] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:01:34 2022] DELETE /identity/v3/projects/11bbd57a0391474ba8dda9ae6ef92592 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:01:44.383466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=62 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:01:45.002839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:03:25.903939 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe90b3-9eee-412f-a32c-5e4146e0e82b None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:25.904824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe90b3-9eee-412f-a32c-5e4146e0e82b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:25.904824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe90b3-9eee-412f-a32c-5e4146e0e82b None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:25.905896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 774/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 16:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:03:25.911339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84caa2b-0763-4603-95c0-efa0d839e106 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:25.911948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84caa2b-0763-4603-95c0-efa0d839e106 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:25.911948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84caa2b-0763-4603-95c0-efa0d839e106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:26.000076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e84caa2b-0763-4603-95c0-efa0d839e106 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:03:26.002117 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e84caa2b-0763-4603-95c0-efa0d839e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:03:26.130906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 738/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 16:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:03:26.284470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe90b3-9eee-412f-a32c-5e4146e0e82b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:03:26.286904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-83fe90b3-9eee-412f-a32c-5e4146e0e82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:03:26.452629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe90b3-9eee-412f-a32c-5e4146e0e82b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:03:26.458731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e1e4d-994d-43f3-b2eb-b7fe4b123af7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:03:26.459425 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e1e4d-994d-43f3-b2eb-b7fe4b123af7 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:26.459715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e1e4d-994d-43f3-b2eb-b7fe4b123af7 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:26.459992 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e1e4d-994d-43f3-b2eb-b7fe4b123af7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:26.468594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e1e4d-994d-43f3-b2eb-b7fe4b123af7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:03:26.470199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e1e4d-994d-43f3-b2eb-b7fe4b123af7 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:03:26.480259 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 775/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:03:27.329253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b461e-0a50-4b82-88a3-67d91cd44c4f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:27.329851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b461e-0a50-4b82-88a3-67d91cd44c4f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:27.329851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b461e-0a50-4b82-88a3-67d91cd44c4f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:27.331201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 739/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 16:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:03:27.336697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0996c-a4d5-49d7-87e6-109a8f623f20 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:27.337215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9490f7-837b-4b71-a0f0-5de1a43717d3 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:27.337325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0996c-a4d5-49d7-87e6-109a8f623f20 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:27.337434 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9490f7-837b-4b71-a0f0-5de1a43717d3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:27.337530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0996c-a4d5-49d7-87e6-109a8f623f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:27.337627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9490f7-837b-4b71-a0f0-5de1a43717d3 None None] PATH_INFO: `/v3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:27.338651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 740/1515] 10.222.0.45 () {54 vars in 925 bytes} [Thu Jul 21 16:03:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:03:27.345311 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f43a36-8ea2-4d2a-95c7-369079c518d4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:27.345596 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f43a36-8ea2-4d2a-95c7-369079c518d4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:27.345873 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f43a36-8ea2-4d2a-95c7-369079c518d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:27.357912 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-93c0996c-a4d5-49d7-87e6-109a8f623f20 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:03:27.359593 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-93c0996c-a4d5-49d7-87e6-109a8f623f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:03:27.368811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 776/1516] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 16:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:03:27.407808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-64f43a36-8ea2-4d2a-95c7-369079c518d4 None None] MFA Rules not processed for user `1f4a46a051c241a2a47059052735c930`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:03:27.409040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-64f43a36-8ea2-4d2a-95c7-369079c518d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:03:27.443606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:03:27.487385 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 741/1517] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Jul 21 16:03:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:03:27.519523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0996c-a4d5-49d7-87e6-109a8f623f20 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:03:27.533004 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0996c-a4d5-49d7-87e6-109a8f623f20 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:03:27.540139 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b7e10-644f-45f3-9238-80eb58a3113b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:03:27.540789 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b7e10-644f-45f3-9238-80eb58a3113b service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:27.541078 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b7e10-644f-45f3-9238-80eb58a3113b service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:27.541355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b7e10-644f-45f3-9238-80eb58a3113b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:27.551582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b7e10-644f-45f3-9238-80eb58a3113b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:03:27.553220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14b7e10-644f-45f3-9238-80eb58a3113b service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:03:27.563875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 777/1518] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:03:36.776329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2867b6c-717f-4a36-9936-0e0a8fc81a62 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:36.776890 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2867b6c-717f-4a36-9936-0e0a8fc81a62 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:36.776890 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2867b6c-717f-4a36-9936-0e0a8fc81a62 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:36.778209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 742/1519] 10.222.0.64 () {54 vars in 961 bytes} [Thu Jul 21 16:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:03:36.783572 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0ed44-4fe8-4b0c-95db-3200d6b5800c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:36.784005 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0ed44-4fe8-4b0c-95db-3200d6b5800c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:36.784176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa0ed44-4fe8-4b0c-95db-3200d6b5800c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:36.803139 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8aa0ed44-4fe8-4b0c-95db-3200d6b5800c None None] MFA Rules not processed for user `1f4a46a051c241a2a47059052735c930`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:03:36.804351 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8aa0ed44-4fe8-4b0c-95db-3200d6b5800c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:03:36.813848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 778/1520] 10.222.0.64 () {58 vars in 1058 bytes} [Thu Jul 21 16:03:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:03:36.821708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2867b6c-717f-4a36-9936-0e0a8fc81a62 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:03:36.836055 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2867b6c-717f-4a36-9936-0e0a8fc81a62 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:03:36.841325 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6db4ea-5056-4893-9e2d-920e9d641978 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:03:36.841970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6db4ea-5056-4893-9e2d-920e9d641978 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:36.842256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6db4ea-5056-4893-9e2d-920e9d641978 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:36.842538 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6db4ea-5056-4893-9e2d-920e9d641978 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:36.851399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6db4ea-5056-4893-9e2d-920e9d641978 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:03:36.853031 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6db4ea-5056-4893-9e2d-920e9d641978 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:03:36.863251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 743/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:03:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:03:38.780071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0634f-0d8e-4e80-b0a9-1ee7453a08a8 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:38.780704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0634f-0d8e-4e80-b0a9-1ee7453a08a8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:38.780704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e0634f-0d8e-4e80-b0a9-1ee7453a08a8 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:38.782136 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 779/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 16:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:03:38.788258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89582b36-ab00-412d-bab2-66f20185a001 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:38.788886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89582b36-ab00-412d-bab2-66f20185a001 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:38.788886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89582b36-ab00-412d-bab2-66f20185a001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:38.809193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-89582b36-ab00-412d-bab2-66f20185a001 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:03:38.810464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-89582b36-ab00-412d-bab2-66f20185a001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:03:38.820805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 744/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 16:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:03:38.972058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0634f-0d8e-4e80-b0a9-1ee7453a08a8 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:03:38.988019 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e0634f-0d8e-4e80-b0a9-1ee7453a08a8 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:03:38.994108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f189665-9abe-4e26-958e-4db6b2510d1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:03:38.994773 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f189665-9abe-4e26-958e-4db6b2510d1b service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:38.995086 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f189665-9abe-4e26-958e-4db6b2510d1b service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:38.995364 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f189665-9abe-4e26-958e-4db6b2510d1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:39.004784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f189665-9abe-4e26-958e-4db6b2510d1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:03:39.006414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f189665-9abe-4e26-958e-4db6b2510d1b service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:03:39.017356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 780/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:03:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:03:39.834090 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1570d-ef46-44e4-b9ad-bb1c5e26509a None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:39.834667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1570d-ef46-44e4-b9ad-bb1c5e26509a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:39.834667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1570d-ef46-44e4-b9ad-bb1c5e26509a None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:39.836097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 745/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 16:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:03:39.841522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c9322-c0e9-4d09-bd10-e63eb0f660b7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:39.842042 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c9322-c0e9-4d09-bd10-e63eb0f660b7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:39.842042 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c9322-c0e9-4d09-bd10-e63eb0f660b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:39.861128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-327c9322-c0e9-4d09-bd10-e63eb0f660b7 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:03:39.862356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-327c9322-c0e9-4d09-bd10-e63eb0f660b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:03:39.871659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 781/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 16:03:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:03:40.023744 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1570d-ef46-44e4-b9ad-bb1c5e26509a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:03:40.039027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1570d-ef46-44e4-b9ad-bb1c5e26509a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:03:40.045056 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c1a4f4-0e98-4fc2-a341-bad696dad41d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:03:40.045705 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1a4f4-0e98-4fc2-a341-bad696dad41d service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:40.045987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1a4f4-0e98-4fc2-a341-bad696dad41d service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:40.046249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c1a4f4-0e98-4fc2-a341-bad696dad41d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:40.055248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1a4f4-0e98-4fc2-a341-bad696dad41d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:03:40.056834 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c1a4f4-0e98-4fc2-a341-bad696dad41d service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:03:40.067287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 746/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:03:44.327958 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6d194-0944-4eb1-aa79-2ed3160f2a80 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:44.328541 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6d194-0944-4eb1-aa79-2ed3160f2a80 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:44.328541 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe6d194-0944-4eb1-aa79-2ed3160f2a80 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:44.329937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 782/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 16:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:03:44.335412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7cab4-26b5-435b-b561-790dee09b07c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:44.335876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7cab4-26b5-435b-b561-790dee09b07c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:44.335973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7cab4-26b5-435b-b561-790dee09b07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:44.356378 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-01f7cab4-26b5-435b-b561-790dee09b07c None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:03:44.357602 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-01f7cab4-26b5-435b-b561-790dee09b07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:03:44.366745 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 747/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 16:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:03:44.443232 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6d194-0944-4eb1-aa79-2ed3160f2a80 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:03:44.445226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dbe6d194-0944-4eb1-aa79-2ed3160f2a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:03:44.515701 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:03:44.532256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe6d194-0944-4eb1-aa79-2ed3160f2a80 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:03:44.535939 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84367516-9dae-48c2-8ac5-a39d2e503134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:03:44.536614 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84367516-9dae-48c2-8ac5-a39d2e503134 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:44.536894 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84367516-9dae-48c2-8ac5-a39d2e503134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:44.537168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84367516-9dae-48c2-8ac5-a39d2e503134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:44.546309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84367516-9dae-48c2-8ac5-a39d2e503134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:03:44.547790 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84367516-9dae-48c2-8ac5-a39d2e503134 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:03:44.557392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 783/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:03:46.627568 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce4e2d-ad44-4acc-9919-540a977e5b51 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:46.628127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce4e2d-ad44-4acc-9919-540a977e5b51 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:46.628127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ce4e2d-ad44-4acc-9919-540a977e5b51 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:46.629498 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 748/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 16:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:03:46.635052 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0a94a-d33a-4b05-bafe-f1de3c63548d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:46.635596 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0a94a-d33a-4b05-bafe-f1de3c63548d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:46.635596 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0a94a-d33a-4b05-bafe-f1de3c63548d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:46.654411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-06b0a94a-d33a-4b05-bafe-f1de3c63548d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:03:46.655754 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-06b0a94a-d33a-4b05-bafe-f1de3c63548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:03:46.665202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 784/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 16:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:03:46.705727 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce4e2d-ad44-4acc-9919-540a977e5b51 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:03:46.716582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ce4e2d-ad44-4acc-9919-540a977e5b51 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:03:46.720425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00c3fb-63bb-4c0b-a785-ef75bff34150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:03:46.721057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00c3fb-63bb-4c0b-a785-ef75bff34150 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:46.721330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00c3fb-63bb-4c0b-a785-ef75bff34150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:46.721599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00c3fb-63bb-4c0b-a785-ef75bff34150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:46.733234 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00c3fb-63bb-4c0b-a785-ef75bff34150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:03:46.735534 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00c3fb-63bb-4c0b-a785-ef75bff34150 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:03:46.749820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 749/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:03:50.640820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a1710-a0d8-4371-8435-50cb35c00f67 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:50.641409 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a1710-a0d8-4371-8435-50cb35c00f67 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:50.641409 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a1710-a0d8-4371-8435-50cb35c00f67 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:50.642632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 785/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 16:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:03:50.648438 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f38ea-f4e0-44c5-92db-24bdf1061f62 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:50.648921 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f38ea-f4e0-44c5-92db-24bdf1061f62 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:50.649073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f38ea-f4e0-44c5-92db-24bdf1061f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:50.789089 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d75f38ea-f4e0-44c5-92db-24bdf1061f62 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:03:50.790302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d75f38ea-f4e0-44c5-92db-24bdf1061f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:03:50.798712 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 750/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 16:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:03:51.103589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a1710-a0d8-4371-8435-50cb35c00f67 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:03:51.105440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-175a1710-a0d8-4371-8435-50cb35c00f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:03:51.190179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a1710-a0d8-4371-8435-50cb35c00f67 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:03:51.194217 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22b6b48-21d6-414c-a4f5-ce61286a7572 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:03:51.194917 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b6b48-21d6-414c-a4f5-ce61286a7572 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:51.195197 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b6b48-21d6-414c-a4f5-ce61286a7572 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:51.195464 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22b6b48-21d6-414c-a4f5-ce61286a7572 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:51.205972 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b6b48-21d6-414c-a4f5-ce61286a7572 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:03:51.207582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22b6b48-21d6-414c-a4f5-ce61286a7572 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:03:51.217716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 786/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:03:53.279141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884e7b8-7636-47da-b317-f607aff7260f None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:53.279697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884e7b8-7636-47da-b317-f607aff7260f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:53.279697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b884e7b8-7636-47da-b317-f607aff7260f None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:53.281103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 751/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 16:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:03:53.288530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10136eb4-7cfb-46f9-954c-316ec02f72c6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:53.289039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10136eb4-7cfb-46f9-954c-316ec02f72c6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:53.289137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10136eb4-7cfb-46f9-954c-316ec02f72c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:53.307844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-10136eb4-7cfb-46f9-954c-316ec02f72c6 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:03:53.309066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-10136eb4-7cfb-46f9-954c-316ec02f72c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:03:53.318557 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 787/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 16:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:03:53.629736 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884e7b8-7636-47da-b317-f607aff7260f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:03:53.631767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b884e7b8-7636-47da-b317-f607aff7260f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:03:53.646087 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b884e7b8-7636-47da-b317-f607aff7260f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:03:53.650048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db04c0-8771-4faa-abe2-8cb5b73e9af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:03:53.650699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db04c0-8771-4faa-abe2-8cb5b73e9af0 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:03:53.651016 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db04c0-8771-4faa-abe2-8cb5b73e9af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:03:53.651291 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db04c0-8771-4faa-abe2-8cb5b73e9af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:03:53.660752 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db04c0-8771-4faa-abe2-8cb5b73e9af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:03:53.662186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db04c0-8771-4faa-abe2-8cb5b73e9af0 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:03:53.671838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 752/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:04:03.302786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=50 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:04:03.667577 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=50 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:37.880941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb4a90-549a-4ae9-adb8-9538a9b4efb3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:37.881606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb4a90-549a-4ae9-adb8-9538a9b4efb3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:37.881606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb4a90-549a-4ae9-adb8-9538a9b4efb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:37.911742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d8fb4a90-549a-4ae9-adb8-9538a9b4efb3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:37.913427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d8fb4a90-549a-4ae9-adb8-9538a9b4efb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:37.926053 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 788/1540] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:05:37.931123 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3fb43-13bb-4b66-b487-214e61bad26a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:37.932740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3fb43-13bb-4b66-b487-214e61bad26a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:37.933519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3fb43-13bb-4b66-b487-214e61bad26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:37.938849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4744efc-e20f-49a1-ab71-ce46796e1aa4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:37.938849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4744efc-e20f-49a1-ab71-ce46796e1aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:37.938849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4744efc-e20f-49a1-ab71-ce46796e1aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:37.971127 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f4744efc-e20f-49a1-ab71-ce46796e1aa4 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:37.972662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f4744efc-e20f-49a1-ab71-ce46796e1aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:37.986740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bea3fb43-13bb-4b66-b487-214e61bad26a None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:37.989329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bea3fb43-13bb-4b66-b487-214e61bad26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:37.995312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 789/1541] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:05:38.003239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4744efc-e20f-49a1-ab71-ce46796e1aa4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:38.013742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 753/1542] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:38.021782 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4744efc-e20f-49a1-ab71-ce46796e1aa4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:38.031008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb954b2-87ae-4ab8-a45e-586e74da9475 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.032089 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb954b2-87ae-4ab8-a45e-586e74da9475 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.032857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb954b2-87ae-4ab8-a45e-586e74da9475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:38.037696 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b81a0-f39e-47da-8482-e924b8a27a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:38.038421 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b81a0-f39e-47da-8482-e924b8a27a5c admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.038710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b81a0-f39e-47da-8482-e924b8a27a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.039012 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b81a0-f39e-47da-8482-e924b8a27a5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:38.039765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b81a0-f39e-47da-8482-e924b8a27a5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:05:38.040070 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b81a0-f39e-47da-8482-e924b8a27a5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:38.041287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: WARNING py.warnings [None req-a17b81a0-f39e-47da-8482-e924b8a27a5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 16:05:38.041287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: warnings.warn(msg) Jul 21 16:05:38.041287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: Jul 21 16:05:38.042438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17b81a0-f39e-47da-8482-e924b8a27a5c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:38.066847 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 790/1543] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 16:05:38.085060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3cb954b2-87ae-4ab8-a45e-586e74da9475 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:38.085310 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b81a0-f39e-47da-8482-e924b8a27a5c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:38.086845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3cb954b2-87ae-4ab8-a45e-586e74da9475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:38.101446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17b81a0-f39e-47da-8482-e924b8a27a5c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:38.104179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 754/1544] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:05:38.110010 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb954b2-87ae-4ab8-a45e-586e74da9475 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:38.114200 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b3e5e-13ee-4bb6-9051-a6d1cc9f752b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:38.114958 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b3e5e-13ee-4bb6-9051-a6d1cc9f752b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.115244 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b3e5e-13ee-4bb6-9051-a6d1cc9f752b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.115521 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b3e5e-13ee-4bb6-9051-a6d1cc9f752b admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:38.116360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b3e5e-13ee-4bb6-9051-a6d1cc9f752b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:38.118338 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b3e5e-13ee-4bb6-9051-a6d1cc9f752b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:38.127754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb954b2-87ae-4ab8-a45e-586e74da9475 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:38.142198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3c1bb-26e3-414b-81a1-d762c10830bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:38.143363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3c1bb-26e3-414b-81a1-d762c10830bf admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.143858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3c1bb-26e3-414b-81a1-d762c10830bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.144353 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3c1bb-26e3-414b-81a1-d762c10830bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:38.145504 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3c1bb-26e3-414b-81a1-d762c10830bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:05:38.146053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3c1bb-26e3-414b-81a1-d762c10830bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:38.148168 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3c1bb-26e3-414b-81a1-d762c10830bf admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:38.167557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 755/1545] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:05:38.186411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3c1bb-26e3-414b-81a1-d762c10830bf admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:38.190066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 791/1546] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:38 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:38.196774 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b3e5e-13ee-4bb6-9051-a6d1cc9f752b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:38.203912 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3c1bb-26e3-414b-81a1-d762c10830bf admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:38.315777 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710f99b-c569-4173-879d-4f07fa307508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:38.316897 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710f99b-c569-4173-879d-4f07fa307508 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.317669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710f99b-c569-4173-879d-4f07fa307508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.318172 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710f99b-c569-4173-879d-4f07fa307508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:38.319154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710f99b-c569-4173-879d-4f07fa307508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:38.320465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-f710f99b-c569-4173-879d-4f07fa307508 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 16:05:38.320465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: warnings.warn(msg) Jul 21 16:05:38.320465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: Jul 21 16:05:38.322073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710f99b-c569-4173-879d-4f07fa307508 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:38.322626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b3e5e-13ee-4bb6-9051-a6d1cc9f752b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:38.334556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe429a-935c-450b-89c1-9b7249132eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:38.335290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe429a-935c-450b-89c1-9b7249132eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.335575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe429a-935c-450b-89c1-9b7249132eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.335855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe429a-935c-450b-89c1-9b7249132eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:38.336576 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe429a-935c-450b-89c1-9b7249132eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:38.337650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: WARNING py.warnings [None req-69fe429a-935c-450b-89c1-9b7249132eb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 16:05:38.337650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: warnings.warn(msg) Jul 21 16:05:38.337650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: Jul 21 16:05:38.342852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe429a-935c-450b-89c1-9b7249132eb1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:38.375671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 756/1547] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:38 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:38.377375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 792/1548] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:38 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:38.381741 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe429a-935c-450b-89c1-9b7249132eb1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:38.382130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710f99b-c569-4173-879d-4f07fa307508 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:38.402845 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe429a-935c-450b-89c1-9b7249132eb1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:38.483994 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710f99b-c569-4173-879d-4f07fa307508 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:38.493696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210c520-2c11-4840-9afc-54da0fbda907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:38.494927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210c520-2c11-4840-9afc-54da0fbda907 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.495449 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210c520-2c11-4840-9afc-54da0fbda907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.495951 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210c520-2c11-4840-9afc-54da0fbda907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:38.497083 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210c520-2c11-4840-9afc-54da0fbda907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:38.499055 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210c520-2c11-4840-9afc-54da0fbda907 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:38.514597 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829975d-03a9-4166-88bb-9b7a5c805464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:38.515346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829975d-03a9-4166-88bb-9b7a5c805464 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.515628 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829975d-03a9-4166-88bb-9b7a5c805464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.515900 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829975d-03a9-4166-88bb-9b7a5c805464 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:38.516637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829975d-03a9-4166-88bb-9b7a5c805464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:38.518708 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829975d-03a9-4166-88bb-9b7a5c805464 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:38.519082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 757/1549] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:38.522740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210c520-2c11-4840-9afc-54da0fbda907 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:38.537581 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210c520-2c11-4840-9afc-54da0fbda907 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:38.546013 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbd970-6649-45d4-bcfb-1f0cb50d3e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:38.547186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbd970-6649-45d4-bcfb-1f0cb50d3e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.547764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbd970-6649-45d4-bcfb-1f0cb50d3e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.548271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbd970-6649-45d4-bcfb-1f0cb50d3e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:38.549990 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbd970-6649-45d4-bcfb-1f0cb50d3e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:38.556101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fbd970-6649-45d4-bcfb-1f0cb50d3e3d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:38.557592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 793/1550] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:38 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:05:38.562322 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8e624-7d3a-4720-9ae9-e7530481910a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.562686 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8e624-7d3a-4720-9ae9-e7530481910a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.562997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8e624-7d3a-4720-9ae9-e7530481910a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:38.571824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 758/1551] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:05:38.573333 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbd970-6649-45d4-bcfb-1f0cb50d3e3d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:38.596554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fbd970-6649-45d4-bcfb-1f0cb50d3e3d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:38.607867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7ee8e624-7d3a-4720-9ae9-e7530481910a None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:38.608994 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d260d-ad53-45c0-b63a-0319f5a4711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:38.610012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d260d-ad53-45c0-b63a-0319f5a4711f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.610567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d260d-ad53-45c0-b63a-0319f5a4711f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.611107 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d260d-ad53-45c0-b63a-0319f5a4711f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:38.613111 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7ee8e624-7d3a-4720-9ae9-e7530481910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:38.614240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d260d-ad53-45c0-b63a-0319f5a4711f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:38.617831 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d260d-ad53-45c0-b63a-0319f5a4711f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:38.636961 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 794/1552] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:38.641340 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 759/1553] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:38.642548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8e624-7d3a-4720-9ae9-e7530481910a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:38.652180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d260d-ad53-45c0-b63a-0319f5a4711f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:38.669586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8e624-7d3a-4720-9ae9-e7530481910a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:38.679623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d260d-ad53-45c0-b63a-0319f5a4711f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:38.689178 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128918b7-28b6-4218-8f85-9a33452fb984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:38.691843 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128918b7-28b6-4218-8f85-9a33452fb984 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.693113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128918b7-28b6-4218-8f85-9a33452fb984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.694212 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128918b7-28b6-4218-8f85-9a33452fb984 admin admin] PATH_INFO: `/v3/projects/9e06bf908d2b4a7692749867b7a0e2df/users/ae884c5ad5864599bef5dbaf8ad08b4c/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:38.702876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6715b55-d659-4e55-8a7c-4096d97240cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:38.702876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6715b55-d659-4e55-8a7c-4096d97240cc admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.702876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6715b55-d659-4e55-8a7c-4096d97240cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.702876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6715b55-d659-4e55-8a7c-4096d97240cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:38.703395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6715b55-d659-4e55-8a7c-4096d97240cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:38.703649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6715b55-d659-4e55-8a7c-4096d97240cc admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:38.721648 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:38.727113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 760/1554] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:38.728808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338a9d0-71ed-4fe3-8555-d08e0dd773a5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.729102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338a9d0-71ed-4fe3-8555-d08e0dd773a5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.729485 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a338a9d0-71ed-4fe3-8555-d08e0dd773a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:38.730729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128918b7-28b6-4218-8f85-9a33452fb984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e06bf908d2b4a7692749867b7a0e2df, user_id=ae884c5ad5864599bef5dbaf8ad08b4c, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:38.733958 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128918b7-28b6-4218-8f85-9a33452fb984 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:38.766025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 795/1555] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:38 2022] PUT /identity/v3/projects/9e06bf908d2b4a7692749867b7a0e2df/users/ae884c5ad5864599bef5dbaf8ad08b4c/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:38.767339 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128918b7-28b6-4218-8f85-9a33452fb984 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:38.767474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a338a9d0-71ed-4fe3-8555-d08e0dd773a5 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:38.770842 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a338a9d0-71ed-4fe3-8555-d08e0dd773a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:38.808247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:38.944177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 761/1556] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:38.945556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe2fe3-9ef8-4196-8027-e3da13b923f0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.945847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe2fe3-9ef8-4196-8027-e3da13b923f0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.946133 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efe2fe3-9ef8-4196-8027-e3da13b923f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:38.955046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128918b7-28b6-4218-8f85-9a33452fb984 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:38.971315 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eaffd3-0e2c-48de-896d-2b71d07dd5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:38.972274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaffd3-0e2c-48de-896d-2b71d07dd5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:38.972556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaffd3-0e2c-48de-896d-2b71d07dd5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:38.973387 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaffd3-0e2c-48de-896d-2b71d07dd5e9 admin admin] PATH_INFO: `/v3/projects/67471d558ecc44a78ee7fff455977b44/users/3212bd24e1f84b70872940214632536f/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.012059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eaffd3-0e2c-48de-896d-2b71d07dd5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67471d558ecc44a78ee7fff455977b44, user_id=3212bd24e1f84b70872940214632536f, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:39.014833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eaffd3-0e2c-48de-896d-2b71d07dd5e9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:39.021191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4efe2fe3-9ef8-4196-8027-e3da13b923f0 None None] MFA Rules not processed for user `ae884c5ad5864599bef5dbaf8ad08b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:39.022848 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4efe2fe3-9ef8-4196-8027-e3da13b923f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:39.044094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 796/1557] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:38 2022] PUT /identity/v3/projects/67471d558ecc44a78ee7fff455977b44/users/3212bd24e1f84b70872940214632536f/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:39.045283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c6d7-6b4d-41fa-8e5a-4df18d376520 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.045583 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c6d7-6b4d-41fa-8e5a-4df18d376520 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.045862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51c6d7-6b4d-41fa-8e5a-4df18d376520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.071240 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8f51c6d7-6b4d-41fa-8e5a-4df18d376520 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:39.072621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8f51c6d7-6b4d-41fa-8e5a-4df18d376520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:39.116439 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 762/1558] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:39.117330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe2fe3-9ef8-4196-8027-e3da13b923f0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:39.133336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efe2fe3-9ef8-4196-8027-e3da13b923f0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:39.151011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 797/1559] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:39.152957 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3a63d-c545-480b-8670-d71c20539b17 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.153418 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3a63d-c545-480b-8670-d71c20539b17 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.153714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3a63d-c545-480b-8670-d71c20539b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.186726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ebc3a63d-c545-480b-8670-d71c20539b17 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:39.188006 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ebc3a63d-c545-480b-8670-d71c20539b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:39.196539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 798/1560] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:39.197674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1996-94c3-43a8-892d-6458b5c516ad None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.198037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1996-94c3-43a8-892d-6458b5c516ad None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.198320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1996-94c3-43a8-892d-6458b5c516ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.217123 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0e1d1996-94c3-43a8-892d-6458b5c516ad None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:39.218361 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0e1d1996-94c3-43a8-892d-6458b5c516ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:39.228144 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 799/1561] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:39.228686 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45f24c-593c-4b46-af7b-62f451fdb3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:39.229452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45f24c-593c-4b46-af7b-62f451fdb3bf admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.229740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45f24c-593c-4b46-af7b-62f451fdb3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.230018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45f24c-593c-4b46-af7b-62f451fdb3bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.230307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f180c-5184-45ee-a67f-6be068f55493 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.230758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f180c-5184-45ee-a67f-6be068f55493 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.230972 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45f24c-593c-4b46-af7b-62f451fdb3bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:05:39.231115 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45f24c-593c-4b46-af7b-62f451fdb3bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:39.231265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f180c-5184-45ee-a67f-6be068f55493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.232769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45f24c-593c-4b46-af7b-62f451fdb3bf admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:39.246365 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 763/1562] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:05:39.247779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a6446-9fe8-4066-b5a4-66dbed8241d4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.248075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a6446-9fe8-4066-b5a4-66dbed8241d4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.248348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a6446-9fe8-4066-b5a4-66dbed8241d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.253342 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-361f180c-5184-45ee-a67f-6be068f55493 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:39.254696 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-361f180c-5184-45ee-a67f-6be068f55493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:39.262776 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 800/1563] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:39.264190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56788c0-33eb-43a2-bdbb-e7b835892364 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.264489 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56788c0-33eb-43a2-bdbb-e7b835892364 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.264768 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56788c0-33eb-43a2-bdbb-e7b835892364 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.266427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 801/1564] 10.222.0.64 () {54 vars in 962 bytes} [Thu Jul 21 16:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:05:39.268066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a09013-38ee-4366-88a3-0374d4337523 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.268066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a09013-38ee-4366-88a3-0374d4337523 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.268395 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a09013-38ee-4366-88a3-0374d4337523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.270613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b70a6446-9fe8-4066-b5a4-66dbed8241d4 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:39.272019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b70a6446-9fe8-4066-b5a4-66dbed8241d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:39.280880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 764/1565] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:39.282226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cfc3c-2660-4670-9c66-a6df65302a40 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.282508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cfc3c-2660-4670-9c66-a6df65302a40 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.282785 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cfc3c-2660-4670-9c66-a6df65302a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.289463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f5a09013-38ee-4366-88a3-0374d4337523 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:39.290720 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f5a09013-38ee-4366-88a3-0374d4337523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:39.301069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 802/1566] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:39.303924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dde858-432a-41bd-b78b-fdb74b14a200 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.304284 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dde858-432a-41bd-b78b-fdb74b14a200 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.304859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dde858-432a-41bd-b78b-fdb74b14a200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.305879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0e6cfc3c-2660-4670-9c66-a6df65302a40 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:39.307166 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0e6cfc3c-2660-4670-9c66-a6df65302a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:39.315340 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 765/1567] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:39.316671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e43a50-77e2-4008-982f-558bda7bbe66 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.316955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e43a50-77e2-4008-982f-558bda7bbe66 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.317225 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e43a50-77e2-4008-982f-558bda7bbe66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.337415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-18e43a50-77e2-4008-982f-558bda7bbe66 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:39.338718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-18e43a50-77e2-4008-982f-558bda7bbe66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:39.338959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-06dde858-432a-41bd-b78b-fdb74b14a200 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:39.340827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-06dde858-432a-41bd-b78b-fdb74b14a200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:39.347271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 766/1568] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:39.348413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e43a50-77e2-4008-982f-558bda7bbe66 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:39.355449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 803/1569] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:39.361356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e43a50-77e2-4008-982f-558bda7bbe66 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:39.361661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aebea9-5237-404a-8ee2-b5e282ece467 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.361948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aebea9-5237-404a-8ee2-b5e282ece467 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.362321 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aebea9-5237-404a-8ee2-b5e282ece467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.369284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914d836-9ff2-43e3-8ec6-3c856ed87929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:39.370010 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914d836-9ff2-43e3-8ec6-3c856ed87929 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.370293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914d836-9ff2-43e3-8ec6-3c856ed87929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.370753 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914d836-9ff2-43e3-8ec6-3c856ed87929 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.371609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914d836-9ff2-43e3-8ec6-3c856ed87929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:39.373733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914d836-9ff2-43e3-8ec6-3c856ed87929 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:39.400804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 767/1570] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:39.402026 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914d836-9ff2-43e3-8ec6-3c856ed87929 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:39.407031 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8914d836-9ff2-43e3-8ec6-3c856ed87929 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:39.413661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:39.419079 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-67aebea9-5237-404a-8ee2-b5e282ece467 None None] MFA Rules not processed for user `e9a1ec1f6bb7467dbd63ad1da36d48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:39.420873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-67aebea9-5237-404a-8ee2-b5e282ece467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:39.449212 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:39.481541 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914d836-9ff2-43e3-8ec6-3c856ed87929 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:39.487973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd62a5-8a9b-4828-86f1-bbb1c454efa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:39.487973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd62a5-8a9b-4828-86f1-bbb1c454efa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.487973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd62a5-8a9b-4828-86f1-bbb1c454efa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.487973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dd62a5-8a9b-4828-86f1-bbb1c454efa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.497379 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 804/1571] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:39.498769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb9b18-3876-4c3f-b739-6836a0062f36 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.500219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb9b18-3876-4c3f-b739-6836a0062f36 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.500219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb9b18-3876-4c3f-b739-6836a0062f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.520227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-dedb9b18-3876-4c3f-b739-6836a0062f36 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:39.521459 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dedb9b18-3876-4c3f-b739-6836a0062f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:39.571629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd62a5-8a9b-4828-86f1-bbb1c454efa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:39.573137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dd62a5-8a9b-4828-86f1-bbb1c454efa7 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:39.584099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 768/1572] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:39.585062 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd62a5-8a9b-4828-86f1-bbb1c454efa7 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:39.595321 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dd62a5-8a9b-4828-86f1-bbb1c454efa7 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:39.600049 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9eb19-1da4-4ffe-a75e-ac080400aed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:39.600814 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9eb19-1da4-4ffe-a75e-ac080400aed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.601166 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9eb19-1da4-4ffe-a75e-ac080400aed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.601505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9eb19-1da4-4ffe-a75e-ac080400aed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.602342 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9eb19-1da4-4ffe-a75e-ac080400aed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:05:39.602723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9eb19-1da4-4ffe-a75e-ac080400aed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:39.603776 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 805/1573] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:39.605227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2a3c8-dab4-4dda-aa94-4f07091f2de4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.605530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2a3c8-dab4-4dda-aa94-4f07091f2de4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.605812 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2a3c8-dab4-4dda-aa94-4f07091f2de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.608283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9eb19-1da4-4ffe-a75e-ac080400aed6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:39.631219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 769/1574] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:05:39.631219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9eb19-1da4-4ffe-a75e-ac080400aed6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:39.633092 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d8b2a3c8-dab4-4dda-aa94-4f07091f2de4 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:39.634369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d8b2a3c8-dab4-4dda-aa94-4f07091f2de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:39.645200 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 806/1575] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:39.645394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9eb19-1da4-4ffe-a75e-ac080400aed6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:39.646017 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2a3c8-dab4-4dda-aa94-4f07091f2de4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:39.656377 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2a3c8-dab4-4dda-aa94-4f07091f2de4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:39.657200 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764ea54-ccfa-461a-9d10-d4b81ae91d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:39.658358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764ea54-ccfa-461a-9d10-d4b81ae91d9d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.658913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764ea54-ccfa-461a-9d10-d4b81ae91d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.659417 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764ea54-ccfa-461a-9d10-d4b81ae91d9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.660472 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764ea54-ccfa-461a-9d10-d4b81ae91d9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:05:39.661452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764ea54-ccfa-461a-9d10-d4b81ae91d9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:39.662096 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224bba4-84b8-45cb-b2c6-f468bc366547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:39.663074 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224bba4-84b8-45cb-b2c6-f468bc366547 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.663427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224bba4-84b8-45cb-b2c6-f468bc366547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.663770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224bba4-84b8-45cb-b2c6-f468bc366547 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.664445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764ea54-ccfa-461a-9d10-d4b81ae91d9d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:39.664655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224bba4-84b8-45cb-b2c6-f468bc366547 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:05:39.665031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224bba4-84b8-45cb-b2c6-f468bc366547 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:39.666788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224bba4-84b8-45cb-b2c6-f468bc366547 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:39.682109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 807/1576] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:05:39.683089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224bba4-84b8-45cb-b2c6-f468bc366547 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:39.694419 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 770/1577] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:05:39.695789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764ea54-ccfa-461a-9d10-d4b81ae91d9d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:39.707248 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224bba4-84b8-45cb-b2c6-f468bc366547 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:39.709317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764ea54-ccfa-461a-9d10-d4b81ae91d9d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:39.712492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87615b-9d8b-48ae-9495-3bce96842ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:39.713113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87615b-9d8b-48ae-9495-3bce96842ccb admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.713517 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87615b-9d8b-48ae-9495-3bce96842ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.713976 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87615b-9d8b-48ae-9495-3bce96842ccb admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.714728 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87615b-9d8b-48ae-9495-3bce96842ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:39.716769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61195a-d520-4591-b706-16c0a2d6d68e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:39.717028 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87615b-9d8b-48ae-9495-3bce96842ccb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:39.717445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61195a-d520-4591-b706-16c0a2d6d68e service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.718011 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61195a-d520-4591-b706-16c0a2d6d68e service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.718011 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61195a-d520-4591-b706-16c0a2d6d68e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.745314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 808/1578] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/users => generated 284 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:39.746233 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87615b-9d8b-48ae-9495-3bce96842ccb admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:39.757230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87615b-9d8b-48ae-9495-3bce96842ccb admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:39.762450 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18fe23-e08f-4ced-97c8-4994e57a7e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:39.763215 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18fe23-e08f-4ced-97c8-4994e57a7e57 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.763506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18fe23-e08f-4ced-97c8-4994e57a7e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.763785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18fe23-e08f-4ced-97c8-4994e57a7e57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.764755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18fe23-e08f-4ced-97c8-4994e57a7e57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:05:39.765125 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18fe23-e08f-4ced-97c8-4994e57a7e57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:39.766866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18fe23-e08f-4ced-97c8-4994e57a7e57 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:39.791780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 809/1579] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:05:39.791780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18fe23-e08f-4ced-97c8-4994e57a7e57 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:39.805421 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18fe23-e08f-4ced-97c8-4994e57a7e57 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:39.814274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54f369-30c7-472c-bc66-18ad097f3d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:39.815342 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54f369-30c7-472c-bc66-18ad097f3d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.815994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54f369-30c7-472c-bc66-18ad097f3d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.816494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54f369-30c7-472c-bc66-18ad097f3d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.818050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54f369-30c7-472c-bc66-18ad097f3d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:39.820292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61195a-d520-4591-b706-16c0a2d6d68e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:39.821439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54f369-30c7-472c-bc66-18ad097f3d47 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:39.821921 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61195a-d520-4591-b706-16c0a2d6d68e service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:39.834805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 771/1580] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:39.836387 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61195a-d520-4591-b706-16c0a2d6d68e service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:39.852839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61195a-d520-4591-b706-16c0a2d6d68e service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:39.871206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 810/1581] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/projects => generated 393 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:39.871206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54f369-30c7-472c-bc66-18ad097f3d47 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:39.872281 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf34f0f-0c36-4880-ac0c-4dbc2cedd61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:39.873369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf34f0f-0c36-4880-ac0c-4dbc2cedd61e admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.873678 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf34f0f-0c36-4880-ac0c-4dbc2cedd61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.875017 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf34f0f-0c36-4880-ac0c-4dbc2cedd61e admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.876677 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf34f0f-0c36-4880-ac0c-4dbc2cedd61e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:05:39.877151 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf34f0f-0c36-4880-ac0c-4dbc2cedd61e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:39.883768 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf34f0f-0c36-4880-ac0c-4dbc2cedd61e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:39.909973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 772/1582] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:05:39.912658 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf34f0f-0c36-4880-ac0c-4dbc2cedd61e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:39.935824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf34f0f-0c36-4880-ac0c-4dbc2cedd61e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:39.941364 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:39.950743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:39.970787 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54f369-30c7-472c-bc66-18ad097f3d47 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:39.988719 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b98f7-3ea0-41d4-9019-7a04f3c09f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:39.992765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b98f7-3ea0-41d4-9019-7a04f3c09f4e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:39.993270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b98f7-3ea0-41d4-9019-7a04f3c09f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:39.993799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b98f7-3ea0-41d4-9019-7a04f3c09f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:39.995879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b98f7-3ea0-41d4-9019-7a04f3c09f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.004338 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b98f7-3ea0-41d4-9019-7a04f3c09f4e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.082355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d994b7f-d4c3-4093-a1b8-a0099e945350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:40.083700 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d994b7f-d4c3-4093-a1b8-a0099e945350 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.084109 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d994b7f-d4c3-4093-a1b8-a0099e945350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.084535 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d994b7f-d4c3-4093-a1b8-a0099e945350 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.085432 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d994b7f-d4c3-4093-a1b8-a0099e945350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.088465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d994b7f-d4c3-4093-a1b8-a0099e945350 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.107743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 811/1583] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/projects => generated 373 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:40.107743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b98f7-3ea0-41d4-9019-7a04f3c09f4e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:40.131310 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 773/1584] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:39 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:40.133015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d994b7f-d4c3-4093-a1b8-a0099e945350 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:40.237632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d994b7f-d4c3-4093-a1b8-a0099e945350 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:40.248289 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c59a4-7640-4a52-8793-2fa0f66d71d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:40.249008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c59a4-7640-4a52-8793-2fa0f66d71d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.249370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c59a4-7640-4a52-8793-2fa0f66d71d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.250595 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c59a4-7640-4a52-8793-2fa0f66d71d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.251521 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c59a4-7640-4a52-8793-2fa0f66d71d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.253698 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c59a4-7640-4a52-8793-2fa0f66d71d3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.295671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 774/1585] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:40 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:40.296492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c59a4-7640-4a52-8793-2fa0f66d71d3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:40.331171 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b98f7-3ea0-41d4-9019-7a04f3c09f4e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:40.408767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c59a4-7640-4a52-8793-2fa0f66d71d3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:40.414635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06034fa-d287-4970-8232-b9654ba098d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:40.415863 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06034fa-d287-4970-8232-b9654ba098d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.416358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06034fa-d287-4970-8232-b9654ba098d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.416801 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06034fa-d287-4970-8232-b9654ba098d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.417620 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06034fa-d287-4970-8232-b9654ba098d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.420571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06034fa-d287-4970-8232-b9654ba098d2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.435929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989bead-feb5-4616-ac62-0034ee218e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:40.436820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989bead-feb5-4616-ac62-0034ee218e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.437097 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989bead-feb5-4616-ac62-0034ee218e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.437374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989bead-feb5-4616-ac62-0034ee218e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.438129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989bead-feb5-4616-ac62-0034ee218e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.439865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989bead-feb5-4616-ac62-0034ee218e69 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.454344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 812/1586] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:40.455271 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989bead-feb5-4616-ac62-0034ee218e69 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:40.459134 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 775/1587] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:40 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:40.461137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06034fa-d287-4970-8232-b9654ba098d2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:40.474054 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989bead-feb5-4616-ac62-0034ee218e69 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:40.475358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06034fa-d287-4970-8232-b9654ba098d2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:40.480286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850f839-e8b8-41d5-82e4-7662aef46db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:40.481349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850f839-e8b8-41d5-82e4-7662aef46db3 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.481645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d0e8d-7e58-42f0-a18e-7eb451d4468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:40.482283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850f839-e8b8-41d5-82e4-7662aef46db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.482523 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d0e8d-7e58-42f0-a18e-7eb451d4468e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.482700 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d0e8d-7e58-42f0-a18e-7eb451d4468e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.482916 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850f839-e8b8-41d5-82e4-7662aef46db3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.483478 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d0e8d-7e58-42f0-a18e-7eb451d4468e admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.483921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850f839-e8b8-41d5-82e4-7662aef46db3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.484632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d0e8d-7e58-42f0-a18e-7eb451d4468e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.488778 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850f839-e8b8-41d5-82e4-7662aef46db3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.489089 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d0e8d-7e58-42f0-a18e-7eb451d4468e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.500517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:40.517227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 776/1588] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:40 2022] POST /identity/v3/users => generated 287 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:40.518641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d0e8d-7e58-42f0-a18e-7eb451d4468e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:40.528159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 813/1589] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:40 2022] POST /identity/v3/projects => generated 401 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:40.529355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850f839-e8b8-41d5-82e4-7662aef46db3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:40.548463 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d0e8d-7e58-42f0-a18e-7eb451d4468e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:40.632309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:40.643222 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850f839-e8b8-41d5-82e4-7662aef46db3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:40.657109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672a0df-246a-4318-88b2-b87896f9803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:40.658424 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672a0df-246a-4318-88b2-b87896f9803d admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.659284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc742e42-4d84-4846-af0c-975df1603086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:40.660056 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc742e42-4d84-4846-af0c-975df1603086 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.660494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc742e42-4d84-4846-af0c-975df1603086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.660629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672a0df-246a-4318-88b2-b87896f9803d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.660953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672a0df-246a-4318-88b2-b87896f9803d admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.661067 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc742e42-4d84-4846-af0c-975df1603086 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.661922 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc742e42-4d84-4846-af0c-975df1603086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.663556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672a0df-246a-4318-88b2-b87896f9803d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.664148 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc742e42-4d84-4846-af0c-975df1603086 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.666431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672a0df-246a-4318-88b2-b87896f9803d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.693036 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 777/1590] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:40 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:40.695269 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e814583-34f7-4e1d-97a7-506176bdfc37 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.695617 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e814583-34f7-4e1d-97a7-506176bdfc37 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.695912 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e814583-34f7-4e1d-97a7-506176bdfc37 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.698355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 778/1591] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 21 16:05:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:05:40.699325 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e814583-34f7-4e1d-97a7-506176bdfc37 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:40.712999 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 814/1592] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:40 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:40.712999 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672a0df-246a-4318-88b2-b87896f9803d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:40.715243 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e814583-34f7-4e1d-97a7-506176bdfc37 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:40.722336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe90e1-b535-434e-afb5-ef5341f94688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:40.723200 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe90e1-b535-434e-afb5-ef5341f94688 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.723966 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe90e1-b535-434e-afb5-ef5341f94688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.724381 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe90e1-b535-434e-afb5-ef5341f94688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.725319 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe90e1-b535-434e-afb5-ef5341f94688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.728141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe90e1-b535-434e-afb5-ef5341f94688 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.735424 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672a0df-246a-4318-88b2-b87896f9803d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:40.745715 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 779/1593] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:40.746778 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88442a39-6447-4a84-b0d6-ccf1b6a70847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:40.746958 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe90e1-b535-434e-afb5-ef5341f94688 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:40.748094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88442a39-6447-4a84-b0d6-ccf1b6a70847 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.748653 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88442a39-6447-4a84-b0d6-ccf1b6a70847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.749118 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88442a39-6447-4a84-b0d6-ccf1b6a70847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.750126 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88442a39-6447-4a84-b0d6-ccf1b6a70847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.753252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88442a39-6447-4a84-b0d6-ccf1b6a70847 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.760653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe90e1-b535-434e-afb5-ef5341f94688 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:40.771621 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fbc97-8f39-4230-84b0-26cb57d81cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:40.773549 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fbc97-8f39-4230-84b0-26cb57d81cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.773856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fbc97-8f39-4230-84b0-26cb57d81cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.774121 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fbc97-8f39-4230-84b0-26cb57d81cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.775115 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fbc97-8f39-4230-84b0-26cb57d81cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.776378 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 815/1594] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:40.776933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2fbc97-8f39-4230-84b0-26cb57d81cd1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.778513 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88442a39-6447-4a84-b0d6-ccf1b6a70847 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:40.795324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 780/1595] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:40.796243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88442a39-6447-4a84-b0d6-ccf1b6a70847 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:40.802001 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fbc97-8f39-4230-84b0-26cb57d81cd1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:40.802631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f784317a-6059-4658-bc9f-06c40e9f076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:40.804357 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784317a-6059-4658-bc9f-06c40e9f076e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.804823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784317a-6059-4658-bc9f-06c40e9f076e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.805251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f784317a-6059-4658-bc9f-06c40e9f076e admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.805979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784317a-6059-4658-bc9f-06c40e9f076e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.808275 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f784317a-6059-4658-bc9f-06c40e9f076e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.821235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2fbc97-8f39-4230-84b0-26cb57d81cd1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:40.830468 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87a6fd-381f-4d8a-b203-fcad6bfabe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:40.831702 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87a6fd-381f-4d8a-b203-fcad6bfabe91 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.832209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87a6fd-381f-4d8a-b203-fcad6bfabe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.832711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87a6fd-381f-4d8a-b203-fcad6bfabe91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.834344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87a6fd-381f-4d8a-b203-fcad6bfabe91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.837758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87a6fd-381f-4d8a-b203-fcad6bfabe91 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.845720 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 816/1596] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:40 2022] POST /identity/v3/users => generated 301 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:40.848508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead3ffc-cdc7-4708-bec4-bf65105d9a77 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.848936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead3ffc-cdc7-4708-bec4-bf65105d9a77 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.849216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead3ffc-cdc7-4708-bec4-bf65105d9a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.857266 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 781/1597] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:40.857266 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87a6fd-381f-4d8a-b203-fcad6bfabe91 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:40.868137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87a6fd-381f-4d8a-b203-fcad6bfabe91 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:40.878089 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfbe67-49d8-492c-94fa-e69d650481e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:40.879691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5ead3ffc-cdc7-4708-bec4-bf65105d9a77 None None] MFA Rules not processed for user `e9a1ec1f6bb7467dbd63ad1da36d48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:40.879923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfbe67-49d8-492c-94fa-e69d650481e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.880631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfbe67-49d8-492c-94fa-e69d650481e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.880984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfbe67-49d8-492c-94fa-e69d650481e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.881166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5ead3ffc-cdc7-4708-bec4-bf65105d9a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:40.882368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfbe67-49d8-492c-94fa-e69d650481e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.884541 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfbe67-49d8-492c-94fa-e69d650481e3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.908555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 782/1598] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:40.909561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfbe67-49d8-492c-94fa-e69d650481e3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:40.924778 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfbe67-49d8-492c-94fa-e69d650481e3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:40.930174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7fd2c-e1f1-4058-a167-19bea7f47db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:40.931323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7fd2c-e1f1-4058-a167-19bea7f47db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:40.931761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7fd2c-e1f1-4058-a167-19bea7f47db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:40.932071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7fd2c-e1f1-4058-a167-19bea7f47db7 admin admin] PATH_INFO: `/v3/projects/4771f8e60b3a4d528b1b5a1cfa3e7fe1/users/5cf92b91a9034b839626c3d40a47b14f/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:40.951375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7fd2c-e1f1-4058-a167-19bea7f47db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4771f8e60b3a4d528b1b5a1cfa3e7fe1, user_id=5cf92b91a9034b839626c3d40a47b14f, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:40.953377 dv-cinder-850668-1-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-33f7fd2c-e1f1-4058-a167-19bea7f47db7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 16:05:40.953377 dv-cinder-850668-1-smb devstack@keystone.service[80253]: warnings.warn(msg) Jul 21 16:05:40.953377 dv-cinder-850668-1-smb devstack@keystone.service[80253]: Jul 21 16:05:40.957488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7fd2c-e1f1-4058-a167-19bea7f47db7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:40.981771 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 783/1599] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:40 2022] PUT /identity/v3/projects/4771f8e60b3a4d528b1b5a1cfa3e7fe1/users/5cf92b91a9034b839626c3d40a47b14f/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:40.995522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7fd2c-e1f1-4058-a167-19bea7f47db7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:41.006019 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 817/1600] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 16:05:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:41.007293 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead3ffc-cdc7-4708-bec4-bf65105d9a77 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:41.022134 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead3ffc-cdc7-4708-bec4-bf65105d9a77 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:41.112881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eec931-948f-4842-a2e6-8ce77937c157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:41.113613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eec931-948f-4842-a2e6-8ce77937c157 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:41.113894 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eec931-948f-4842-a2e6-8ce77937c157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:41.114188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eec931-948f-4842-a2e6-8ce77937c157 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:41.115228 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eec931-948f-4842-a2e6-8ce77937c157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:41.117225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eec931-948f-4842-a2e6-8ce77937c157 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:41.135817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 818/1601] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:41.135817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eec931-948f-4842-a2e6-8ce77937c157 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:41.144755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eec931-948f-4842-a2e6-8ce77937c157 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:41.150160 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b42b6-f0b8-4f97-aa1a-312d1c056c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:41.150987 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b42b6-f0b8-4f97-aa1a-312d1c056c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:41.151280 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b42b6-f0b8-4f97-aa1a-312d1c056c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:41.151565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b42b6-f0b8-4f97-aa1a-312d1c056c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:41.152508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b42b6-f0b8-4f97-aa1a-312d1c056c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:41.154411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b42b6-f0b8-4f97-aa1a-312d1c056c36 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:41.175310 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 819/1602] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:41.175310 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b42b6-f0b8-4f97-aa1a-312d1c056c36 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:41.189098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b42b6-f0b8-4f97-aa1a-312d1c056c36 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:41.191868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7fd2c-e1f1-4058-a167-19bea7f47db7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:41.199637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf6ca5-5fd8-4873-b2f6-23982f9f7610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:41.200175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf6ca5-5fd8-4873-b2f6-23982f9f7610 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:41.200466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf6ca5-5fd8-4873-b2f6-23982f9f7610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:41.200752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf6ca5-5fd8-4873-b2f6-23982f9f7610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:41.201725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf6ca5-5fd8-4873-b2f6-23982f9f7610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:41.203536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf6ca5-5fd8-4873-b2f6-23982f9f7610 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:41.208403 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6b07c-190c-4a88-80ae-3e8acc0c05e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:41.210368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6b07c-190c-4a88-80ae-3e8acc0c05e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:41.211729 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6b07c-190c-4a88-80ae-3e8acc0c05e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:41.212533 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6b07c-190c-4a88-80ae-3e8acc0c05e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:41.214282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6b07c-190c-4a88-80ae-3e8acc0c05e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:41.217767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6b07c-190c-4a88-80ae-3e8acc0c05e1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:41.224304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 820/1603] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:41.224304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf6ca5-5fd8-4873-b2f6-23982f9f7610 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:41.234400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf6ca5-5fd8-4873-b2f6-23982f9f7610 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:41.241427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee1e4c-0fd5-4345-a0df-b35877d7a5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:41.242156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee1e4c-0fd5-4345-a0df-b35877d7a5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:41.242534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee1e4c-0fd5-4345-a0df-b35877d7a5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:41.242968 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee1e4c-0fd5-4345-a0df-b35877d7a5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:41.244126 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee1e4c-0fd5-4345-a0df-b35877d7a5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:41.246183 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee1e4c-0fd5-4345-a0df-b35877d7a5b2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:41.251668 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 784/1604] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:41.255145 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1dfba-40dc-47e4-b167-6ca1ea6d6109 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:41.256732 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1dfba-40dc-47e4-b167-6ca1ea6d6109 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:41.257507 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1dfba-40dc-47e4-b167-6ca1ea6d6109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:41.259330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 821/1605] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:41.263897 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee1e4c-0fd5-4345-a0df-b35877d7a5b2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:41.284537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:41.320741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:41.332677 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b1e1dfba-40dc-47e4-b167-6ca1ea6d6109 None None] MFA Rules not processed for user `5cf92b91a9034b839626c3d40a47b14f`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:41.334156 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b1e1dfba-40dc-47e4-b167-6ca1ea6d6109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:41.367664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee1e4c-0fd5-4345-a0df-b35877d7a5b2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:41.373299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af147d28-cbaf-4c2e-8878-a7a1e394afc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:41.374494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af147d28-cbaf-4c2e-8878-a7a1e394afc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:41.375048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af147d28-cbaf-4c2e-8878-a7a1e394afc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:41.375434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af147d28-cbaf-4c2e-8878-a7a1e394afc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:41.481811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 785/1606] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:41.482840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1dfba-40dc-47e4-b167-6ca1ea6d6109 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:41.496870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1dfba-40dc-47e4-b167-6ca1ea6d6109 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:41.502299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61ed8f-2e83-4dfc-a56c-26cf3cd2388e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:41.503309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61ed8f-2e83-4dfc-a56c-26cf3cd2388e admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:41.503696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61ed8f-2e83-4dfc-a56c-26cf3cd2388e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:41.504072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61ed8f-2e83-4dfc-a56c-26cf3cd2388e admin admin] PATH_INFO: `/v3/projects/d57259f7b918428c9537fc255b1e7483/users/352747efafff47c7a672023ee5511628/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:41.532753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af147d28-cbaf-4c2e-8878-a7a1e394afc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:41.534782 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61ed8f-2e83-4dfc-a56c-26cf3cd2388e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57259f7b918428c9537fc255b1e7483, user_id=352747efafff47c7a672023ee5511628, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:41.535606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af147d28-cbaf-4c2e-8878-a7a1e394afc3 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:41.540165 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61ed8f-2e83-4dfc-a56c-26cf3cd2388e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:41.552253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 822/1607] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:41.555970 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af147d28-cbaf-4c2e-8878-a7a1e394afc3 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:41.571550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 786/1608] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:41 2022] PUT /identity/v3/projects/d57259f7b918428c9537fc255b1e7483/users/352747efafff47c7a672023ee5511628/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:41.572639 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61ed8f-2e83-4dfc-a56c-26cf3cd2388e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:41.595157 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af147d28-cbaf-4c2e-8878-a7a1e394afc3 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:41.697325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848c255-1cdb-439a-861c-68006d607fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:41.698704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848c255-1cdb-439a-861c-68006d607fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:41.699132 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848c255-1cdb-439a-861c-68006d607fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:41.699481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848c255-1cdb-439a-861c-68006d607fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:41.700323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848c255-1cdb-439a-861c-68006d607fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:41.702089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848c255-1cdb-439a-861c-68006d607fe4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:41.729715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 823/1609] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:41.730685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848c255-1cdb-439a-861c-68006d607fe4 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:41.742094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848c255-1cdb-439a-861c-68006d607fe4 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:41.748939 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031d608-a51b-46de-b269-7cfc88efb537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:41.749971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031d608-a51b-46de-b269-7cfc88efb537 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:41.750348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031d608-a51b-46de-b269-7cfc88efb537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:41.750929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031d608-a51b-46de-b269-7cfc88efb537 admin admin] PATH_INFO: `/v3/projects/a6434c8ace4940eab84d949fe10245ae/users/35f595da10d34af4b1eeb5a3ec4a69b7/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:41.774267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031d608-a51b-46de-b269-7cfc88efb537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6434c8ace4940eab84d949fe10245ae, user_id=35f595da10d34af4b1eeb5a3ec4a69b7, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:41.778025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031d608-a51b-46de-b269-7cfc88efb537 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:41.787690 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61ed8f-2e83-4dfc-a56c-26cf3cd2388e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:41.804033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 824/1610] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:41 2022] PUT /identity/v3/projects/a6434c8ace4940eab84d949fe10245ae/users/35f595da10d34af4b1eeb5a3ec4a69b7/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:41.806089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031d608-a51b-46de-b269-7cfc88efb537 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:41.879836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:41.980452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2793ba-2fbb-47be-8291-393f68c8b866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:41.980452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2793ba-2fbb-47be-8291-393f68c8b866 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:41.980452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2793ba-2fbb-47be-8291-393f68c8b866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:41.980452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2793ba-2fbb-47be-8291-393f68c8b866 admin admin] PATH_INFO: `/v3/projects/eddd10f655004ffe887d7c078f3824d7/users/a0717341e70e4476a3e5391533e467ce/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:42.027910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2793ba-2fbb-47be-8291-393f68c8b866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eddd10f655004ffe887d7c078f3824d7, user_id=a0717341e70e4476a3e5391533e467ce, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:42.027910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2793ba-2fbb-47be-8291-393f68c8b866 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:42.029114 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031d608-a51b-46de-b269-7cfc88efb537 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:42.041640 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 787/1611] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:41 2022] PUT /identity/v3/projects/eddd10f655004ffe887d7c078f3824d7/users/a0717341e70e4476a3e5391533e467ce/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:42.044643 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a7c54-f099-415c-a4e6-efb87590d5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:42.047264 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2793ba-2fbb-47be-8291-393f68c8b866 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:42.048551 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7c54-f099-415c-a4e6-efb87590d5a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:42.051677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7c54-f099-415c-a4e6-efb87590d5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:42.052174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7c54-f099-415c-a4e6-efb87590d5a8 admin admin] PATH_INFO: `/v3/projects/a8a5dc53fd4a4976b61b3890cf69ccf9/users/5d296c52b0d742d79eb2e35480a57da4/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:42.064159 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:42.098609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a7c54-f099-415c-a4e6-efb87590d5a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8a5dc53fd4a4976b61b3890cf69ccf9, user_id=5d296c52b0d742d79eb2e35480a57da4, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:42.105184 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a7c54-f099-415c-a4e6-efb87590d5a8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:42.130002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 825/1612] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:41 2022] PUT /identity/v3/projects/a8a5dc53fd4a4976b61b3890cf69ccf9/users/5d296c52b0d742d79eb2e35480a57da4/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:42.132000 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a7a3a-33a6-469b-b070-b9bdb1fbc6eb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:42.132793 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a7a3a-33a6-469b-b070-b9bdb1fbc6eb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:42.133522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a7a3a-33a6-469b-b070-b9bdb1fbc6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:42.143357 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2793ba-2fbb-47be-8291-393f68c8b866 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:42.191014 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ff1a7a3a-33a6-469b-b070-b9bdb1fbc6eb None None] MFA Rules not processed for user `352747efafff47c7a672023ee5511628`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:42.192518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ff1a7a3a-33a6-469b-b070-b9bdb1fbc6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:42.270205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b01b1-ea48-4d99-8c4f-a0c6aabaf02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:42.272015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b01b1-ea48-4d99-8c4f-a0c6aabaf02e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:42.272496 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b01b1-ea48-4d99-8c4f-a0c6aabaf02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:42.273666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b01b1-ea48-4d99-8c4f-a0c6aabaf02e admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:42.274698 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b01b1-ea48-4d99-8c4f-a0c6aabaf02e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:42.277522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9b01b1-ea48-4d99-8c4f-a0c6aabaf02e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:42.314634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 826/1613] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:42.314634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a7a3a-33a6-469b-b070-b9bdb1fbc6eb None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:42.318653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 788/1614] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:42 2022] POST /identity/v3/projects => generated 369 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:42.325381 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6358cb-b2fd-4c87-8060-14cf3cb07698 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:42.325876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6358cb-b2fd-4c87-8060-14cf3cb07698 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:42.326461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6358cb-b2fd-4c87-8060-14cf3cb07698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:42.327571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a7a3a-33a6-469b-b070-b9bdb1fbc6eb None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:42.354592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fb6358cb-b2fd-4c87-8060-14cf3cb07698 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:42.359914 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fb6358cb-b2fd-4c87-8060-14cf3cb07698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:42.408696 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503d425-abbd-41c1-bae9-c78f89a848b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:42.409911 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503d425-abbd-41c1-bae9-c78f89a848b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:42.410203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503d425-abbd-41c1-bae9-c78f89a848b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:42.410482 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503d425-abbd-41c1-bae9-c78f89a848b1 admin admin] PATH_INFO: `/v3/projects/3062b8785a4b4d8388a2cb49a0d54ebf/users/435e6979dcbb4d5f9c3c968420c5d17c/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:42.436123 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503d425-abbd-41c1-bae9-c78f89a848b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3062b8785a4b4d8388a2cb49a0d54ebf, user_id=435e6979dcbb4d5f9c3c968420c5d17c, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:42.439453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b503d425-abbd-41c1-bae9-c78f89a848b1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:42.468763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 827/1615] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:42 2022] PUT /identity/v3/projects/3062b8785a4b4d8388a2cb49a0d54ebf/users/435e6979dcbb4d5f9c3c968420c5d17c/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:42.470549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539aed7-c809-4fa7-83b6-a0feac8d843d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:42.471161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539aed7-c809-4fa7-83b6-a0feac8d843d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:42.472438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539aed7-c809-4fa7-83b6-a0feac8d843d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:42.506887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4539aed7-c809-4fa7-83b6-a0feac8d843d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:42.508407 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4539aed7-c809-4fa7-83b6-a0feac8d843d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:42.519384 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 789/1616] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:42.522057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf7e5a-6461-4e70-bbfe-54fd06111167 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:42.522568 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf7e5a-6461-4e70-bbfe-54fd06111167 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:42.523181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf7e5a-6461-4e70-bbfe-54fd06111167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:42.538018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:42.592490 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b4cf7e5a-6461-4e70-bbfe-54fd06111167 None None] MFA Rules not processed for user `5d296c52b0d742d79eb2e35480a57da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:42.594795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b4cf7e5a-6461-4e70-bbfe-54fd06111167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:42.678526 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:42.726244 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 828/1617] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:42.727532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539aed7-c809-4fa7-83b6-a0feac8d843d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:42.744822 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539aed7-c809-4fa7-83b6-a0feac8d843d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:42.769461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 790/1618] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:42.769461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf7e5a-6461-4e70-bbfe-54fd06111167 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:42.780747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad374687-9e19-41af-8bce-735e940b68e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:42.781458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad374687-9e19-41af-8bce-735e940b68e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:42.781752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad374687-9e19-41af-8bce-735e940b68e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:42.782013 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad374687-9e19-41af-8bce-735e940b68e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:42.782737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad374687-9e19-41af-8bce-735e940b68e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:42.788569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad374687-9e19-41af-8bce-735e940b68e5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:42.801856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf7e5a-6461-4e70-bbfe-54fd06111167 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:42.812948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919fb77-17f4-4c31-9827-ac684e556cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:42.815476 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919fb77-17f4-4c31-9827-ac684e556cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:42.815791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919fb77-17f4-4c31-9827-ac684e556cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:42.817614 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919fb77-17f4-4c31-9827-ac684e556cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:42.818433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919fb77-17f4-4c31-9827-ac684e556cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:42.823048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919fb77-17f4-4c31-9827-ac684e556cf3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:42.884695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 791/1619] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:42 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:42.886741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60573501-a11b-4e93-9c54-6543fd6c5e5f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:42.888733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60573501-a11b-4e93-9c54-6543fd6c5e5f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:42.889085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60573501-a11b-4e93-9c54-6543fd6c5e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:42.904139 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 829/1620] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:42 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:42.905298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad374687-9e19-41af-8bce-735e940b68e5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:42.951009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-60573501-a11b-4e93-9c54-6543fd6c5e5f None None] MFA Rules not processed for user `435e6979dcbb4d5f9c3c968420c5d17c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:42.952337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-60573501-a11b-4e93-9c54-6543fd6c5e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:43.035969 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 792/1621] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:43.035969 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60573501-a11b-4e93-9c54-6543fd6c5e5f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:43.055175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad374687-9e19-41af-8bce-735e940b68e5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:43.061488 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dbb899-86c1-42eb-9e75-f52d7f7e1669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:43.062595 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbb899-86c1-42eb-9e75-f52d7f7e1669 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:43.064915 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbb899-86c1-42eb-9e75-f52d7f7e1669 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:43.064915 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dbb899-86c1-42eb-9e75-f52d7f7e1669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:43.127997 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60573501-a11b-4e93-9c54-6543fd6c5e5f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:43.140619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ff2d4-cc9e-46b3-9b92-e8d119179505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:43.141820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ff2d4-cc9e-46b3-9b92-e8d119179505 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:43.142437 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ff2d4-cc9e-46b3-9b92-e8d119179505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:43.143078 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ff2d4-cc9e-46b3-9b92-e8d119179505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:43.205857 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbb899-86c1-42eb-9e75-f52d7f7e1669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:43.209167 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dbb899-86c1-42eb-9e75-f52d7f7e1669 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:43.227336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 830/1622] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:43.229182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737182cd-4fa9-4cf8-aa9f-6bb16baa5acd None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:43.229678 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737182cd-4fa9-4cf8-aa9f-6bb16baa5acd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:43.230157 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737182cd-4fa9-4cf8-aa9f-6bb16baa5acd None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:43.237121 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 831/1623] 10.222.0.64 () {54 vars in 962 bytes} [Thu Jul 21 16:05:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:05:43.238119 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737182cd-4fa9-4cf8-aa9f-6bb16baa5acd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:43.254558 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737182cd-4fa9-4cf8-aa9f-6bb16baa5acd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:43.260423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4de42-7c91-460a-8027-9986d85d2296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:43.261182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4de42-7c91-460a-8027-9986d85d2296 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:43.261485 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4de42-7c91-460a-8027-9986d85d2296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:43.261795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4de42-7c91-460a-8027-9986d85d2296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:43.262661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4de42-7c91-460a-8027-9986d85d2296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:43.268865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4de42-7c91-460a-8027-9986d85d2296 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:43.285932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 832/1624] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:43.287045 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4de42-7c91-460a-8027-9986d85d2296 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:43.297464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:43.314758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ff2d4-cc9e-46b3-9b92-e8d119179505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:43.317852 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ff2d4-cc9e-46b3-9b92-e8d119179505 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:43.321896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4de42-7c91-460a-8027-9986d85d2296 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:43.339498 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116753a3-65d8-4631-82f5-998b5ea49969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:43.340557 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116753a3-65d8-4631-82f5-998b5ea49969 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:43.341033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116753a3-65d8-4631-82f5-998b5ea49969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:43.341578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116753a3-65d8-4631-82f5-998b5ea49969 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:43.342542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116753a3-65d8-4631-82f5-998b5ea49969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:43.346246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 793/1625] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:43.347959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ff2d4-cc9e-46b3-9b92-e8d119179505 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:43.348235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116753a3-65d8-4631-82f5-998b5ea49969 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:43.368374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ff2d4-cc9e-46b3-9b92-e8d119179505 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:43.378587 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f3393-3033-4e28-a686-e01860f52ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:43.380232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f3393-3033-4e28-a686-e01860f52ddb admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:43.380819 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f3393-3033-4e28-a686-e01860f52ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:43.381606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f3393-3033-4e28-a686-e01860f52ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:43.382946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f3393-3033-4e28-a686-e01860f52ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:43.389279 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f3393-3033-4e28-a686-e01860f52ddb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:43.402191 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 833/1626] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:43 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:43.404119 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a1d57-0931-4b6c-916f-3282722cfe3b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:43.406743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a1d57-0931-4b6c-916f-3282722cfe3b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:43.407310 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a1d57-0931-4b6c-916f-3282722cfe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:43.458189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 794/1627] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:43 2022] POST /identity/v3/projects => generated 405 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:43.460571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f3393-3033-4e28-a686-e01860f52ddb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:43.468548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-093a1d57-0931-4b6c-916f-3282722cfe3b None None] MFA Rules not processed for user `e9a1ec1f6bb7467dbd63ad1da36d48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:43.473882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-093a1d57-0931-4b6c-916f-3282722cfe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:43.525347 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:43.627559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f3393-3033-4e28-a686-e01860f52ddb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:43.642295 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11693eac-f62a-49db-bb47-5279b2525a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:43.644934 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11693eac-f62a-49db-bb47-5279b2525a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:43.647035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11693eac-f62a-49db-bb47-5279b2525a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:43.647397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11693eac-f62a-49db-bb47-5279b2525a52 admin admin] PATH_INFO: `/v3/projects/3561aa9e6bc04d26911a380e92ea7fb9/users/a3c213a698ae4cd4aec708c95df1b630/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:43.674747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 834/1628] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Jul 21 16:05:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:43.677547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a1d57-0931-4b6c-916f-3282722cfe3b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:43.700037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11693eac-f62a-49db-bb47-5279b2525a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3561aa9e6bc04d26911a380e92ea7fb9, user_id=a3c213a698ae4cd4aec708c95df1b630, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:43.715726 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11693eac-f62a-49db-bb47-5279b2525a52 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:43.722384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a1d57-0931-4b6c-916f-3282722cfe3b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:43.749532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14333cc4-a8a4-4b23-83c3-135b1ad0847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:43.750807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14333cc4-a8a4-4b23-83c3-135b1ad0847e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:43.751133 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 795/1629] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:43 2022] PUT /identity/v3/projects/3561aa9e6bc04d26911a380e92ea7fb9/users/a3c213a698ae4cd4aec708c95df1b630/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:43.751302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14333cc4-a8a4-4b23-83c3-135b1ad0847e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:43.751724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14333cc4-a8a4-4b23-83c3-135b1ad0847e admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:43.752272 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11693eac-f62a-49db-bb47-5279b2525a52 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:43.753634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14333cc4-a8a4-4b23-83c3-135b1ad0847e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:43.757022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14333cc4-a8a4-4b23-83c3-135b1ad0847e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:43.809552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 835/1630] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:43.809552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14333cc4-a8a4-4b23-83c3-135b1ad0847e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:43.874805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14333cc4-a8a4-4b23-83c3-135b1ad0847e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:43.936150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11693eac-f62a-49db-bb47-5279b2525a52 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:43.982802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2c4cf-fc2b-4357-a52b-5f55e19e4eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:43.983709 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2c4cf-fc2b-4357-a52b-5f55e19e4eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:43.984096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2c4cf-fc2b-4357-a52b-5f55e19e4eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:43.984503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2c4cf-fc2b-4357-a52b-5f55e19e4eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:43.985691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2c4cf-fc2b-4357-a52b-5f55e19e4eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:43.989060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2c4cf-fc2b-4357-a52b-5f55e19e4eb3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:44.052754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 796/1631] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:43 2022] POST /identity/v3/users => generated 309 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:44.058534 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2c4cf-fc2b-4357-a52b-5f55e19e4eb3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:44.100662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2c4cf-fc2b-4357-a52b-5f55e19e4eb3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:44.117960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93969f-e345-4558-bd94-68743996003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:44.121605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93969f-e345-4558-bd94-68743996003a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:44.121896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93969f-e345-4558-bd94-68743996003a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:44.122232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93969f-e345-4558-bd94-68743996003a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:44.127548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93969f-e345-4558-bd94-68743996003a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:44.134049 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93969f-e345-4558-bd94-68743996003a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:44.165922 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 797/1632] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:44.166632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93969f-e345-4558-bd94-68743996003a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:44.198728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93969f-e345-4558-bd94-68743996003a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:44.210220 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79550724-3215-401b-85a8-8c416b2781dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:44.212116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79550724-3215-401b-85a8-8c416b2781dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:44.212714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79550724-3215-401b-85a8-8c416b2781dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:44.213348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79550724-3215-401b-85a8-8c416b2781dd admin admin] PATH_INFO: `/v3/projects/598ca8b1f5134c79bbc7db7e50cc0cd3/users/fa662a04737648948a3b3815fef1d8ce/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:44.217803 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c926cf-fa00-425c-8ede-0d421e300e17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:44.218608 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c926cf-fa00-425c-8ede-0d421e300e17 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:44.218768 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c926cf-fa00-425c-8ede-0d421e300e17 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:44.219071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c926cf-fa00-425c-8ede-0d421e300e17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:44.278100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79550724-3215-401b-85a8-8c416b2781dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=598ca8b1f5134c79bbc7db7e50cc0cd3, user_id=fa662a04737648948a3b3815fef1d8ce, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:44.291774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79550724-3215-401b-85a8-8c416b2781dd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:44.346060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 798/1633] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:44 2022] PUT /identity/v3/projects/598ca8b1f5134c79bbc7db7e50cc0cd3/users/fa662a04737648948a3b3815fef1d8ce/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:44.348356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79550724-3215-401b-85a8-8c416b2781dd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:44.358677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c926cf-fa00-425c-8ede-0d421e300e17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:44.362283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c926cf-fa00-425c-8ede-0d421e300e17 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:44.378727 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:44.402949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 836/1634] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:44.404955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c926cf-fa00-425c-8ede-0d421e300e17 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:44.443057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c926cf-fa00-425c-8ede-0d421e300e17 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:44.524697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:44.576799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15d753-6b38-446a-be59-f945877ae599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:44.577575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15d753-6b38-446a-be59-f945877ae599 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:44.577862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15d753-6b38-446a-be59-f945877ae599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:44.578141 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d15d753-6b38-446a-be59-f945877ae599 admin admin] PATH_INFO: `/v3/projects/3561aa9e6bc04d26911a380e92ea7fb9/users/a3c213a698ae4cd4aec708c95df1b630/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:44.587311 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15d753-6b38-446a-be59-f945877ae599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3561aa9e6bc04d26911a380e92ea7fb9, user_id=a3c213a698ae4cd4aec708c95df1b630, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:44.591226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d15d753-6b38-446a-be59-f945877ae599 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:44.626647 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 837/1635] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:44 2022] PUT /identity/v3/projects/3561aa9e6bc04d26911a380e92ea7fb9/users/a3c213a698ae4cd4aec708c95df1b630/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:44.628130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15d753-6b38-446a-be59-f945877ae599 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:44.713580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79550724-3215-401b-85a8-8c416b2781dd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:44.827263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d15d753-6b38-446a-be59-f945877ae599 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:44.869115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58929-28b3-4248-b3e2-696cda4608b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:44.870871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58929-28b3-4248-b3e2-696cda4608b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:44.870871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58929-28b3-4248-b3e2-696cda4608b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:44.871289 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d58929-28b3-4248-b3e2-696cda4608b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:44.873137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062c79e-af7d-4c8e-9564-b2d94bec9803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:44.874058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062c79e-af7d-4c8e-9564-b2d94bec9803 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:44.874364 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062c79e-af7d-4c8e-9564-b2d94bec9803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:44.875174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062c79e-af7d-4c8e-9564-b2d94bec9803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:44.875587 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062c79e-af7d-4c8e-9564-b2d94bec9803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:44.877490 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062c79e-af7d-4c8e-9564-b2d94bec9803 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:44.885518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d58929-28b3-4248-b3e2-696cda4608b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:44.888560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d58929-28b3-4248-b3e2-696cda4608b6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:44.905981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 799/1636] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 559 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:44.909006 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa0f5e-f2b3-4c9a-8add-f96e0f604145 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:44.909301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa0f5e-f2b3-4c9a-8add-f96e0f604145 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:44.909587 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa0f5e-f2b3-4c9a-8add-f96e0f604145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:44.920755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 838/1637] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:44.922675 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58929-28b3-4248-b3e2-696cda4608b6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:44.958228 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d58929-28b3-4248-b3e2-696cda4608b6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:44.974039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446331c7-1ff5-422d-825e-feb52c883a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:44.980791 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446331c7-1ff5-422d-825e-feb52c883a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:44.981403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446331c7-1ff5-422d-825e-feb52c883a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:44.982059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446331c7-1ff5-422d-825e-feb52c883a87 admin admin] PATH_INFO: `/v3/projects/ea1a9ee660c946fba087dde6083d845d/users/73e4aeba5b164f668feb9acb292fe788/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:45.010192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2afa0f5e-f2b3-4c9a-8add-f96e0f604145 None None] MFA Rules not processed for user `a3c213a698ae4cd4aec708c95df1b630`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:45.011531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2afa0f5e-f2b3-4c9a-8add-f96e0f604145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:45.092669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446331c7-1ff5-422d-825e-feb52c883a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1a9ee660c946fba087dde6083d845d, user_id=73e4aeba5b164f668feb9acb292fe788, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:45.108492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446331c7-1ff5-422d-825e-feb52c883a87 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:45.153347 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 839/1638] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:44 2022] PUT /identity/v3/projects/ea1a9ee660c946fba087dde6083d845d/users/73e4aeba5b164f668feb9acb292fe788/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:45.158428 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446331c7-1ff5-422d-825e-feb52c883a87 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:45.208909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 800/1639] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:44 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:45.210495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa0f5e-f2b3-4c9a-8add-f96e0f604145 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:45.236754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa0f5e-f2b3-4c9a-8add-f96e0f604145 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:45.372707 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:45.509003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b4023-63c7-4d33-988c-3ec923bd68d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:45.510196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b4023-63c7-4d33-988c-3ec923bd68d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:45.510594 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b4023-63c7-4d33-988c-3ec923bd68d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:45.511117 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b4023-63c7-4d33-988c-3ec923bd68d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:45.512020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b4023-63c7-4d33-988c-3ec923bd68d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:45.513851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b4023-63c7-4d33-988c-3ec923bd68d6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:45.515429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446331c7-1ff5-422d-825e-feb52c883a87 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:45.536233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 801/1640] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:45.537359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b4023-63c7-4d33-988c-3ec923bd68d6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:45.555043 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecc09b-6320-45fb-98b2-d07a8905adf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:45.557515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecc09b-6320-45fb-98b2-d07a8905adf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:45.558266 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecc09b-6320-45fb-98b2-d07a8905adf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:45.559652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecc09b-6320-45fb-98b2-d07a8905adf1 admin admin] PATH_INFO: `/v3/projects/598ca8b1f5134c79bbc7db7e50cc0cd3/users/fa662a04737648948a3b3815fef1d8ce/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:45.565128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecc09b-6320-45fb-98b2-d07a8905adf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=598ca8b1f5134c79bbc7db7e50cc0cd3, user_id=fa662a04737648948a3b3815fef1d8ce, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:45.578803 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecc09b-6320-45fb-98b2-d07a8905adf1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:45.658213 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 840/1641] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:45 2022] PUT /identity/v3/projects/598ca8b1f5134c79bbc7db7e50cc0cd3/users/fa662a04737648948a3b3815fef1d8ce/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:45.664767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecc09b-6320-45fb-98b2-d07a8905adf1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:45.891747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b4023-63c7-4d33-988c-3ec923bd68d6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:45.907682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:46.035564 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecc09b-6320-45fb-98b2-d07a8905adf1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:46.054786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3506a0d9-0326-43cd-8795-de710f8ccbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:46.063996 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506a0d9-0326-43cd-8795-de710f8ccbbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:46.064770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506a0d9-0326-43cd-8795-de710f8ccbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:46.065256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3506a0d9-0326-43cd-8795-de710f8ccbbc admin admin] PATH_INFO: `/v3/projects/ea1a9ee660c946fba087dde6083d845d/users/73e4aeba5b164f668feb9acb292fe788/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:46.080529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506a0d9-0326-43cd-8795-de710f8ccbbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea1a9ee660c946fba087dde6083d845d, user_id=73e4aeba5b164f668feb9acb292fe788, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:46.083456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3506a0d9-0326-43cd-8795-de710f8ccbbc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:46.109830 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94f3b5-3412-4a55-84f1-e0352e356426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:46.110572 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94f3b5-3412-4a55-84f1-e0352e356426 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:46.110946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94f3b5-3412-4a55-84f1-e0352e356426 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:46.111236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94f3b5-3412-4a55-84f1-e0352e356426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:46.121516 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 841/1642] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:45 2022] PUT /identity/v3/projects/ea1a9ee660c946fba087dde6083d845d/users/73e4aeba5b164f668feb9acb292fe788/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:46.123565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd42843-4999-4bba-833b-8a26c5b62519 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:46.123565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd42843-4999-4bba-833b-8a26c5b62519 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:46.123843 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd42843-4999-4bba-833b-8a26c5b62519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:46.230966 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0dd42843-4999-4bba-833b-8a26c5b62519 None None] MFA Rules not processed for user `fa662a04737648948a3b3815fef1d8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:46.232267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0dd42843-4999-4bba-833b-8a26c5b62519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:46.257132 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94f3b5-3412-4a55-84f1-e0352e356426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:46.264912 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94f3b5-3412-4a55-84f1-e0352e356426 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:46.314711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 802/1643] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:45 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 776 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:46.317389 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b2709-a109-4b29-beef-6079f8536951 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:46.317869 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b2709-a109-4b29-beef-6079f8536951 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:46.318384 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b2709-a109-4b29-beef-6079f8536951 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:46.331303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 803/1644] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 21 16:05:46 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:05:46.338714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4755c-405c-4a48-879c-bbfaea738c2a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:46.339249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4755c-405c-4a48-879c-bbfaea738c2a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:46.339674 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e4755c-405c-4a48-879c-bbfaea738c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:46.392867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 842/1645] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:46.394473 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422f488-36cf-4de1-8537-c8b4fd1e4f97 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:46.394788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422f488-36cf-4de1-8537-c8b4fd1e4f97 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:46.395527 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422f488-36cf-4de1-8537-c8b4fd1e4f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:46.417654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5422f488-36cf-4de1-8537-c8b4fd1e4f97 None None] MFA Rules not processed for user `e9a1ec1f6bb7467dbd63ad1da36d48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:46.419796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5422f488-36cf-4de1-8537-c8b4fd1e4f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:46.437349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-16e4755c-405c-4a48-879c-bbfaea738c2a None None] MFA Rules not processed for user `73e4aeba5b164f668feb9acb292fe788`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:46.440844 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-16e4755c-405c-4a48-879c-bbfaea738c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:46.536646 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:46.634213 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 843/1646] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 16:05:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:46.637727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422f488-36cf-4de1-8537-c8b4fd1e4f97 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:46.658972 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 804/1647] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:46 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:46.751673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:46.760396 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422f488-36cf-4de1-8537-c8b4fd1e4f97 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:46.767902 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f13e74-e556-4bc7-98ac-805f2c66d2df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:46.814107 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4755c-405c-4a48-879c-bbfaea738c2a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:46.818225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f13e74-e556-4bc7-98ac-805f2c66d2df service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:46.818225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f13e74-e556-4bc7-98ac-805f2c66d2df service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:46.818225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f13e74-e556-4bc7-98ac-805f2c66d2df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:46.818225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f13e74-e556-4bc7-98ac-805f2c66d2df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:46.818661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e4755c-405c-4a48-879c-bbfaea738c2a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:46.818789 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f13e74-e556-4bc7-98ac-805f2c66d2df service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:46.818920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e865f-b6a2-4719-842b-0a95faa7e92e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:46.818920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e865f-b6a2-4719-842b-0a95faa7e92e service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:46.818920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e865f-b6a2-4719-842b-0a95faa7e92e service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:46.818920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e865f-b6a2-4719-842b-0a95faa7e92e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:46.819374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 844/1648] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:46 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:46.837192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e865f-b6a2-4719-842b-0a95faa7e92e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:46.838772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e865f-b6a2-4719-842b-0a95faa7e92e service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:46.864200 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 805/1649] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:05:46.912538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f13e74-e556-4bc7-98ac-805f2c66d2df service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:46.924706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f13e74-e556-4bc7-98ac-805f2c66d2df service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:46.938227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de029a5-0d7b-4198-971f-5f26e36a8a82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:46.940180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de029a5-0d7b-4198-971f-5f26e36a8a82 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:46.940518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de029a5-0d7b-4198-971f-5f26e36a8a82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:46.940794 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de029a5-0d7b-4198-971f-5f26e36a8a82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:46.967677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de029a5-0d7b-4198-971f-5f26e36a8a82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:46.969273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de029a5-0d7b-4198-971f-5f26e36a8a82 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:47.017144 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 845/1650] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:46 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:47.499177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e865f-b6a2-4719-842b-0a95faa7e92e service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:47.765447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de029a5-0d7b-4198-971f-5f26e36a8a82 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:47.835663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e865f-b6a2-4719-842b-0a95faa7e92e service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:47.868113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec96128-bedd-4f56-830e-6bc078b728f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:47.870920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec96128-bedd-4f56-830e-6bc078b728f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:47.871425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec96128-bedd-4f56-830e-6bc078b728f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:47.871919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec96128-bedd-4f56-830e-6bc078b728f9 admin admin] PATH_INFO: `/v3/users/5d296c52b0d742d79eb2e35480a57da4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:47.881401 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec96128-bedd-4f56-830e-6bc078b728f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d296c52b0d742d79eb2e35480a57da4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:47.883335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: WARNING py.warnings [None req-0ec96128-bedd-4f56-830e-6bc078b728f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 16:05:47.883335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: warnings.warn(msg) Jul 21 16:05:47.883335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: Jul 21 16:05:47.899720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec96128-bedd-4f56-830e-6bc078b728f9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:48.107232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ec96128-bedd-4f56-830e-6bc078b728f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d296c52b0d742d79eb2e35480a57da4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:48.123318 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de029a5-0d7b-4198-971f-5f26e36a8a82 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:48.139234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5afbe-439e-44ae-8fd4-30b6eb3335f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:48.140225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5afbe-439e-44ae-8fd4-30b6eb3335f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:48.140529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5afbe-439e-44ae-8fd4-30b6eb3335f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:48.140773 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5afbe-439e-44ae-8fd4-30b6eb3335f1 admin admin] PATH_INFO: `/v3/users/435e6979dcbb4d5f9c3c968420c5d17c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:48.143662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ec96128-bedd-4f56-830e-6bc078b728f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d296c52b0d742d79eb2e35480a57da4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:48.152156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5afbe-439e-44ae-8fd4-30b6eb3335f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435e6979dcbb4d5f9c3c968420c5d17c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:48.165006 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5afbe-439e-44ae-8fd4-30b6eb3335f1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:48.193292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ec96128-bedd-4f56-830e-6bc078b728f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d296c52b0d742d79eb2e35480a57da4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:48.194983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ec96128-bedd-4f56-830e-6bc078b728f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d296c52b0d742d79eb2e35480a57da4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:48.203864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0ec96128-bedd-4f56-830e-6bc078b728f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d296c52b0d742d79eb2e35480a57da4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:48.283835 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-49c5afbe-439e-44ae-8fd4-30b6eb3335f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435e6979dcbb4d5f9c3c968420c5d17c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:48.330081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-49c5afbe-439e-44ae-8fd4-30b6eb3335f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435e6979dcbb4d5f9c3c968420c5d17c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:48.359346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-49c5afbe-439e-44ae-8fd4-30b6eb3335f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435e6979dcbb4d5f9c3c968420c5d17c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:48.360231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-49c5afbe-439e-44ae-8fd4-30b6eb3335f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435e6979dcbb4d5f9c3c968420c5d17c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:48.374033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 806/1651] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:05:47 2022] DELETE /identity/v3/users/5d296c52b0d742d79eb2e35480a57da4 => generated 0 bytes in 873 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:48.374254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e17809-3acb-4113-bf77-8e60db83db7c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:48.374565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e17809-3acb-4113-bf77-8e60db83db7c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:48.375996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e17809-3acb-4113-bf77-8e60db83db7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:48.387412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-49c5afbe-439e-44ae-8fd4-30b6eb3335f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435e6979dcbb4d5f9c3c968420c5d17c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:48.398376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 846/1652] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:05:47 2022] DELETE /identity/v3/users/435e6979dcbb4d5f9c3c968420c5d17c => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:48.408609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebc833-120d-44d3-bd36-f4075c9e8a55 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:48.411671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebc833-120d-44d3-bd36-f4075c9e8a55 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:48.412504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebc833-120d-44d3-bd36-f4075c9e8a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:48.441911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-56e17809-3acb-4113-bf77-8e60db83db7c None None] MFA Rules not processed for user `3212bd24e1f84b70872940214632536f`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:48.446216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-56e17809-3acb-4113-bf77-8e60db83db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:48.460500 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e8ebc833-120d-44d3-bd36-f4075c9e8a55 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:48.467996 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e8ebc833-120d-44d3-bd36-f4075c9e8a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:48.514730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:48.677380 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:48.715811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 847/1653] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:48.718010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6cbd3-a578-4bee-8ce8-be2c265fc97b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:48.718195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6cbd3-a578-4bee-8ce8-be2c265fc97b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:48.729058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6cbd3-a578-4bee-8ce8-be2c265fc97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:48.741993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 807/1654] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:48.743528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e17809-3acb-4113-bf77-8e60db83db7c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:48.746021 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-56e17809-3acb-4113-bf77-8e60db83db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:48.778710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-68f6cbd3-a578-4bee-8ce8-be2c265fc97b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:48.782738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-68f6cbd3-a578-4bee-8ce8-be2c265fc97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:48.851681 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 848/1655] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:48.871373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6cbd3-a578-4bee-8ce8-be2c265fc97b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:48.879540 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-68f6cbd3-a578-4bee-8ce8-be2c265fc97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:48.969388 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e17809-3acb-4113-bf77-8e60db83db7c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:48.988967 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a380db1-87c8-4ac4-bf53-e4740c465dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:48.990167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a380db1-87c8-4ac4-bf53-e4740c465dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:48.990667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a380db1-87c8-4ac4-bf53-e4740c465dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:48.991293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a380db1-87c8-4ac4-bf53-e4740c465dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:49.034422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a380db1-87c8-4ac4-bf53-e4740c465dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:49.037275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a380db1-87c8-4ac4-bf53-e4740c465dc4 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:49.079335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 808/1656] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:49.081263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a380db1-87c8-4ac4-bf53-e4740c465dc4 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:49.110034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a380db1-87c8-4ac4-bf53-e4740c465dc4 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:49.124705 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd051e-07fd-4c04-9114-494abf0a42cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:49.125593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd051e-07fd-4c04-9114-494abf0a42cc service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:49.126045 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd051e-07fd-4c04-9114-494abf0a42cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:49.126469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd051e-07fd-4c04-9114-494abf0a42cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:49.157458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd051e-07fd-4c04-9114-494abf0a42cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:49.160986 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd051e-07fd-4c04-9114-494abf0a42cc service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:49.200962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 809/1657] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:49.202307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6cbd3-a578-4bee-8ce8-be2c265fc97b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:49.202732 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd051e-07fd-4c04-9114-494abf0a42cc service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:49.204598 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-02cd051e-07fd-4c04-9114-494abf0a42cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:49.223769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749a5f0-c6c7-465c-8ebc-85bd3f4b5600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:49.224471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749a5f0-c6c7-465c-8ebc-85bd3f4b5600 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:49.224757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749a5f0-c6c7-465c-8ebc-85bd3f4b5600 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:49.225033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749a5f0-c6c7-465c-8ebc-85bd3f4b5600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:49.239830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749a5f0-c6c7-465c-8ebc-85bd3f4b5600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:49.240583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd051e-07fd-4c04-9114-494abf0a42cc service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:49.254337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749a5f0-c6c7-465c-8ebc-85bd3f4b5600 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:49.254663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545bba8-0a56-49bf-b9e5-9ae24bb22dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:49.255905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545bba8-0a56-49bf-b9e5-9ae24bb22dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:49.256764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545bba8-0a56-49bf-b9e5-9ae24bb22dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:49.257057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545bba8-0a56-49bf-b9e5-9ae24bb22dc8 admin admin] PATH_INFO: `/v3/users/352747efafff47c7a672023ee5511628` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:49.261175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545bba8-0a56-49bf-b9e5-9ae24bb22dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=352747efafff47c7a672023ee5511628)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:49.263211 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a545bba8-0a56-49bf-b9e5-9ae24bb22dc8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:49.284919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 849/1658] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:49.431710 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a545bba8-0a56-49bf-b9e5-9ae24bb22dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '352747efafff47c7a672023ee5511628'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:49.454799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a545bba8-0a56-49bf-b9e5-9ae24bb22dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '352747efafff47c7a672023ee5511628'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:49.468345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a545bba8-0a56-49bf-b9e5-9ae24bb22dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '352747efafff47c7a672023ee5511628'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:49.469035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a545bba8-0a56-49bf-b9e5-9ae24bb22dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '352747efafff47c7a672023ee5511628'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:49.469777 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a545bba8-0a56-49bf-b9e5-9ae24bb22dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '352747efafff47c7a672023ee5511628'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:49.504306 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 810/1659] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:05:49 2022] DELETE /identity/v3/users/352747efafff47c7a672023ee5511628 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:49.509252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6001681-ce8b-4c3a-a500-ebbfde509f5b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:49.509541 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6001681-ce8b-4c3a-a500-ebbfde509f5b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:49.510078 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6001681-ce8b-4c3a-a500-ebbfde509f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:49.549397 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e6001681-ce8b-4c3a-a500-ebbfde509f5b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:49.559304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e6001681-ce8b-4c3a-a500-ebbfde509f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:49.803336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 850/1660] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:49.931239 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545bba8-0a56-49bf-b9e5-9ae24bb22dc8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:49.935343 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a545bba8-0a56-49bf-b9e5-9ae24bb22dc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:49.965721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545bba8-0a56-49bf-b9e5-9ae24bb22dc8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:49.969991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6001681-ce8b-4c3a-a500-ebbfde509f5b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:49.972427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e6001681-ce8b-4c3a-a500-ebbfde509f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:49.973014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121f0b2-667a-47dd-ac71-7e45b63c7153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:49.974184 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121f0b2-667a-47dd-ac71-7e45b63c7153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:49.974634 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121f0b2-667a-47dd-ac71-7e45b63c7153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:49.975081 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121f0b2-667a-47dd-ac71-7e45b63c7153 admin admin] PATH_INFO: `/v3/users/ae884c5ad5864599bef5dbaf8ad08b4c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:49.982522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121f0b2-667a-47dd-ac71-7e45b63c7153 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae884c5ad5864599bef5dbaf8ad08b4c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:49.984943 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121f0b2-667a-47dd-ac71-7e45b63c7153 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:50.022599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:50.137228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c121f0b2-667a-47dd-ac71-7e45b63c7153 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae884c5ad5864599bef5dbaf8ad08b4c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:50.170365 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c121f0b2-667a-47dd-ac71-7e45b63c7153 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae884c5ad5864599bef5dbaf8ad08b4c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:50.215466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c121f0b2-667a-47dd-ac71-7e45b63c7153 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae884c5ad5864599bef5dbaf8ad08b4c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:50.216427 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c121f0b2-667a-47dd-ac71-7e45b63c7153 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae884c5ad5864599bef5dbaf8ad08b4c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:50.217660 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c121f0b2-667a-47dd-ac71-7e45b63c7153 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae884c5ad5864599bef5dbaf8ad08b4c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:50.322342 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 811/1661] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:05:49 2022] DELETE /identity/v3/users/ae884c5ad5864599bef5dbaf8ad08b4c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:50.324283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09932da1-b273-4958-b28f-4fc10a8a269a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:50.324630 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09932da1-b273-4958-b28f-4fc10a8a269a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:50.324973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09932da1-b273-4958-b28f-4fc10a8a269a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:50.369542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6001681-ce8b-4c3a-a500-ebbfde509f5b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:50.392995 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-09932da1-b273-4958-b28f-4fc10a8a269a None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:50.400372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-09932da1-b273-4958-b28f-4fc10a8a269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:50.508611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:50.566116 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adec953-dda2-44e6-a15a-ebc1c0ccaba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:50.571084 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adec953-dda2-44e6-a15a-ebc1c0ccaba1 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:50.571744 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adec953-dda2-44e6-a15a-ebc1c0ccaba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:50.573047 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adec953-dda2-44e6-a15a-ebc1c0ccaba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:50.579826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4adec953-dda2-44e6-a15a-ebc1c0ccaba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:50.636755 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 812/1662] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:05:50.698194 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09932da1-b273-4958-b28f-4fc10a8a269a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:50.710349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-09932da1-b273-4958-b28f-4fc10a8a269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:50.777440 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09932da1-b273-4958-b28f-4fc10a8a269a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:50.786048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee88b7e-a1f5-4a47-b932-f0c1ef6089ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:50.787448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee88b7e-a1f5-4a47-b932-f0c1ef6089ae service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:50.787942 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee88b7e-a1f5-4a47-b932-f0c1ef6089ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:50.788911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee88b7e-a1f5-4a47-b932-f0c1ef6089ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:50.798842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adec953-dda2-44e6-a15a-ebc1c0ccaba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:50.800544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adec953-dda2-44e6-a15a-ebc1c0ccaba1 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:50.820121 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee88b7e-a1f5-4a47-b932-f0c1ef6089ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:50.821437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 851/1663] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 853 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:05:50.825511 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee88b7e-a1f5-4a47-b932-f0c1ef6089ae service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:50.877229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 813/1664] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:51.038854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adec953-dda2-44e6-a15a-ebc1c0ccaba1 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:51.040412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4adec953-dda2-44e6-a15a-ebc1c0ccaba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:51.061552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee88b7e-a1f5-4a47-b932-f0c1ef6089ae service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:51.064476 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7ee88b7e-a1f5-4a47-b932-f0c1ef6089ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:51.066269 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adec953-dda2-44e6-a15a-ebc1c0ccaba1 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:51.083967 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dbd70b-82c5-42a5-b181-2aa6711468cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:51.088364 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbd70b-82c5-42a5-b181-2aa6711468cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:51.088667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbd70b-82c5-42a5-b181-2aa6711468cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:51.088957 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbd70b-82c5-42a5-b181-2aa6711468cd admin admin] PATH_INFO: `/v3/projects/a8a5dc53fd4a4976b61b3890cf69ccf9` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:51.093766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbd70b-82c5-42a5-b181-2aa6711468cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8a5dc53fd4a4976b61b3890cf69ccf9)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:51.094870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: WARNING py.warnings [None req-74dbd70b-82c5-42a5-b181-2aa6711468cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 16:05:51.094870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: warnings.warn(msg) Jul 21 16:05:51.094870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: Jul 21 16:05:51.096103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dbd70b-82c5-42a5-b181-2aa6711468cd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:51.116672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee88b7e-a1f5-4a47-b932-f0c1ef6089ae service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:51.138909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04303d8-97dd-4696-80a8-c2fe2982ab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:51.144610 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04303d8-97dd-4696-80a8-c2fe2982ab42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:51.145086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04303d8-97dd-4696-80a8-c2fe2982ab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:51.145555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04303d8-97dd-4696-80a8-c2fe2982ab42 admin admin] PATH_INFO: `/v3/projects/3062b8785a4b4d8388a2cb49a0d54ebf` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:51.158008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04303d8-97dd-4696-80a8-c2fe2982ab42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3062b8785a4b4d8388a2cb49a0d54ebf)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:51.161301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04303d8-97dd-4696-80a8-c2fe2982ab42 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:51.290172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-74dbd70b-82c5-42a5-b181-2aa6711468cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8a5dc53fd4a4976b61b3890cf69ccf9', 'request_id': 'req-74dbd70b-82c5-42a5-b181-2aa6711468cd'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:51.320420 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-74dbd70b-82c5-42a5-b181-2aa6711468cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8a5dc53fd4a4976b61b3890cf69ccf9', 'request_id': 'req-74dbd70b-82c5-42a5-b181-2aa6711468cd'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:51.343088 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e04303d8-97dd-4696-80a8-c2fe2982ab42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3062b8785a4b4d8388a2cb49a0d54ebf', 'request_id': 'req-e04303d8-97dd-4696-80a8-c2fe2982ab42'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:51.378950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e04303d8-97dd-4696-80a8-c2fe2982ab42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3062b8785a4b4d8388a2cb49a0d54ebf', 'request_id': 'req-e04303d8-97dd-4696-80a8-c2fe2982ab42'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:51.387017 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-74dbd70b-82c5-42a5-b181-2aa6711468cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8a5dc53fd4a4976b61b3890cf69ccf9', 'request_id': 'req-74dbd70b-82c5-42a5-b181-2aa6711468cd'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:51.401232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e04303d8-97dd-4696-80a8-c2fe2982ab42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3062b8785a4b4d8388a2cb49a0d54ebf', 'request_id': 'req-e04303d8-97dd-4696-80a8-c2fe2982ab42'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:51.432904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-74dbd70b-82c5-42a5-b181-2aa6711468cd admin admin] The token cache is being invalidate because project a8a5dc53fd4a4976b61b3890cf69ccf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:05:51.433371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-74dbd70b-82c5-42a5-b181-2aa6711468cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:51.436018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-74dbd70b-82c5-42a5-b181-2aa6711468cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:51.439151 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e04303d8-97dd-4696-80a8-c2fe2982ab42 admin admin] The token cache is being invalidate because project 3062b8785a4b4d8388a2cb49a0d54ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:05:51.442992 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e04303d8-97dd-4696-80a8-c2fe2982ab42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:51.450367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 852/1665] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:05:51 2022] DELETE /identity/v3/projects/a8a5dc53fd4a4976b61b3890cf69ccf9 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:51.452933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa975eab-c440-47fb-8300-dc9c272b28f3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:51.453365 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa975eab-c440-47fb-8300-dc9c272b28f3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:51.453864 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa975eab-c440-47fb-8300-dc9c272b28f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:51.456539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e04303d8-97dd-4696-80a8-c2fe2982ab42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:51.463093 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 814/1666] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:05:51 2022] DELETE /identity/v3/projects/3062b8785a4b4d8388a2cb49a0d54ebf => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:05:51.466323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04303d8-97dd-4696-80a8-c2fe2982ab42 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:51.471290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e04303d8-97dd-4696-80a8-c2fe2982ab42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:51.493128 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:51.542322 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-aa975eab-c440-47fb-8300-dc9c272b28f3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:51.544749 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-aa975eab-c440-47fb-8300-dc9c272b28f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:51.660539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04303d8-97dd-4696-80a8-c2fe2982ab42 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:51.670634 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d7e8c-2b47-446d-ac79-068f19c421dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:51.673206 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d7e8c-2b47-446d-ac79-068f19c421dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:51.673970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d7e8c-2b47-446d-ac79-068f19c421dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:51.674650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d7e8c-2b47-446d-ac79-068f19c421dd admin admin] PATH_INFO: `/v3/users/73e4aeba5b164f668feb9acb292fe788` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:51.677329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d7e8c-2b47-446d-ac79-068f19c421dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=73e4aeba5b164f668feb9acb292fe788)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:51.684025 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d7e8c-2b47-446d-ac79-068f19c421dd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:51.812665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 853/1667] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:51.830001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf3ec1-41d9-450a-9251-4794030027fa None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:51.831426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf3ec1-41d9-450a-9251-4794030027fa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:51.831543 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1f5d7e8c-2b47-446d-ac79-068f19c421dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73e4aeba5b164f668feb9acb292fe788'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:51.831896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf3ec1-41d9-450a-9251-4794030027fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:51.852074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1f5d7e8c-2b47-446d-ac79-068f19c421dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73e4aeba5b164f668feb9acb292fe788'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:51.886414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1f5d7e8c-2b47-446d-ac79-068f19c421dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73e4aeba5b164f668feb9acb292fe788'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:51.889504 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1f5d7e8c-2b47-446d-ac79-068f19c421dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73e4aeba5b164f668feb9acb292fe788'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:51.890845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1f5d7e8c-2b47-446d-ac79-068f19c421dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73e4aeba5b164f668feb9acb292fe788'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:51.897948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:51.913238 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d8cf3ec1-41d9-450a-9251-4794030027fa None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:51.918311 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d8cf3ec1-41d9-450a-9251-4794030027fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:51.948773 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 854/1668] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:51.954460 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf3ec1-41d9-450a-9251-4794030027fa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:51.981306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf3ec1-41d9-450a-9251-4794030027fa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:51.994355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9765437-b4e4-4045-9850-ca93f817d6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:51.995301 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9765437-b4e4-4045-9850-ca93f817d6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:51.995818 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9765437-b4e4-4045-9850-ca93f817d6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:51.996236 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9765437-b4e4-4045-9850-ca93f817d6e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:51.997963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9765437-b4e4-4045-9850-ca93f817d6e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:05:51.998351 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9765437-b4e4-4045-9850-ca93f817d6e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:52.004829 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9765437-b4e4-4045-9850-ca93f817d6e9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:52.038596 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 815/1669] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:05:51 2022] DELETE /identity/v3/users/73e4aeba5b164f668feb9acb292fe788 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:52.041731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 855/1670] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:05:52.059146 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d7e8c-2b47-446d-ac79-068f19c421dd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:52.341004 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d7e8c-2b47-446d-ac79-068f19c421dd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:52.385789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c71a9-30f6-4688-b249-a4b1d7f2f5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:52.389894 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c71a9-30f6-4688-b249-a4b1d7f2f5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:52.393692 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c71a9-30f6-4688-b249-a4b1d7f2f5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:52.394329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c71a9-30f6-4688-b249-a4b1d7f2f5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:52.399877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c71a9-30f6-4688-b249-a4b1d7f2f5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:52.409618 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c71a9-30f6-4688-b249-a4b1d7f2f5c2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:52.412042 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9765437-b4e4-4045-9850-ca93f817d6e9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:52.414093 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b9765437-b4e4-4045-9850-ca93f817d6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:52.437174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9765437-b4e4-4045-9850-ca93f817d6e9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:52.444679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8efa30-f3ee-4396-8529-312986a52ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:52.447106 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8efa30-f3ee-4396-8529-312986a52ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:52.447991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8efa30-f3ee-4396-8529-312986a52ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:52.448699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8efa30-f3ee-4396-8529-312986a52ec6 admin admin] PATH_INFO: `/v3/users/5cf92b91a9034b839626c3d40a47b14f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:52.454278 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8efa30-f3ee-4396-8529-312986a52ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cf92b91a9034b839626c3d40a47b14f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:52.459394 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8efa30-f3ee-4396-8529-312986a52ec6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:52.518864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 816/1671] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:52 2022] POST /identity/v3/projects => generated 371 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:52.520718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c71a9-30f6-4688-b249-a4b1d7f2f5c2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:52.551341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:52.603770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8c8efa30-f3ee-4396-8529-312986a52ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cf92b91a9034b839626c3d40a47b14f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:52.655050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8c8efa30-f3ee-4396-8529-312986a52ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cf92b91a9034b839626c3d40a47b14f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:52.681611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8c8efa30-f3ee-4396-8529-312986a52ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cf92b91a9034b839626c3d40a47b14f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:52.682728 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8c8efa30-f3ee-4396-8529-312986a52ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cf92b91a9034b839626c3d40a47b14f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:52.712402 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8c8efa30-f3ee-4396-8529-312986a52ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cf92b91a9034b839626c3d40a47b14f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:52.731876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c71a9-30f6-4688-b249-a4b1d7f2f5c2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:52.735661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 856/1672] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:05:52 2022] DELETE /identity/v3/users/5cf92b91a9034b839626c3d40a47b14f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:05:52.741288 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392cd44-0e1e-41cd-b454-579fbaa5f1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:52.743058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4470b93-2f33-4512-969b-9843bd708eb4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:52.743570 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4470b93-2f33-4512-969b-9843bd708eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:52.744121 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4470b93-2f33-4512-969b-9843bd708eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:52.744235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392cd44-0e1e-41cd-b454-579fbaa5f1db admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:52.744649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392cd44-0e1e-41cd-b454-579fbaa5f1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:52.745650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392cd44-0e1e-41cd-b454-579fbaa5f1db admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:52.746379 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392cd44-0e1e-41cd-b454-579fbaa5f1db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:52.750653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392cd44-0e1e-41cd-b454-579fbaa5f1db admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:52.815227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d4470b93-2f33-4512-969b-9843bd708eb4 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:52.817348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d4470b93-2f33-4512-969b-9843bd708eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:52.824369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 817/1673] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:52 2022] POST /identity/v3/users => generated 286 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:05:52.827703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392cd44-0e1e-41cd-b454-579fbaa5f1db admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:52.835600 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2392cd44-0e1e-41cd-b454-579fbaa5f1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:52.880259 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392cd44-0e1e-41cd-b454-579fbaa5f1db admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:52.958416 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 857/1674] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:05:52.991224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4470b93-2f33-4512-969b-9843bd708eb4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:52.993045 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d4470b93-2f33-4512-969b-9843bd708eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:53.051484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2b0d7-adfe-4022-acc9-964fff81f287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:53.055185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2b0d7-adfe-4022-acc9-964fff81f287 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:53.056867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2b0d7-adfe-4022-acc9-964fff81f287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:53.057655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2b0d7-adfe-4022-acc9-964fff81f287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:53.058945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2b0d7-adfe-4022-acc9-964fff81f287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:53.064103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2b0d7-adfe-4022-acc9-964fff81f287 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:53.082102 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4470b93-2f33-4512-969b-9843bd708eb4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:53.094588 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 818/1675] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:05:53.094838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dada6b-b0ec-410c-97b9-ddadbfa59896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:53.095680 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dada6b-b0ec-410c-97b9-ddadbfa59896 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:53.095970 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dada6b-b0ec-410c-97b9-ddadbfa59896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:53.097122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2b0d7-adfe-4022-acc9-964fff81f287 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:53.099315 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dada6b-b0ec-410c-97b9-ddadbfa59896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:53.121284 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dada6b-b0ec-410c-97b9-ddadbfa59896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:53.123354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dada6b-b0ec-410c-97b9-ddadbfa59896 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:53.125487 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2b0d7-adfe-4022-acc9-964fff81f287 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:53.136453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 858/1676] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:05:53.139263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56a900-5f4c-4444-950f-8fafbd63bc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:53.140383 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56a900-5f4c-4444-950f-8fafbd63bc1f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:53.140880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56a900-5f4c-4444-950f-8fafbd63bc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:53.142095 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56a900-5f4c-4444-950f-8fafbd63bc1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:53.143128 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56a900-5f4c-4444-950f-8fafbd63bc1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:53.145854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56a900-5f4c-4444-950f-8fafbd63bc1f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:53.170048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 819/1677] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:53.175360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dada6b-b0ec-410c-97b9-ddadbfa59896 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:53.181755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:53.195091 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dada6b-b0ec-410c-97b9-ddadbfa59896 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:53.198312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b9c18-4219-4279-9ac6-16d7e97b5806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:53.199345 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b9c18-4219-4279-9ac6-16d7e97b5806 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:53.199636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b9c18-4219-4279-9ac6-16d7e97b5806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:53.200064 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b9c18-4219-4279-9ac6-16d7e97b5806 admin admin] PATH_INFO: `/v3/projects/0a67a9fc90e14213b2a81800192a63cc/users/a7f78b875b7e4e8cab842e24750b8fdb/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:53.224822 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b9c18-4219-4279-9ac6-16d7e97b5806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a67a9fc90e14213b2a81800192a63cc, user_id=a7f78b875b7e4e8cab842e24750b8fdb, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:53.228331 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b9c18-4219-4279-9ac6-16d7e97b5806 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:53.260953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d414e26-1bbe-42a0-a8a0-47ac7c2ab469 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:53.261385 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d414e26-1bbe-42a0-a8a0-47ac7c2ab469 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:53.262007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d414e26-1bbe-42a0-a8a0-47ac7c2ab469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:53.263950 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 859/1678] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:53 2022] PUT /identity/v3/projects/0a67a9fc90e14213b2a81800192a63cc/users/a7f78b875b7e4e8cab842e24750b8fdb/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:53.307345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4d414e26-1bbe-42a0-a8a0-47ac7c2ab469 None None] MFA Rules not processed for user `a7f78b875b7e4e8cab842e24750b8fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:53.308873 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4d414e26-1bbe-42a0-a8a0-47ac7c2ab469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:53.429960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b9c18-4219-4279-9ac6-16d7e97b5806 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:53.434735 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 820/1679] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:53.596764 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b9c18-4219-4279-9ac6-16d7e97b5806 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:53.603530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a92f4-ad93-4bb2-ae58-7832ada7aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:53.604240 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a92f4-ad93-4bb2-ae58-7832ada7aee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:53.604525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a92f4-ad93-4bb2-ae58-7832ada7aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:53.604857 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a92f4-ad93-4bb2-ae58-7832ada7aee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:53.605657 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a92f4-ad93-4bb2-ae58-7832ada7aee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:53.607748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a92f4-ad93-4bb2-ae58-7832ada7aee6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:53.651216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 860/1680] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:53 2022] POST /identity/v3/projects => generated 373 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:53.655954 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d414e26-1bbe-42a0-a8a0-47ac7c2ab469 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:53.678641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d414e26-1bbe-42a0-a8a0-47ac7c2ab469 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:53.693386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:53.790220 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746535b-e4a6-4246-ba92-39bd8a3cc991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:53.791196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746535b-e4a6-4246-ba92-39bd8a3cc991 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:53.791606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746535b-e4a6-4246-ba92-39bd8a3cc991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:53.791995 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746535b-e4a6-4246-ba92-39bd8a3cc991 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:53.793414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746535b-e4a6-4246-ba92-39bd8a3cc991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:53.796897 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2746535b-e4a6-4246-ba92-39bd8a3cc991 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:53.810628 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a92f4-ad93-4bb2-ae58-7832ada7aee6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:53.818863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6e0a92f4-ad93-4bb2-ae58-7832ada7aee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:53.847282 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a92f4-ad93-4bb2-ae58-7832ada7aee6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:53.865114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 821/1681] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:53 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:05:53.867541 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746535b-e4a6-4246-ba92-39bd8a3cc991 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:53.872186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33592188-cd16-46b1-99e1-bfcd24d797ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:53.876852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33592188-cd16-46b1-99e1-bfcd24d797ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:53.878803 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33592188-cd16-46b1-99e1-bfcd24d797ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:53.880646 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33592188-cd16-46b1-99e1-bfcd24d797ab admin admin] PATH_INFO: `/v3/projects/ea1a9ee660c946fba087dde6083d845d` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:53.885669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33592188-cd16-46b1-99e1-bfcd24d797ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea1a9ee660c946fba087dde6083d845d)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:53.892854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33592188-cd16-46b1-99e1-bfcd24d797ab admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:53.908326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2746535b-e4a6-4246-ba92-39bd8a3cc991 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:53.928075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18be765-c2fa-44bc-a5f0-d820116af686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:53.930963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18be765-c2fa-44bc-a5f0-d820116af686 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:53.931829 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18be765-c2fa-44bc-a5f0-d820116af686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:53.933033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18be765-c2fa-44bc-a5f0-d820116af686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:53.936756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18be765-c2fa-44bc-a5f0-d820116af686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:53.939055 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18be765-c2fa-44bc-a5f0-d820116af686 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:53.972751 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 822/1682] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:53.974064 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18be765-c2fa-44bc-a5f0-d820116af686 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:53.980685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c18be765-c2fa-44bc-a5f0-d820116af686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:54.023612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18be765-c2fa-44bc-a5f0-d820116af686 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:54.059316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-33592188-cd16-46b1-99e1-bfcd24d797ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea1a9ee660c946fba087dde6083d845d', 'request_id': 'req-33592188-cd16-46b1-99e1-bfcd24d797ab'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:54.085512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-33592188-cd16-46b1-99e1-bfcd24d797ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea1a9ee660c946fba087dde6083d845d', 'request_id': 'req-33592188-cd16-46b1-99e1-bfcd24d797ab'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:54.099369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-33592188-cd16-46b1-99e1-bfcd24d797ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea1a9ee660c946fba087dde6083d845d', 'request_id': 'req-33592188-cd16-46b1-99e1-bfcd24d797ab'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:54.133452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-33592188-cd16-46b1-99e1-bfcd24d797ab admin admin] The token cache is being invalidate because project ea1a9ee660c946fba087dde6083d845d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:05:54.135967 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-33592188-cd16-46b1-99e1-bfcd24d797ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:54.137186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-33592188-cd16-46b1-99e1-bfcd24d797ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:54.139876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 861/1683] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:05:53 2022] DELETE /identity/v3/projects/ea1a9ee660c946fba087dde6083d845d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:54.140853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33592188-cd16-46b1-99e1-bfcd24d797ab admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:54.144159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-33592188-cd16-46b1-99e1-bfcd24d797ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:54.183870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68e72b-0385-4e55-b888-672fa26390bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:54.185691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68e72b-0385-4e55-b888-672fa26390bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:54.186121 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68e72b-0385-4e55-b888-672fa26390bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:54.186595 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f68e72b-0385-4e55-b888-672fa26390bd admin admin] PATH_INFO: `/v3/projects/d57259f7b918428c9537fc255b1e7483` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:54.189949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68e72b-0385-4e55-b888-672fa26390bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57259f7b918428c9537fc255b1e7483)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:54.193708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f68e72b-0385-4e55-b888-672fa26390bd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:54.263084 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:54.321884 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33592188-cd16-46b1-99e1-bfcd24d797ab admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:54.357017 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f68e72b-0385-4e55-b888-672fa26390bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57259f7b918428c9537fc255b1e7483', 'request_id': 'req-5f68e72b-0385-4e55-b888-672fa26390bd'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:54.381764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f68e72b-0385-4e55-b888-672fa26390bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57259f7b918428c9537fc255b1e7483', 'request_id': 'req-5f68e72b-0385-4e55-b888-672fa26390bd'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:54.399786 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f68e72b-0385-4e55-b888-672fa26390bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57259f7b918428c9537fc255b1e7483', 'request_id': 'req-5f68e72b-0385-4e55-b888-672fa26390bd'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:54.426876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f68e72b-0385-4e55-b888-672fa26390bd admin admin] The token cache is being invalidate because project d57259f7b918428c9537fc255b1e7483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:05:54.427503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f68e72b-0385-4e55-b888-672fa26390bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:54.432515 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f68e72b-0385-4e55-b888-672fa26390bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:54.440208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 823/1684] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:05:53 2022] DELETE /identity/v3/projects/d57259f7b918428c9537fc255b1e7483 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:54.440208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68e72b-0385-4e55-b888-672fa26390bd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:54.445453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f68e72b-0385-4e55-b888-672fa26390bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:54.490199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f05dea-6045-4a93-8545-eda0881ebff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:54.491482 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f05dea-6045-4a93-8545-eda0881ebff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:54.491718 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f05dea-6045-4a93-8545-eda0881ebff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:54.497457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f05dea-6045-4a93-8545-eda0881ebff0 admin admin] PATH_INFO: `/v3/projects/9e06bf908d2b4a7692749867b7a0e2df` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:54.499701 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f05dea-6045-4a93-8545-eda0881ebff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e06bf908d2b4a7692749867b7a0e2df)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:54.501917 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f05dea-6045-4a93-8545-eda0881ebff0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:54.517297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:54.621565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d0f05dea-6045-4a93-8545-eda0881ebff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e06bf908d2b4a7692749867b7a0e2df', 'request_id': 'req-d0f05dea-6045-4a93-8545-eda0881ebff0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:54.635508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f68e72b-0385-4e55-b888-672fa26390bd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:54.639664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d0f05dea-6045-4a93-8545-eda0881ebff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e06bf908d2b4a7692749867b7a0e2df', 'request_id': 'req-d0f05dea-6045-4a93-8545-eda0881ebff0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:54.650556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d0f05dea-6045-4a93-8545-eda0881ebff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e06bf908d2b4a7692749867b7a0e2df', 'request_id': 'req-d0f05dea-6045-4a93-8545-eda0881ebff0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:54.681759 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d0f05dea-6045-4a93-8545-eda0881ebff0 admin admin] The token cache is being invalidate because project 9e06bf908d2b4a7692749867b7a0e2df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:05:54.684827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d0f05dea-6045-4a93-8545-eda0881ebff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:54.688577 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d0f05dea-6045-4a93-8545-eda0881ebff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:54.696584 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 862/1685] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:05:54 2022] DELETE /identity/v3/projects/9e06bf908d2b4a7692749867b7a0e2df => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:54.697879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f05dea-6045-4a93-8545-eda0881ebff0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:54.699752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d0f05dea-6045-4a93-8545-eda0881ebff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:54.788539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30205d-4c4a-4a73-88e7-07307ca6f0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:54.791369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30205d-4c4a-4a73-88e7-07307ca6f0eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:54.791369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30205d-4c4a-4a73-88e7-07307ca6f0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:54.791369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30205d-4c4a-4a73-88e7-07307ca6f0eb admin admin] PATH_INFO: `/v3/projects/119150c43e8c44d0a0a3d4043dd6eed0/users/d446f929b95640468c6f1481e37472ed/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:54.811185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30205d-4c4a-4a73-88e7-07307ca6f0eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=119150c43e8c44d0a0a3d4043dd6eed0, user_id=d446f929b95640468c6f1481e37472ed, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:54.814385 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30205d-4c4a-4a73-88e7-07307ca6f0eb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:54.839299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 824/1686] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:54 2022] PUT /identity/v3/projects/119150c43e8c44d0a0a3d4043dd6eed0/users/d446f929b95640468c6f1481e37472ed/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:54.841007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5122d-f990-46ed-b0ea-1f800151001e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:54.842271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5122d-f990-46ed-b0ea-1f800151001e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:54.842271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5122d-f990-46ed-b0ea-1f800151001e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:54.866091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d7a5122d-f990-46ed-b0ea-1f800151001e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:54.868926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d7a5122d-f990-46ed-b0ea-1f800151001e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:54.887462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f05dea-6045-4a93-8545-eda0881ebff0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:54.999911 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:55.061733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 825/1687] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:55.065640 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5122d-f990-46ed-b0ea-1f800151001e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:55.069979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d7a5122d-f990-46ed-b0ea-1f800151001e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:55.109549 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5122d-f990-46ed-b0ea-1f800151001e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:55.112259 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:55.113804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:55.114311 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:55.114787 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a admin admin] PATH_INFO: `/v3/projects/4771f8e60b3a4d528b1b5a1cfa3e7fe1` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:55.124127 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4771f8e60b3a4d528b1b5a1cfa3e7fe1)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:55.124405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36d2dd-fc18-4e89-b741-6f9a39fba0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:55.125267 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36d2dd-fc18-4e89-b741-6f9a39fba0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:55.126486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36d2dd-fc18-4e89-b741-6f9a39fba0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:55.126952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36d2dd-fc18-4e89-b741-6f9a39fba0e6 admin admin] PATH_INFO: `/v3/users/fa662a04737648948a3b3815fef1d8ce` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:55.127572 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:55.129082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36d2dd-fc18-4e89-b741-6f9a39fba0e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa662a04737648948a3b3815fef1d8ce)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:55.131972 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36d2dd-fc18-4e89-b741-6f9a39fba0e6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:55.228104 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd36d2dd-fc18-4e89-b741-6f9a39fba0e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa662a04737648948a3b3815fef1d8ce'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:55.230387 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:55.252003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd36d2dd-fc18-4e89-b741-6f9a39fba0e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa662a04737648948a3b3815fef1d8ce'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:55.289354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd36d2dd-fc18-4e89-b741-6f9a39fba0e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa662a04737648948a3b3815fef1d8ce'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:55.295691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd36d2dd-fc18-4e89-b741-6f9a39fba0e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa662a04737648948a3b3815fef1d8ce'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:55.296612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd36d2dd-fc18-4e89-b741-6f9a39fba0e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa662a04737648948a3b3815fef1d8ce'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:55.330918 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4771f8e60b3a4d528b1b5a1cfa3e7fe1', 'request_id': 'req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:55.357590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4771f8e60b3a4d528b1b5a1cfa3e7fe1', 'request_id': 'req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:55.364194 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 826/1688] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:05:55 2022] DELETE /identity/v3/users/fa662a04737648948a3b3815fef1d8ce => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:55.371964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e0c53-9b9d-4d9d-be20-54152a5f0890 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:55.372406 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e0c53-9b9d-4d9d-be20-54152a5f0890 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:55.375649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e0c53-9b9d-4d9d-be20-54152a5f0890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:55.378848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4771f8e60b3a4d528b1b5a1cfa3e7fe1', 'request_id': 'req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:55.419826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a admin admin] The token cache is being invalidate because project 4771f8e60b3a4d528b1b5a1cfa3e7fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:05:55.420131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:55.423034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:55.429295 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 863/1689] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:05:54 2022] DELETE /identity/v3/projects/4771f8e60b3a4d528b1b5a1cfa3e7fe1 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:55.431186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:55.432189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-374e0c53-9b9d-4d9d-be20-54152a5f0890 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:55.435039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:55.435907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-374e0c53-9b9d-4d9d-be20-54152a5f0890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:55.624655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 827/1690] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:55.635567 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff9cff-b18b-4dc4-9cb0-7804b1e1ca3a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:55.636946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c5889-208e-44c2-8ade-881e484bb4ea None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:55.637223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c5889-208e-44c2-8ade-881e484bb4ea None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:55.637605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c5889-208e-44c2-8ade-881e484bb4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:55.652905 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccee742-6aaf-48a7-afac-548d1be987ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:55.654029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccee742-6aaf-48a7-afac-548d1be987ba admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:55.654662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccee742-6aaf-48a7-afac-548d1be987ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:55.655244 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccee742-6aaf-48a7-afac-548d1be987ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:55.656402 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccee742-6aaf-48a7-afac-548d1be987ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:55.674246 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccee742-6aaf-48a7-afac-548d1be987ba admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:55.697777 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-591c5889-208e-44c2-8ade-881e484bb4ea None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:55.702002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-591c5889-208e-44c2-8ade-881e484bb4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:55.711697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 864/1691] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:55 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:55.711697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d4995-4f7b-4223-a076-01c69506e4e9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:55.711959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d4995-4f7b-4223-a076-01c69506e4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:55.712505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d4995-4f7b-4223-a076-01c69506e4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:55.733561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 828/1692] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:55.734737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c5889-208e-44c2-8ade-881e484bb4ea None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:55.740766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-591c5889-208e-44c2-8ade-881e484bb4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:55.751113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ef2d4995-4f7b-4223-a076-01c69506e4e9 None None] MFA Rules not processed for user `3212bd24e1f84b70872940214632536f`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:55.753334 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ef2d4995-4f7b-4223-a076-01c69506e4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:55.772711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c5889-208e-44c2-8ade-881e484bb4ea None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:55.781760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7639e7-3d18-4dda-ae0b-97b1a7c54952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:55.783124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7639e7-3d18-4dda-ae0b-97b1a7c54952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:55.783610 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7639e7-3d18-4dda-ae0b-97b1a7c54952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:55.784105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7639e7-3d18-4dda-ae0b-97b1a7c54952 admin admin] PATH_INFO: `/v3/users/a3c213a698ae4cd4aec708c95df1b630` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:55.785674 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7639e7-3d18-4dda-ae0b-97b1a7c54952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c213a698ae4cd4aec708c95df1b630)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:55.788048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7639e7-3d18-4dda-ae0b-97b1a7c54952 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:55.882752 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fa7639e7-3d18-4dda-ae0b-97b1a7c54952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c213a698ae4cd4aec708c95df1b630'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:55.899268 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fa7639e7-3d18-4dda-ae0b-97b1a7c54952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c213a698ae4cd4aec708c95df1b630'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:55.919575 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fa7639e7-3d18-4dda-ae0b-97b1a7c54952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c213a698ae4cd4aec708c95df1b630'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:55.920988 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fa7639e7-3d18-4dda-ae0b-97b1a7c54952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c213a698ae4cd4aec708c95df1b630'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:55.922469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fa7639e7-3d18-4dda-ae0b-97b1a7c54952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c213a698ae4cd4aec708c95df1b630'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:55.940929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 865/1693] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:55.940929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac5191-0db3-4012-9e50-146b84fdd959 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:55.940929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac5191-0db3-4012-9e50-146b84fdd959 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:55.940929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac5191-0db3-4012-9e50-146b84fdd959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:55.957877 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:55.979539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 829/1694] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:05:55 2022] DELETE /identity/v3/users/a3c213a698ae4cd4aec708c95df1b630 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:55.980774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7639e7-3d18-4dda-ae0b-97b1a7c54952 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:55.984633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-14ac5191-0db3-4012-9e50-146b84fdd959 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:55.985953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fa7639e7-3d18-4dda-ae0b-97b1a7c54952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:55.988562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-14ac5191-0db3-4012-9e50-146b84fdd959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:56.085371 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:56.158452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7639e7-3d18-4dda-ae0b-97b1a7c54952 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:56.170120 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed280ce-18f7-4866-8017-995c661aa697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:56.171111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed280ce-18f7-4866-8017-995c661aa697 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:56.171399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed280ce-18f7-4866-8017-995c661aa697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:56.173943 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed280ce-18f7-4866-8017-995c661aa697 admin admin] PATH_INFO: `/v3/projects/119150c43e8c44d0a0a3d4043dd6eed0/users/d446f929b95640468c6f1481e37472ed/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:56.178841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed280ce-18f7-4866-8017-995c661aa697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119150c43e8c44d0a0a3d4043dd6eed0, user_id=d446f929b95640468c6f1481e37472ed, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:56.183969 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed280ce-18f7-4866-8017-995c661aa697 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:56.195365 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 866/1695] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:56.197257 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac5191-0db3-4012-9e50-146b84fdd959 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:56.209202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-14ac5191-0db3-4012-9e50-146b84fdd959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:56.223548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 830/1696] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:55 2022] PUT /identity/v3/projects/119150c43e8c44d0a0a3d4043dd6eed0/users/d446f929b95640468c6f1481e37472ed/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:56.225250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed280ce-18f7-4866-8017-995c661aa697 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:56.250661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac5191-0db3-4012-9e50-146b84fdd959 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:56.389532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a3a91-a9f5-4b5b-a9c2-26b2a3eb6c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:56.391806 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a3a91-a9f5-4b5b-a9c2-26b2a3eb6c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:56.392302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a3a91-a9f5-4b5b-a9c2-26b2a3eb6c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:56.392740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a3a91-a9f5-4b5b-a9c2-26b2a3eb6c81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:56.393691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a3a91-a9f5-4b5b-a9c2-26b2a3eb6c81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:05:56.394170 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a3a91-a9f5-4b5b-a9c2-26b2a3eb6c81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:56.396581 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a3a91-a9f5-4b5b-a9c2-26b2a3eb6c81 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:56.411287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 867/1697] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:05:56.412984 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80259948-836c-4510-b7d0-d1a97311468e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:56.413406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80259948-836c-4510-b7d0-d1a97311468e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:56.413817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80259948-836c-4510-b7d0-d1a97311468e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:56.448046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-80259948-836c-4510-b7d0-d1a97311468e None None] MFA Rules not processed for user `d446f929b95640468c6f1481e37472ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:56.453447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-80259948-836c-4510-b7d0-d1a97311468e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:56.477905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed280ce-18f7-4866-8017-995c661aa697 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:56.494508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64decb09-2a38-4e38-8965-e8402e8227ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:56.495256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64decb09-2a38-4e38-8965-e8402e8227ae admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:56.495539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64decb09-2a38-4e38-8965-e8402e8227ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:56.495817 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64decb09-2a38-4e38-8965-e8402e8227ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:56.496578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64decb09-2a38-4e38-8965-e8402e8227ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:05:56.497606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64decb09-2a38-4e38-8965-e8402e8227ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:56.499352 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64decb09-2a38-4e38-8965-e8402e8227ae admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:56.535750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 831/1698] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:05:56.536753 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64decb09-2a38-4e38-8965-e8402e8227ae admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:56.571028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64decb09-2a38-4e38-8965-e8402e8227ae admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:56.585843 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36493fd-5cba-47f9-a51c-a5e27d3f3da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:56.586591 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36493fd-5cba-47f9-a51c-a5e27d3f3da3 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:56.586900 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36493fd-5cba-47f9-a51c-a5e27d3f3da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:56.587208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36493fd-5cba-47f9-a51c-a5e27d3f3da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:56.588111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36493fd-5cba-47f9-a51c-a5e27d3f3da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:56.597879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36493fd-5cba-47f9-a51c-a5e27d3f3da3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:56.608401 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 868/1699] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:56 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:56.621040 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80259948-836c-4510-b7d0-d1a97311468e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:56.643237 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80259948-836c-4510-b7d0-d1a97311468e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:56.656898 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57d69f-362e-455c-b4bf-98b1eb1297aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:56.658225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57d69f-362e-455c-b4bf-98b1eb1297aa admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:56.658225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57d69f-362e-455c-b4bf-98b1eb1297aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:56.658721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57d69f-362e-455c-b4bf-98b1eb1297aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:56.659110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57d69f-362e-455c-b4bf-98b1eb1297aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:56.661086 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57d69f-362e-455c-b4bf-98b1eb1297aa admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:56.698025 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 832/1700] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:56 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:56.701661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36493fd-5cba-47f9-a51c-a5e27d3f3da3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:56.708599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:56.719445 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 869/1701] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:56 2022] POST /identity/v3/projects => generated 401 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:56.725043 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f36493fd-5cba-47f9-a51c-a5e27d3f3da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:56.726159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57d69f-362e-455c-b4bf-98b1eb1297aa admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:56.872840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57d69f-362e-455c-b4bf-98b1eb1297aa admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:56.878077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5381da-56d7-44ef-b726-936cbca7e8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:56.879098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5381da-56d7-44ef-b726-936cbca7e8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:56.879531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5381da-56d7-44ef-b726-936cbca7e8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:56.891368 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5381da-56d7-44ef-b726-936cbca7e8e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:56.892426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5381da-56d7-44ef-b726-936cbca7e8e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:56.894671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5381da-56d7-44ef-b726-936cbca7e8e9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:56.939943 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 870/1702] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:56 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:56.939943 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5381da-56d7-44ef-b726-936cbca7e8e9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:56.973415 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5381da-56d7-44ef-b726-936cbca7e8e9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:56.978653 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd440adb-93b6-4cb5-8a18-c768097fe88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:56.979426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd440adb-93b6-4cb5-8a18-c768097fe88e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:56.979711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd440adb-93b6-4cb5-8a18-c768097fe88e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:56.979991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd440adb-93b6-4cb5-8a18-c768097fe88e admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:56.980733 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd440adb-93b6-4cb5-8a18-c768097fe88e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:56.986452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd440adb-93b6-4cb5-8a18-c768097fe88e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:57.003138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36493fd-5cba-47f9-a51c-a5e27d3f3da3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:57.034499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 871/1703] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:56 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:57.038631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd440adb-93b6-4cb5-8a18-c768097fe88e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:57.064937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd440adb-93b6-4cb5-8a18-c768097fe88e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:57.069999 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfabeca-dc45-415b-b1da-5797b3fd2db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:57.070725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfabeca-dc45-415b-b1da-5797b3fd2db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:57.071035 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfabeca-dc45-415b-b1da-5797b3fd2db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:57.071332 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfabeca-dc45-415b-b1da-5797b3fd2db6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:57.072180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfabeca-dc45-415b-b1da-5797b3fd2db6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:57.073906 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfabeca-dc45-415b-b1da-5797b3fd2db6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:57.113732 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 872/1704] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:57.113732 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfabeca-dc45-415b-b1da-5797b3fd2db6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:57.132922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfabeca-dc45-415b-b1da-5797b3fd2db6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:57.138021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4266d-d798-4d99-bd1d-b6e10d1e7735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:57.138850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4266d-d798-4d99-bd1d-b6e10d1e7735 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:57.139060 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4266d-d798-4d99-bd1d-b6e10d1e7735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:57.139452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4266d-d798-4d99-bd1d-b6e10d1e7735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:57.140073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4266d-d798-4d99-bd1d-b6e10d1e7735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:57.141787 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4266d-d798-4d99-bd1d-b6e10d1e7735 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:57.178323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 873/1705] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:57.179412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4266d-d798-4d99-bd1d-b6e10d1e7735 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:57.198207 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4266d-d798-4d99-bd1d-b6e10d1e7735 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:57.206367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c5ad0-7429-4e05-b256-d83b442bf009 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:57.206540 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900f145-0bf6-449e-be59-9b5e4e083113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:57.207518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900f145-0bf6-449e-be59-9b5e4e083113 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:57.207518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900f145-0bf6-449e-be59-9b5e4e083113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:57.207729 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c5ad0-7429-4e05-b256-d83b442bf009 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:57.207809 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900f145-0bf6-449e-be59-9b5e4e083113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:57.208088 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c5ad0-7429-4e05-b256-d83b442bf009 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:57.208375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c5ad0-7429-4e05-b256-d83b442bf009 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:57.208466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900f145-0bf6-449e-be59-9b5e4e083113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:57.219595 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900f145-0bf6-449e-be59-9b5e4e083113 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:57.227885 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:57.240292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 874/1706] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:57.241164 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900f145-0bf6-449e-be59-9b5e4e083113 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:57.261335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900f145-0bf6-449e-be59-9b5e4e083113 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:57.279073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826ce6b-c8a9-4800-8a76-4bc36d5d6623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:57.279791 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826ce6b-c8a9-4800-8a76-4bc36d5d6623 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:57.280077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826ce6b-c8a9-4800-8a76-4bc36d5d6623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:57.280756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826ce6b-c8a9-4800-8a76-4bc36d5d6623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:57.281115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826ce6b-c8a9-4800-8a76-4bc36d5d6623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:57.282791 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826ce6b-c8a9-4800-8a76-4bc36d5d6623 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:57.306248 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 875/1707] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:57.310491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826ce6b-c8a9-4800-8a76-4bc36d5d6623 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:57.334618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826ce6b-c8a9-4800-8a76-4bc36d5d6623 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:57.347696 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc01332-ae73-47bf-ad11-0a2d53027773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:57.348649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc01332-ae73-47bf-ad11-0a2d53027773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:57.348941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc01332-ae73-47bf-ad11-0a2d53027773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:57.349656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc01332-ae73-47bf-ad11-0a2d53027773 admin admin] PATH_INFO: `/v3/projects/8f47a47c140c40f3a46ad9d50e6931e6/users/88cadfbcfa384f9b8386b91b5e59b52c/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:57.383156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc01332-ae73-47bf-ad11-0a2d53027773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f47a47c140c40f3a46ad9d50e6931e6, user_id=88cadfbcfa384f9b8386b91b5e59b52c, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:57.386112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc01332-ae73-47bf-ad11-0a2d53027773 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:57.397034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c5ad0-7429-4e05-b256-d83b442bf009 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:57.400850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c5ad0-7429-4e05-b256-d83b442bf009 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:57.416827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 876/1708] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:57 2022] PUT /identity/v3/projects/8f47a47c140c40f3a46ad9d50e6931e6/users/88cadfbcfa384f9b8386b91b5e59b52c/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:57.418923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc01332-ae73-47bf-ad11-0a2d53027773 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:57.434855 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 833/1709] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:57.442514 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c5ad0-7429-4e05-b256-d83b442bf009 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:57.446009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-001c5ad0-7429-4e05-b256-d83b442bf009 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:57.476818 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c5ad0-7429-4e05-b256-d83b442bf009 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:57.640483 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc01332-ae73-47bf-ad11-0a2d53027773 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:57.653915 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa262dc4-3eee-4913-910f-38217e56be15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:57.655757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa262dc4-3eee-4913-910f-38217e56be15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:57.656717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa262dc4-3eee-4913-910f-38217e56be15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:57.657367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa262dc4-3eee-4913-910f-38217e56be15 admin admin] PATH_INFO: `/v3/projects/4d5f4a8692fc4ff29b2c11c297e5fddd/users/cea62586ba2e4a03af70dac52acb4c9e/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:57.679140 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:57.704517 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa262dc4-3eee-4913-910f-38217e56be15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d5f4a8692fc4ff29b2c11c297e5fddd, user_id=cea62586ba2e4a03af70dac52acb4c9e, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:57.712989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa262dc4-3eee-4913-910f-38217e56be15 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:57.757945 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 877/1710] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:57 2022] PUT /identity/v3/projects/4d5f4a8692fc4ff29b2c11c297e5fddd/users/cea62586ba2e4a03af70dac52acb4c9e/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:57.762184 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d534819-b00c-4368-b50b-b5622d4d2f03 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:57.762747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d534819-b00c-4368-b50b-b5622d4d2f03 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:57.763366 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d534819-b00c-4368-b50b-b5622d4d2f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:57.783945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a1a37-2f40-41f3-87e0-734fab1a3a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:57.786938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a1a37-2f40-41f3-87e0-734fab1a3a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:57.790177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a1a37-2f40-41f3-87e0-734fab1a3a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:57.791125 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a1a37-2f40-41f3-87e0-734fab1a3a90 admin admin] PATH_INFO: `/v3/projects/598ca8b1f5134c79bbc7db7e50cc0cd3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:57.797871 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a1a37-2f40-41f3-87e0-734fab1a3a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=598ca8b1f5134c79bbc7db7e50cc0cd3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:57.809470 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a1a37-2f40-41f3-87e0-734fab1a3a90 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:57.853871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9d534819-b00c-4368-b50b-b5622d4d2f03 None None] MFA Rules not processed for user `88cadfbcfa384f9b8386b91b5e59b52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:57.856262 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9d534819-b00c-4368-b50b-b5622d4d2f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:58.008033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b97a1a37-2f40-41f3-87e0-734fab1a3a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '598ca8b1f5134c79bbc7db7e50cc0cd3', 'request_id': 'req-b97a1a37-2f40-41f3-87e0-734fab1a3a90'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:58.031988 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b97a1a37-2f40-41f3-87e0-734fab1a3a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '598ca8b1f5134c79bbc7db7e50cc0cd3', 'request_id': 'req-b97a1a37-2f40-41f3-87e0-734fab1a3a90'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:58.039873 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b97a1a37-2f40-41f3-87e0-734fab1a3a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '598ca8b1f5134c79bbc7db7e50cc0cd3', 'request_id': 'req-b97a1a37-2f40-41f3-87e0-734fab1a3a90'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:58.066569 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b97a1a37-2f40-41f3-87e0-734fab1a3a90 admin admin] The token cache is being invalidate because project 598ca8b1f5134c79bbc7db7e50cc0cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:05:58.067019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b97a1a37-2f40-41f3-87e0-734fab1a3a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:58.068450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b97a1a37-2f40-41f3-87e0-734fab1a3a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:58.070513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 834/1711] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:05:57 2022] DELETE /identity/v3/projects/598ca8b1f5134c79bbc7db7e50cc0cd3 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:58.071413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a1a37-2f40-41f3-87e0-734fab1a3a90 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:58.077489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b97a1a37-2f40-41f3-87e0-734fab1a3a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:58.132589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 878/1712] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:58.138789 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d534819-b00c-4368-b50b-b5622d4d2f03 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:58.139743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9d534819-b00c-4368-b50b-b5622d4d2f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:58.160941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:58.221547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a1a37-2f40-41f3-87e0-734fab1a3a90 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:58.226694 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd84c6-7b8b-4586-9d09-f6d7e1f0a2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:58.227659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd84c6-7b8b-4586-9d09-f6d7e1f0a2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:58.227996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd84c6-7b8b-4586-9d09-f6d7e1f0a2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:58.228275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd84c6-7b8b-4586-9d09-f6d7e1f0a2e8 admin admin] PATH_INFO: `/v3/projects/3561aa9e6bc04d26911a380e92ea7fb9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:58.229667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd84c6-7b8b-4586-9d09-f6d7e1f0a2e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3561aa9e6bc04d26911a380e92ea7fb9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:58.231754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fd84c6-7b8b-4586-9d09-f6d7e1f0a2e8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:58.294403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d534819-b00c-4368-b50b-b5622d4d2f03 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:58.321250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d4fd84c6-7b8b-4586-9d09-f6d7e1f0a2e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3561aa9e6bc04d26911a380e92ea7fb9', 'request_id': 'req-d4fd84c6-7b8b-4586-9d09-f6d7e1f0a2e8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:58.335229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d4fd84c6-7b8b-4586-9d09-f6d7e1f0a2e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3561aa9e6bc04d26911a380e92ea7fb9', 'request_id': 'req-d4fd84c6-7b8b-4586-9d09-f6d7e1f0a2e8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:58.350344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d4fd84c6-7b8b-4586-9d09-f6d7e1f0a2e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3561aa9e6bc04d26911a380e92ea7fb9', 'request_id': 'req-d4fd84c6-7b8b-4586-9d09-f6d7e1f0a2e8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:58.377426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d4fd84c6-7b8b-4586-9d09-f6d7e1f0a2e8 admin admin] The token cache is being invalidate because project 3561aa9e6bc04d26911a380e92ea7fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:05:58.377763 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d4fd84c6-7b8b-4586-9d09-f6d7e1f0a2e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:58.379316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d4fd84c6-7b8b-4586-9d09-f6d7e1f0a2e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:05:58.387665 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 835/1713] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:05:58 2022] DELETE /identity/v3/projects/3561aa9e6bc04d26911a380e92ea7fb9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:05:58.389557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d7b02-8ba4-45db-bd6a-718869863a2e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:58.389872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d7b02-8ba4-45db-bd6a-718869863a2e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:58.390200 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d7b02-8ba4-45db-bd6a-718869863a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:58.408315 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5db61b-86e5-4518-9389-e190fd119347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:58.409060 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5db61b-86e5-4518-9389-e190fd119347 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:58.409353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5db61b-86e5-4518-9389-e190fd119347 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:58.409630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5db61b-86e5-4518-9389-e190fd119347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:58.415367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-eb5db61b-86e5-4518-9389-e190fd119347 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:58.431201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f86d7b02-8ba4-45db-bd6a-718869863a2e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:58.432441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f86d7b02-8ba4-45db-bd6a-718869863a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:58.519047 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:58.547122 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5db61b-86e5-4518-9389-e190fd119347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:58.548622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5db61b-86e5-4518-9389-e190fd119347 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:58.578657 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 879/1715] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:58.578972 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 836/1715] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:58.579115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63f43a-d691-451f-9325-2698707fd351 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:58.579115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63f43a-d691-451f-9325-2698707fd351 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:58.579115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c63f43a-d691-451f-9325-2698707fd351 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:58.579527 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb0e9a-9a6f-4920-9341-e657a85e8540 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:58.579527 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb0e9a-9a6f-4920-9341-e657a85e8540 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:58.579527 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb0e9a-9a6f-4920-9341-e657a85e8540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:58.579942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 880/1716] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 21 16:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:05:58.579942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63f43a-d691-451f-9325-2698707fd351 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:58.592222 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7c63f43a-d691-451f-9325-2698707fd351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:58.631204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c63f43a-d691-451f-9325-2698707fd351 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:58.651312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46977450-5578-4413-a4df-3d69262044eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:58.652017 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46977450-5578-4413-a4df-3d69262044eb admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:58.652304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46977450-5578-4413-a4df-3d69262044eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:58.652581 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46977450-5578-4413-a4df-3d69262044eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:58.653306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46977450-5578-4413-a4df-3d69262044eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:58.655332 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46977450-5578-4413-a4df-3d69262044eb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:58.657231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-36bb0e9a-9a6f-4920-9341-e657a85e8540 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:58.664721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-36bb0e9a-9a6f-4920-9341-e657a85e8540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:58.700619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 837/1717] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:58.704282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7229b-8d19-4d92-ab2a-6b2a2e301a46 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:58.706781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7229b-8d19-4d92-ab2a-6b2a2e301a46 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:58.707700 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b7229b-8d19-4d92-ab2a-6b2a2e301a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:58.771336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-20b7229b-8d19-4d92-ab2a-6b2a2e301a46 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:58.776303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-20b7229b-8d19-4d92-ab2a-6b2a2e301a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:58.785735 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 881/1718] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:58 2022] POST /identity/v3/projects => generated 381 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:58.788766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1f1b5-80cb-4328-ab3a-05965fd769d9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:58.790015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1f1b5-80cb-4328-ab3a-05965fd769d9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:58.793827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1f1b5-80cb-4328-ab3a-05965fd769d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:58.974414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fef1f1b5-80cb-4328-ab3a-05965fd769d9 None None] MFA Rules not processed for user `1b46a82ffe92437fb8205bd186a8b05e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:58.978400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fef1f1b5-80cb-4328-ab3a-05965fd769d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:59.019658 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:05:59.060831 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 838/1719] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:59.060831 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7229b-8d19-4d92-ab2a-6b2a2e301a46 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:59.060831 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-20b7229b-8d19-4d92-ab2a-6b2a2e301a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:59.193805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 882/1720] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 16:05:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:59.198258 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06865c-8924-4fd3-8105-85a77133572d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:59.202887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06865c-8924-4fd3-8105-85a77133572d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:59.203569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06865c-8924-4fd3-8105-85a77133572d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:59.254164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b7229b-8d19-4d92-ab2a-6b2a2e301a46 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:59.268814 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee49cd0c-7371-43c6-9f5e-6d6186902c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:59.269526 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49cd0c-7371-43c6-9f5e-6d6186902c3a service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:59.269811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49cd0c-7371-43c6-9f5e-6d6186902c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:59.270249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee49cd0c-7371-43c6-9f5e-6d6186902c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:59.281833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-dc06865c-8924-4fd3-8105-85a77133572d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:59.284213 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dc06865c-8924-4fd3-8105-85a77133572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:59.296813 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49cd0c-7371-43c6-9f5e-6d6186902c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:59.298302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee49cd0c-7371-43c6-9f5e-6d6186902c3a service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:59.314916 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 883/1721] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:59.316968 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06865c-8924-4fd3-8105-85a77133572d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:59.321963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 839/1722] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:59.323463 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd2dfc-7547-4929-91f8-0b72d8769d1f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:59.323711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd2dfc-7547-4929-91f8-0b72d8769d1f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:59.323991 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd2dfc-7547-4929-91f8-0b72d8769d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:59.337786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06865c-8924-4fd3-8105-85a77133572d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:59.350914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa35e2a-6b09-4ee9-b45b-5582bf374f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:59.352428 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa35e2a-6b09-4ee9-b45b-5582bf374f77 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:59.353169 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa35e2a-6b09-4ee9-b45b-5582bf374f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:59.353807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa35e2a-6b09-4ee9-b45b-5582bf374f77 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:59.355695 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa35e2a-6b09-4ee9-b45b-5582bf374f77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:59.362191 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa35e2a-6b09-4ee9-b45b-5582bf374f77 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:59.369438 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b1fd2dfc-7547-4929-91f8-0b72d8769d1f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:05:59.370742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b1fd2dfc-7547-4929-91f8-0b72d8769d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:05:59.418806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 840/1723] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:05:59.425065 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd2dfc-7547-4929-91f8-0b72d8769d1f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:59.428146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 884/1724] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:05:59 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:59.434987 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa35e2a-6b09-4ee9-b45b-5582bf374f77 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:59.491883 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd2dfc-7547-4929-91f8-0b72d8769d1f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:59.499673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa35e2a-6b09-4ee9-b45b-5582bf374f77 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:59.516561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbb2a7-ecbf-4d37-a042-242f4a8ce827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:59.522419 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbb2a7-ecbf-4d37-a042-242f4a8ce827 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:59.526619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbb2a7-ecbf-4d37-a042-242f4a8ce827 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:59.529989 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fbb2a7-ecbf-4d37-a042-242f4a8ce827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:59.533544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff02c7b-90f8-4b26-ac5d-7f7bf984bfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:59.537996 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff02c7b-90f8-4b26-ac5d-7f7bf984bfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:59.543196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff02c7b-90f8-4b26-ac5d-7f7bf984bfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:59.549172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff02c7b-90f8-4b26-ac5d-7f7bf984bfb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:59.553284 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff02c7b-90f8-4b26-ac5d-7f7bf984bfb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:05:59.556439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff02c7b-90f8-4b26-ac5d-7f7bf984bfb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:59.572137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff02c7b-90f8-4b26-ac5d-7f7bf984bfb1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:59.584011 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbb2a7-ecbf-4d37-a042-242f4a8ce827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:59.614141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fbb2a7-ecbf-4d37-a042-242f4a8ce827 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:59.650322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 841/1725] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:05:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:05:59.655555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbb2a7-ecbf-4d37-a042-242f4a8ce827 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:59.658618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 885/1726] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:05:59.660996 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff02c7b-90f8-4b26-ac5d-7f7bf984bfb1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:59.710072 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff02c7b-90f8-4b26-ac5d-7f7bf984bfb1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:59.730662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3261e91-d9f7-46cf-991c-7c027a6665bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:59.739967 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fbb2a7-ecbf-4d37-a042-242f4a8ce827 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:59.758429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3261e91-d9f7-46cf-991c-7c027a6665bd admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:59.759679 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3261e91-d9f7-46cf-991c-7c027a6665bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:59.760171 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3261e91-d9f7-46cf-991c-7c027a6665bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:59.762523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3261e91-d9f7-46cf-991c-7c027a6665bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:59.768939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b31a5-e36b-4f78-9e81-5031d751ba4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:59.770253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b31a5-e36b-4f78-9e81-5031d751ba4d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:59.770804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b31a5-e36b-4f78-9e81-5031d751ba4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:59.771242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b31a5-e36b-4f78-9e81-5031d751ba4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:59.771982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3261e91-d9f7-46cf-991c-7c027a6665bd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:59.772434 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b31a5-e36b-4f78-9e81-5031d751ba4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:05:59.772962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b31a5-e36b-4f78-9e81-5031d751ba4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:59.775961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b31a5-e36b-4f78-9e81-5031d751ba4d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:59.811653 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 886/1727] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:05:59.813262 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3261e91-d9f7-46cf-991c-7c027a6665bd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:59.838926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 842/1728] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:05:59.840364 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b31a5-e36b-4f78-9e81-5031d751ba4d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:05:59.851155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3261e91-d9f7-46cf-991c-7c027a6665bd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:59.876204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84e5cf-f6cf-4dd8-bc69-1063c59f982b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:59.877813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84e5cf-f6cf-4dd8-bc69-1063c59f982b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:59.878267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84e5cf-f6cf-4dd8-bc69-1063c59f982b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:59.878621 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b31a5-e36b-4f78-9e81-5031d751ba4d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:05:59.878734 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84e5cf-f6cf-4dd8-bc69-1063c59f982b admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:59.880475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84e5cf-f6cf-4dd8-bc69-1063c59f982b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:05:59.884111 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84e5cf-f6cf-4dd8-bc69-1063c59f982b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:05:59.914858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15a9ce-1d26-4e2c-8f06-b56fd9e2881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:05:59.916681 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15a9ce-1d26-4e2c-8f06-b56fd9e2881e admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:05:59.917163 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15a9ce-1d26-4e2c-8f06-b56fd9e2881e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:05:59.926037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15a9ce-1d26-4e2c-8f06-b56fd9e2881e admin admin] PATH_INFO: `/v3/projects/33389b4e1b8c45df9b1de4a0728e6fe9/users/108c7f1017b4444e853aab44b9d22418/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:05:59.986628 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 887/1729] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:59 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:05:59.986628 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84e5cf-f6cf-4dd8-bc69-1063c59f982b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:00.004416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15a9ce-1d26-4e2c-8f06-b56fd9e2881e admin admin] RBAC: Authorizing `identity:create_grant(project_id=33389b4e1b8c45df9b1de4a0728e6fe9, user_id=108c7f1017b4444e853aab44b9d22418, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:00.007981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15a9ce-1d26-4e2c-8f06-b56fd9e2881e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:00.040581 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 843/1730] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:05:59 2022] PUT /identity/v3/projects/33389b4e1b8c45df9b1de4a0728e6fe9/users/108c7f1017b4444e853aab44b9d22418/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:00.041461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15a9ce-1d26-4e2c-8f06-b56fd9e2881e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:00.172302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:00.251636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84e5cf-f6cf-4dd8-bc69-1063c59f982b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:00.253689 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15a9ce-1d26-4e2c-8f06-b56fd9e2881e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:00.263517 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8ebd3-9f10-4b32-9378-083c92cecea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:00.264693 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90134ee4-9482-4a81-a6ce-ea9a30594cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:00.265218 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8ebd3-9f10-4b32-9378-083c92cecea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:00.265699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8ebd3-9f10-4b32-9378-083c92cecea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:00.266093 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90134ee4-9482-4a81-a6ce-ea9a30594cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:00.266403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8ebd3-9f10-4b32-9378-083c92cecea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:00.266949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90134ee4-9482-4a81-a6ce-ea9a30594cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:00.267424 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90134ee4-9482-4a81-a6ce-ea9a30594cb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:00.267810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8ebd3-9f10-4b32-9378-083c92cecea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:00.268617 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90134ee4-9482-4a81-a6ce-ea9a30594cb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:00.271037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90134ee4-9482-4a81-a6ce-ea9a30594cb2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:00.275216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8ebd3-9f10-4b32-9378-083c92cecea7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:00.311548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 844/1731] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:00 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:00.313060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90134ee4-9482-4a81-a6ce-ea9a30594cb2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:00.328453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90134ee4-9482-4a81-a6ce-ea9a30594cb2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:00.357269 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5e93c-9060-4125-b0f8-29701a3e0466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:00.359435 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5e93c-9060-4125-b0f8-29701a3e0466 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:00.360125 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5e93c-9060-4125-b0f8-29701a3e0466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:00.360611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5e93c-9060-4125-b0f8-29701a3e0466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:00.361692 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5e93c-9060-4125-b0f8-29701a3e0466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:00.364230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5e93c-9060-4125-b0f8-29701a3e0466 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:00.380722 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 845/1732] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:00.382369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5e93c-9060-4125-b0f8-29701a3e0466 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:00.426127 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 888/1733] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:05:59 2022] POST /identity/v3/projects => generated 367 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:00.429450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5e93c-9060-4125-b0f8-29701a3e0466 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:00.430327 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8ebd3-9f10-4b32-9378-083c92cecea7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:00.504822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:00.587007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6d8c0-4753-4639-a8e4-a650d8dac6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:00.588254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6d8c0-4753-4639-a8e4-a650d8dac6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:00.588771 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6d8c0-4753-4639-a8e4-a650d8dac6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:00.589251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6d8c0-4753-4639-a8e4-a650d8dac6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:00.590289 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6d8c0-4753-4639-a8e4-a650d8dac6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:00.592767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb6d8c0-4753-4639-a8e4-a650d8dac6b6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:00.612763 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 846/1734] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:00.614211 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6d8c0-4753-4639-a8e4-a650d8dac6b6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:00.628527 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb6d8c0-4753-4639-a8e4-a650d8dac6b6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:00.636264 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7a1a0-5638-4d36-ba54-3c3c0f647c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:00.638122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7a1a0-5638-4d36-ba54-3c3c0f647c85 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:00.638682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7a1a0-5638-4d36-ba54-3c3c0f647c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:00.639263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7a1a0-5638-4d36-ba54-3c3c0f647c85 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:00.640238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7a1a0-5638-4d36-ba54-3c3c0f647c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:00.643234 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7a1a0-5638-4d36-ba54-3c3c0f647c85 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:00.690757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 847/1735] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:00 2022] POST /identity/v3/users => generated 284 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:00.694585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7a1a0-5638-4d36-ba54-3c3c0f647c85 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:00.724024 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7a1a0-5638-4d36-ba54-3c3c0f647c85 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:00.745171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627054bd-5cea-465b-a95f-653cc94332f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:00.746011 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627054bd-5cea-465b-a95f-653cc94332f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:00.746399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627054bd-5cea-465b-a95f-653cc94332f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:00.746736 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627054bd-5cea-465b-a95f-653cc94332f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:00.747610 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627054bd-5cea-465b-a95f-653cc94332f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:00.749377 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627054bd-5cea-465b-a95f-653cc94332f0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:00.791825 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 848/1736] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:00.792939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627054bd-5cea-465b-a95f-653cc94332f0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:00.805027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8ebd3-9f10-4b32-9378-083c92cecea7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:00.829866 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627054bd-5cea-465b-a95f-653cc94332f0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:00.840117 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15875a-a66e-4926-9441-0585827c111a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:00.841550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15875a-a66e-4926-9441-0585827c111a admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:00.842046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15875a-a66e-4926-9441-0585827c111a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:00.842546 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15875a-a66e-4926-9441-0585827c111a admin admin] PATH_INFO: `/v3/projects/33389b4e1b8c45df9b1de4a0728e6fe9/users/108c7f1017b4444e853aab44b9d22418/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:00.843960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c61bd-9c95-4cc8-82c0-71052ea521ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:00.844811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c61bd-9c95-4cc8-82c0-71052ea521ed admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:00.845150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c61bd-9c95-4cc8-82c0-71052ea521ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:00.845420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c61bd-9c95-4cc8-82c0-71052ea521ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:00.846382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c61bd-9c95-4cc8-82c0-71052ea521ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:00.853109 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c61bd-9c95-4cc8-82c0-71052ea521ed admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:00.871456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15875a-a66e-4926-9441-0585827c111a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33389b4e1b8c45df9b1de4a0728e6fe9, user_id=108c7f1017b4444e853aab44b9d22418, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:00.883521 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 849/1737] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:00.884661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c61bd-9c95-4cc8-82c0-71052ea521ed admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:00.896932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15875a-a66e-4926-9441-0585827c111a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:00.903064 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c61bd-9c95-4cc8-82c0-71052ea521ed admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:00.917007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b105e97-faeb-4520-b803-347e5fb00e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:00.918049 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b105e97-faeb-4520-b803-347e5fb00e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:00.918332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b105e97-faeb-4520-b803-347e5fb00e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:00.918765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b105e97-faeb-4520-b803-347e5fb00e94 admin admin] PATH_INFO: `/v3/projects/6c9170a5dfd949a6a39b5d5157943dc5/users/cc1bd57972eb4f02992fe02dcabe2b90/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:00.959934 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b105e97-faeb-4520-b803-347e5fb00e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9170a5dfd949a6a39b5d5157943dc5, user_id=cc1bd57972eb4f02992fe02dcabe2b90, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:00.962746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b105e97-faeb-4520-b803-347e5fb00e94 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:00.971191 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 889/1738] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:00 2022] PUT /identity/v3/projects/33389b4e1b8c45df9b1de4a0728e6fe9/users/108c7f1017b4444e853aab44b9d22418/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:00.973986 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15875a-a66e-4926-9441-0585827c111a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:01.013011 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 850/1739] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:00 2022] PUT /identity/v3/projects/6c9170a5dfd949a6a39b5d5157943dc5/users/cc1bd57972eb4f02992fe02dcabe2b90/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:01.015158 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3876f26-c40e-4c23-ae44-d2daddbe7bd7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:01.015453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3876f26-c40e-4c23-ae44-d2daddbe7bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:01.015734 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3876f26-c40e-4c23-ae44-d2daddbe7bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:01.083948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b3876f26-c40e-4c23-ae44-d2daddbe7bd7 None None] MFA Rules not processed for user `108c7f1017b4444e853aab44b9d22418`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:01.085502 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b3876f26-c40e-4c23-ae44-d2daddbe7bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:01.205291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15875a-a66e-4926-9441-0585827c111a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:01.289135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 851/1740] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:01.298029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604185e5-08d3-42d8-b107-0a11627ff90e None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:01.300151 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604185e5-08d3-42d8-b107-0a11627ff90e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:01.302142 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604185e5-08d3-42d8-b107-0a11627ff90e None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:01.311266 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 852/1741] 10.222.0.64 () {54 vars in 961 bytes} [Thu Jul 21 16:06:01 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:06:01.313062 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40adcd1-a89c-478a-bfd1-8ebaea435343 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:01.313355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40adcd1-a89c-478a-bfd1-8ebaea435343 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:01.313633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40adcd1-a89c-478a-bfd1-8ebaea435343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:01.374898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e40adcd1-a89c-478a-bfd1-8ebaea435343 None None] MFA Rules not processed for user `cc1bd57972eb4f02992fe02dcabe2b90`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:01.376205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e40adcd1-a89c-478a-bfd1-8ebaea435343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:01.376710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762685a-dd6a-4856-b2fd-a49585e19d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:01.377575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762685a-dd6a-4856-b2fd-a49585e19d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:01.377814 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762685a-dd6a-4856-b2fd-a49585e19d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:01.382399 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762685a-dd6a-4856-b2fd-a49585e19d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:01.383530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762685a-dd6a-4856-b2fd-a49585e19d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:01.387611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4762685a-dd6a-4856-b2fd-a49585e19d3f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:01.421338 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 890/1742] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 447 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:01.421681 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762685a-dd6a-4856-b2fd-a49585e19d3f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:01.431297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4762685a-dd6a-4856-b2fd-a49585e19d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:01.460649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:01.487428 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:01.584010 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 853/1743] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:01.585538 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee780a-53ee-45e6-b20e-c6b4d59bb1f4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:01.585832 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee780a-53ee-45e6-b20e-c6b4d59bb1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:01.586110 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee780a-53ee-45e6-b20e-c6b4d59bb1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:01.613610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762685a-dd6a-4856-b2fd-a49585e19d3f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:01.642648 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d0958-39ea-4ff0-a98b-d0c9624feeef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:01.646022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d0958-39ea-4ff0-a98b-d0c9624feeef service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:01.646980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d0958-39ea-4ff0-a98b-d0c9624feeef service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:01.647624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d0958-39ea-4ff0-a98b-d0c9624feeef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:01.654609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7bee780a-53ee-45e6-b20e-c6b4d59bb1f4 None None] MFA Rules not processed for user `1f4a46a051c241a2a47059052735c930`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:01.657348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7bee780a-53ee-45e6-b20e-c6b4d59bb1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:01.673176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d0958-39ea-4ff0-a98b-d0c9624feeef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:01.677396 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d0958-39ea-4ff0-a98b-d0c9624feeef service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:01.728431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 891/1744] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:01.742848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d0958-39ea-4ff0-a98b-d0c9624feeef service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:01.828927 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d0958-39ea-4ff0-a98b-d0c9624feeef service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:01.857292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 854/1745] 10.222.0.64 () {58 vars in 1058 bytes} [Thu Jul 21 16:06:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:01.859007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee780a-53ee-45e6-b20e-c6b4d59bb1f4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:01.875058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a07dfd-2b81-427b-8743-0e1ffabe3bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:01.883720 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a07dfd-2b81-427b-8743-0e1ffabe3bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:01.883720 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a07dfd-2b81-427b-8743-0e1ffabe3bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:01.883720 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a07dfd-2b81-427b-8743-0e1ffabe3bc6 admin admin] PATH_INFO: `/v3/projects/93143567e0994d3a96dad4850123b5ab/users/a26429e4007b42ab803ed54eb7af9c79/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:01.885405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee780a-53ee-45e6-b20e-c6b4d59bb1f4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:01.912739 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5441c23-e6a8-4790-aefb-c15d6e42163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:01.913728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5441c23-e6a8-4790-aefb-c15d6e42163c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:01.914082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5441c23-e6a8-4790-aefb-c15d6e42163c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:01.914430 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5441c23-e6a8-4790-aefb-c15d6e42163c admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:01.919448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5441c23-e6a8-4790-aefb-c15d6e42163c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:01.927675 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5441c23-e6a8-4790-aefb-c15d6e42163c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:01.967565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a07dfd-2b81-427b-8743-0e1ffabe3bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93143567e0994d3a96dad4850123b5ab, user_id=a26429e4007b42ab803ed54eb7af9c79, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:01.984058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a07dfd-2b81-427b-8743-0e1ffabe3bc6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:01.995203 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 855/1746] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:01 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:01.998305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5441c23-e6a8-4790-aefb-c15d6e42163c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:02.060578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 892/1747] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:01 2022] PUT /identity/v3/projects/93143567e0994d3a96dad4850123b5ab/users/a26429e4007b42ab803ed54eb7af9c79/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:02.076236 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a07dfd-2b81-427b-8743-0e1ffabe3bc6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:02.203603 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5441c23-e6a8-4790-aefb-c15d6e42163c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:02.311174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:02.339307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a07dfd-2b81-427b-8743-0e1ffabe3bc6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:02.345354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb765c1-caf6-4061-8681-403577579557 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:02.346531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683fb14-5d8d-45ac-95b6-6523aeb19aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:02.346677 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb765c1-caf6-4061-8681-403577579557 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:02.346677 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb765c1-caf6-4061-8681-403577579557 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:02.347045 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683fb14-5d8d-45ac-95b6-6523aeb19aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:02.347124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb765c1-caf6-4061-8681-403577579557 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:02.347190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683fb14-5d8d-45ac-95b6-6523aeb19aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:02.347190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683fb14-5d8d-45ac-95b6-6523aeb19aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:02.347948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683fb14-5d8d-45ac-95b6-6523aeb19aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:02.349488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ceb765c1-caf6-4061-8681-403577579557 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:02.350718 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683fb14-5d8d-45ac-95b6-6523aeb19aa1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:02.368701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb765c1-caf6-4061-8681-403577579557 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:02.372555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb765c1-caf6-4061-8681-403577579557 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:02.393159 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 856/1748] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:02.394919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb765c1-caf6-4061-8681-403577579557 service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:02.396223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 893/1749] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:02 2022] POST /identity/v3/users => generated 289 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:02.404938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb4b35-fb76-4708-a66c-5ad676e573ca None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:02.405309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb4b35-fb76-4708-a66c-5ad676e573ca None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:02.405503 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb4b35-fb76-4708-a66c-5ad676e573ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:02.471753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-efeb4b35-fb76-4708-a66c-5ad676e573ca None None] MFA Rules not processed for user `a26429e4007b42ab803ed54eb7af9c79`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:02.473684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-efeb4b35-fb76-4708-a66c-5ad676e573ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:02.518180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb765c1-caf6-4061-8681-403577579557 service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:02.526734 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586ecf1-8648-4d19-bb44-877a3413b47c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:02.527881 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586ecf1-8648-4d19-bb44-877a3413b47c service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:02.528238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586ecf1-8648-4d19-bb44-877a3413b47c service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:02.528617 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9586ecf1-8648-4d19-bb44-877a3413b47c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:02.535307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9586ecf1-8648-4d19-bb44-877a3413b47c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:02.681273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 894/1750] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:02.684586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ea927-a3bc-45e5-adfa-342cb09ae882 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:02.684943 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ea927-a3bc-45e5-adfa-342cb09ae882 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:02.685296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ea927-a3bc-45e5-adfa-342cb09ae882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:02.723796 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586ecf1-8648-4d19-bb44-877a3413b47c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:02.728968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9586ecf1-8648-4d19-bb44-877a3413b47c service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:02.745706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:02.775163 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 857/1751] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:02.775422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c62ea927-a3bc-45e5-adfa-342cb09ae882 None None] MFA Rules not processed for user `cea62586ba2e4a03af70dac52acb4c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:02.777861 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c62ea927-a3bc-45e5-adfa-342cb09ae882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:02.778252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586ecf1-8648-4d19-bb44-877a3413b47c service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:02.804205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9586ecf1-8648-4d19-bb44-877a3413b47c service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:02.819472 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b836403-3249-4155-80f0-1287b77c16dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:02.820258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b836403-3249-4155-80f0-1287b77c16dc admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:02.820535 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b836403-3249-4155-80f0-1287b77c16dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:02.822256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b836403-3249-4155-80f0-1287b77c16dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:02.823891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b836403-3249-4155-80f0-1287b77c16dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:02.828573 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b836403-3249-4155-80f0-1287b77c16dc admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:02.855292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 858/1752] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:02.857769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881d2fe-fd50-47ec-b939-06a7f10131d8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:02.858626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881d2fe-fd50-47ec-b939-06a7f10131d8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:02.860847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881d2fe-fd50-47ec-b939-06a7f10131d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:02.954550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a881d2fe-fd50-47ec-b939-06a7f10131d8 None None] MFA Rules not processed for user `35f595da10d34af4b1eeb5a3ec4a69b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:02.958150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a881d2fe-fd50-47ec-b939-06a7f10131d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:02.961391 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 895/1753] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:02.962471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ea927-a3bc-45e5-adfa-342cb09ae882 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:03.007362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ea927-a3bc-45e5-adfa-342cb09ae882 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:03.018596 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a51913-05b3-4c4d-a2ac-2ff08787258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:03.019063 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a51913-05b3-4c4d-a2ac-2ff08787258e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:03.019373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a51913-05b3-4c4d-a2ac-2ff08787258e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:03.020800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a51913-05b3-4c4d-a2ac-2ff08787258e admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:03.021584 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a51913-05b3-4c4d-a2ac-2ff08787258e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:03.027358 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a51913-05b3-4c4d-a2ac-2ff08787258e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:03.094179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 896/1754] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:02 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:03.095129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a51913-05b3-4c4d-a2ac-2ff08787258e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:03.304020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 859/1755] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:03.309981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881d2fe-fd50-47ec-b939-06a7f10131d8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:03.317372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a881d2fe-fd50-47ec-b939-06a7f10131d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:03.327922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a51913-05b3-4c4d-a2ac-2ff08787258e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:03.341210 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aafbb1-3597-4bad-8eda-306be3cf5eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:03.344376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aafbb1-3597-4bad-8eda-306be3cf5eae admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:03.344931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aafbb1-3597-4bad-8eda-306be3cf5eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:03.346671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aafbb1-3597-4bad-8eda-306be3cf5eae admin admin] PATH_INFO: `/v3/projects/ba815fefa2b94e87bf6fc58170f42b66/users/9fb801f94cc8459eaa58921a0d44eb3a/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:03.378655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881d2fe-fd50-47ec-b939-06a7f10131d8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:03.386058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aafbb1-3597-4bad-8eda-306be3cf5eae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba815fefa2b94e87bf6fc58170f42b66, user_id=9fb801f94cc8459eaa58921a0d44eb3a, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:03.389839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aafbb1-3597-4bad-8eda-306be3cf5eae admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:03.398108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2c437-b56d-4b82-8298-11cf529e6edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:03.399408 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2c437-b56d-4b82-8298-11cf529e6edd admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:03.400027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2c437-b56d-4b82-8298-11cf529e6edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:03.400607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2c437-b56d-4b82-8298-11cf529e6edd admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:03.404417 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2c437-b56d-4b82-8298-11cf529e6edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:03.410511 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2c437-b56d-4b82-8298-11cf529e6edd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:03.436894 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:03.442673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 897/1756] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:03 2022] PUT /identity/v3/projects/ba815fefa2b94e87bf6fc58170f42b66/users/9fb801f94cc8459eaa58921a0d44eb3a/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:03.443176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aafbb1-3597-4bad-8eda-306be3cf5eae admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:03.493800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 860/1757] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:03 2022] POST /identity/v3/projects => generated 405 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:03.512380 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fd160-1c2e-4f45-b880-b561a8425e0a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:03.515013 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fd160-1c2e-4f45-b880-b561a8425e0a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:03.515736 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fd160-1c2e-4f45-b880-b561a8425e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:03.568273 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2a7fd160-1c2e-4f45-b880-b561a8425e0a None None] MFA Rules not processed for user `35f595da10d34af4b1eeb5a3ec4a69b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:03.571505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2a7fd160-1c2e-4f45-b880-b561a8425e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:03.614442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aafbb1-3597-4bad-8eda-306be3cf5eae admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:03.629290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:03.797430 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 861/1758] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:03.798438 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fd160-1c2e-4f45-b880-b561a8425e0a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:03.819797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392555c2-e112-4585-9766-42af435e715a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:03.820472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392555c2-e112-4585-9766-42af435e715a admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:03.820871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392555c2-e112-4585-9766-42af435e715a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:03.821240 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392555c2-e112-4585-9766-42af435e715a admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:03.821963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392555c2-e112-4585-9766-42af435e715a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:03.828713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392555c2-e112-4585-9766-42af435e715a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:03.887603 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 898/1759] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:03 2022] POST /identity/v3/users => generated 291 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:03.888756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392555c2-e112-4585-9766-42af435e715a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:03.917791 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392555c2-e112-4585-9766-42af435e715a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:03.931391 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0912a0-fde0-416e-bd94-194c47c5c93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:03.934652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0912a0-fde0-416e-bd94-194c47c5c93d admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:03.936861 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0912a0-fde0-416e-bd94-194c47c5c93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:03.936861 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0912a0-fde0-416e-bd94-194c47c5c93d admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:03.937561 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0912a0-fde0-416e-bd94-194c47c5c93d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:03.946395 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0912a0-fde0-416e-bd94-194c47c5c93d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:03.947534 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fd160-1c2e-4f45-b880-b561a8425e0a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:03.958018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb1d15-c5de-478a-9d81-22b3655ff88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:03.958734 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb1d15-c5de-478a-9d81-22b3655ff88c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:03.962949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb1d15-c5de-478a-9d81-22b3655ff88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:03.964360 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fb1d15-c5de-478a-9d81-22b3655ff88c admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:03.974502 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb1d15-c5de-478a-9d81-22b3655ff88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:03.982230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fb1d15-c5de-478a-9d81-22b3655ff88c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:04.008800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 899/1760] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:03 2022] POST /identity/v3/users => generated 309 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:04.011441 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0912a0-fde0-416e-bd94-194c47c5c93d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:04.017732 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 862/1761] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:03 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:04.019224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb1d15-c5de-478a-9d81-22b3655ff88c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:04.022018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fb0912a0-fde0-416e-bd94-194c47c5c93d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:04.046785 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fb1d15-c5de-478a-9d81-22b3655ff88c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:04.062185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f9b16-6229-41ad-b0dd-4e046ff14b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:04.064681 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f9b16-6229-41ad-b0dd-4e046ff14b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:04.064972 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f9b16-6229-41ad-b0dd-4e046ff14b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:04.065242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f9b16-6229-41ad-b0dd-4e046ff14b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:04.070795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f9b16-6229-41ad-b0dd-4e046ff14b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:04.075128 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5f9b16-6229-41ad-b0dd-4e046ff14b11 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:04.102865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 863/1762] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:04.112261 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f9b16-6229-41ad-b0dd-4e046ff14b11 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:04.148884 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f9b16-6229-41ad-b0dd-4e046ff14b11 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:04.185404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042266e-1c70-4033-957f-7bce797aeb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:04.187006 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042266e-1c70-4033-957f-7bce797aeb24 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:04.187735 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042266e-1c70-4033-957f-7bce797aeb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:04.188896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042266e-1c70-4033-957f-7bce797aeb24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:04.190542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042266e-1c70-4033-957f-7bce797aeb24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:04.196490 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042266e-1c70-4033-957f-7bce797aeb24 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:04.270770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0912a0-fde0-416e-bd94-194c47c5c93d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:04.276411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 864/1763] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:04 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:04.276411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042266e-1c70-4033-957f-7bce797aeb24 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:04.286528 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c46aee-de9a-4e7e-8653-652f4580ad4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:04.287264 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c46aee-de9a-4e7e-8653-652f4580ad4d service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:04.287554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c46aee-de9a-4e7e-8653-652f4580ad4d service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:04.287834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c46aee-de9a-4e7e-8653-652f4580ad4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:04.308770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c46aee-de9a-4e7e-8653-652f4580ad4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:04.310558 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c46aee-de9a-4e7e-8653-652f4580ad4d service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:04.329816 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042266e-1c70-4033-957f-7bce797aeb24 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:04.331466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 900/1764] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:04.332396 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c46aee-de9a-4e7e-8653-652f4580ad4d service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:04.356417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c46aee-de9a-4e7e-8653-652f4580ad4d service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:04.373626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ff5f0-d898-49c2-ba93-80f82c99a8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:04.374579 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ff5f0-d898-49c2-ba93-80f82c99a8f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:04.374895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ff5f0-d898-49c2-ba93-80f82c99a8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:04.375182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ff5f0-d898-49c2-ba93-80f82c99a8f8 admin admin] PATH_INFO: `/v3/projects/693488e6281e4ad1b742cdf39302adb3/users/5da8425099634dcdbe0104b23ed57c06/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:04.380018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f6331-36af-481c-a283-cbe75eb61123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:04.381708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f6331-36af-481c-a283-cbe75eb61123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:04.382302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f6331-36af-481c-a283-cbe75eb61123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:04.382948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f6331-36af-481c-a283-cbe75eb61123 admin admin] PATH_INFO: `/v3/projects/ba815fefa2b94e87bf6fc58170f42b66/users/9fb801f94cc8459eaa58921a0d44eb3a/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:04.393580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f6331-36af-481c-a283-cbe75eb61123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba815fefa2b94e87bf6fc58170f42b66, user_id=9fb801f94cc8459eaa58921a0d44eb3a, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:04.400620 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f6331-36af-481c-a283-cbe75eb61123 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:04.407856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ff5f0-d898-49c2-ba93-80f82c99a8f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=693488e6281e4ad1b742cdf39302adb3, user_id=5da8425099634dcdbe0104b23ed57c06, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:04.419199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7ff5f0-d898-49c2-ba93-80f82c99a8f8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:04.453420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 865/1765] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:04 2022] PUT /identity/v3/projects/ba815fefa2b94e87bf6fc58170f42b66/users/9fb801f94cc8459eaa58921a0d44eb3a/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:04.455161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f6331-36af-481c-a283-cbe75eb61123 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:04.466760 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 901/1766] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:04 2022] PUT /identity/v3/projects/693488e6281e4ad1b742cdf39302adb3/users/5da8425099634dcdbe0104b23ed57c06/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:04.468428 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c988619-fc5f-4954-995a-faea3bde90f7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:04.468866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c988619-fc5f-4954-995a-faea3bde90f7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:04.469028 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c988619-fc5f-4954-995a-faea3bde90f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:04.554956 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7c988619-fc5f-4954-995a-faea3bde90f7 None None] MFA Rules not processed for user `a0717341e70e4476a3e5391533e467ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:04.556996 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7c988619-fc5f-4954-995a-faea3bde90f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:04.671288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:04.702993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:04.750831 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f6331-36af-481c-a283-cbe75eb61123 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:04.780824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 902/1767] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:04.786677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef0908-5249-4d10-a4da-7f5dc48017a2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:04.787292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef0908-5249-4d10-a4da-7f5dc48017a2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:04.787593 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef0908-5249-4d10-a4da-7f5dc48017a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:04.873296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7aef0908-5249-4d10-a4da-7f5dc48017a2 None None] MFA Rules not processed for user `9fb801f94cc8459eaa58921a0d44eb3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:04.875971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7aef0908-5249-4d10-a4da-7f5dc48017a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:05.101951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 903/1768] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:05.104003 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef0908-5249-4d10-a4da-7f5dc48017a2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:05.197041 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fd6b5-71c3-497f-a41c-7e0834bd43eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:05.199318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fd6b5-71c3-497f-a41c-7e0834bd43eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:05.206057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fd6b5-71c3-497f-a41c-7e0834bd43eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:05.206867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3fd6b5-71c3-497f-a41c-7e0834bd43eb admin admin] PATH_INFO: `/v3/projects/ad00cea7270a4440b4785c4ff7f4d86a/users/741c771e26b0424abc25b908dc5aa696/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:05.300055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef0908-5249-4d10-a4da-7f5dc48017a2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:05.321474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fd6b5-71c3-497f-a41c-7e0834bd43eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad00cea7270a4440b4785c4ff7f4d86a, user_id=741c771e26b0424abc25b908dc5aa696, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:05.321965 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089983e-1941-4eb4-b416-0c4c842e20b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:05.326906 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089983e-1941-4eb4-b416-0c4c842e20b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:05.327250 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089983e-1941-4eb4-b416-0c4c842e20b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:05.327516 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089983e-1941-4eb4-b416-0c4c842e20b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:05.334931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089983e-1941-4eb4-b416-0c4c842e20b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:05.336991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089983e-1941-4eb4-b416-0c4c842e20b8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:05.343107 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3fd6b5-71c3-497f-a41c-7e0834bd43eb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:05.381774 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 904/1769] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:05.381987 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1d0f5-da8b-455e-9071-369367208bc2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:05.382212 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1d0f5-da8b-455e-9071-369367208bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:05.382683 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1d0f5-da8b-455e-9071-369367208bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:05.411652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 866/1770] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:04 2022] PUT /identity/v3/projects/ad00cea7270a4440b4785c4ff7f4d86a/users/741c771e26b0424abc25b908dc5aa696/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 957 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:05.413468 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fd6b5-71c3-497f-a41c-7e0834bd43eb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:05.449002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-58a1d0f5-da8b-455e-9071-369367208bc2 None None] MFA Rules not processed for user `a0717341e70e4476a3e5391533e467ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:05.450287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-58a1d0f5-da8b-455e-9071-369367208bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:05.594896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:05.616002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3fd6b5-71c3-497f-a41c-7e0834bd43eb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:05.624752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 905/1771] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:05.627442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1d0f5-da8b-455e-9071-369367208bc2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:05.632811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e13fa7-07aa-490a-92e9-332c6a1ff9db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:05.633650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e13fa7-07aa-490a-92e9-332c6a1ff9db service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:05.633935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e13fa7-07aa-490a-92e9-332c6a1ff9db service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:05.634219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e13fa7-07aa-490a-92e9-332c6a1ff9db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:05.839386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e13fa7-07aa-490a-92e9-332c6a1ff9db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:05.841154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e13fa7-07aa-490a-92e9-332c6a1ff9db service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:05.860061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 867/1772] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:05.861255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e13fa7-07aa-490a-92e9-332c6a1ff9db service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:05.922285 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1d0f5-da8b-455e-9071-369367208bc2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:05.978447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023221e-2fce-426d-bef4-68098556806e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:05.979514 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023221e-2fce-426d-bef4-68098556806e admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:05.979831 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023221e-2fce-426d-bef4-68098556806e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:05.980549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023221e-2fce-426d-bef4-68098556806e admin admin] PATH_INFO: `/v3/projects/693488e6281e4ad1b742cdf39302adb3/users/5da8425099634dcdbe0104b23ed57c06/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:05.985879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023221e-2fce-426d-bef4-68098556806e admin admin] RBAC: Authorizing `identity:create_grant(project_id=693488e6281e4ad1b742cdf39302adb3, user_id=5da8425099634dcdbe0104b23ed57c06, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:05.996533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023221e-2fce-426d-bef4-68098556806e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:06.030016 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:06.053724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 906/1773] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:05 2022] PUT /identity/v3/projects/693488e6281e4ad1b742cdf39302adb3/users/5da8425099634dcdbe0104b23ed57c06/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:06.054686 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023221e-2fce-426d-bef4-68098556806e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:06.067709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f023221e-2fce-426d-bef4-68098556806e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:06.169686 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e13fa7-07aa-490a-92e9-332c6a1ff9db service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:06.338422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023221e-2fce-426d-bef4-68098556806e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:06.346765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffd4d6-5ae3-4f25-98a4-6e820d18d83f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:06.347868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffd4d6-5ae3-4f25-98a4-6e820d18d83f service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:06.348161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffd4d6-5ae3-4f25-98a4-6e820d18d83f service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:06.348446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffd4d6-5ae3-4f25-98a4-6e820d18d83f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:06.403853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8a009-2e2e-49c5-83ea-ecb83fe0a574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:06.405257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8a009-2e2e-49c5-83ea-ecb83fe0a574 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:06.409686 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8a009-2e2e-49c5-83ea-ecb83fe0a574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:06.414096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8a009-2e2e-49c5-83ea-ecb83fe0a574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:06.415136 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8a009-2e2e-49c5-83ea-ecb83fe0a574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:06.416959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8a009-2e2e-49c5-83ea-ecb83fe0a574 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:06.472500 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 868/1774] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:05 2022] GET /identity/v3/roles => generated 1420 bytes in 612 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:06.484239 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4000b-9588-43c2-9b61-c2334ba5c659 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:06.492467 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4000b-9588-43c2-9b61-c2334ba5c659 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:06.493085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4000b-9588-43c2-9b61-c2334ba5c659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:06.540946 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffd4d6-5ae3-4f25-98a4-6e820d18d83f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:06.545270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffd4d6-5ae3-4f25-98a4-6e820d18d83f service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:06.566678 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 907/1775] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:06.568349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffd4d6-5ae3-4f25-98a4-6e820d18d83f service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:06.607190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-77a4000b-9588-43c2-9b61-c2334ba5c659 None None] MFA Rules not processed for user `5da8425099634dcdbe0104b23ed57c06`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:06.611103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-77a4000b-9588-43c2-9b61-c2334ba5c659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:06.659999 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:06.757012 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffd4d6-5ae3-4f25-98a4-6e820d18d83f service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:06.768643 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568e6ac-1c46-46bb-84b6-0d9110b28247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:06.769336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568e6ac-1c46-46bb-84b6-0d9110b28247 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:06.769618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568e6ac-1c46-46bb-84b6-0d9110b28247 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:06.769892 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568e6ac-1c46-46bb-84b6-0d9110b28247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:06.918166 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 869/1776] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:06 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:06.923179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4000b-9588-43c2-9b61-c2334ba5c659 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:06.938606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568e6ac-1c46-46bb-84b6-0d9110b28247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:06.945678 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568e6ac-1c46-46bb-84b6-0d9110b28247 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:06.974273 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4000b-9588-43c2-9b61-c2334ba5c659 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:07.004997 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7675b89-4f43-47d8-bf04-e1f3f27e6ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:07.010506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 908/1777] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:07.013150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7675b89-4f43-47d8-bf04-e1f3f27e6ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:07.013445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7675b89-4f43-47d8-bf04-e1f3f27e6ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:07.017286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eae73-68fc-4ffa-9ef7-e3729064e114 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:07.017587 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eae73-68fc-4ffa-9ef7-e3729064e114 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:07.017875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eae73-68fc-4ffa-9ef7-e3729064e114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:07.020619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7675b89-4f43-47d8-bf04-e1f3f27e6ee1 admin admin] PATH_INFO: `/v3/projects/ad00cea7270a4440b4785c4ff7f4d86a/users/741c771e26b0424abc25b908dc5aa696/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:07.026614 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7675b89-4f43-47d8-bf04-e1f3f27e6ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad00cea7270a4440b4785c4ff7f4d86a, user_id=741c771e26b0424abc25b908dc5aa696, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:07.044007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7675b89-4f43-47d8-bf04-e1f3f27e6ee1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:07.094951 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 870/1778] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:06 2022] PUT /identity/v3/projects/ad00cea7270a4440b4785c4ff7f4d86a/users/741c771e26b0424abc25b908dc5aa696/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:07.252324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-862eae73-68fc-4ffa-9ef7-e3729064e114 None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:07.263093 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-862eae73-68fc-4ffa-9ef7-e3729064e114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:07.461742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7675b89-4f43-47d8-bf04-e1f3f27e6ee1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:07.639217 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 909/1779] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 16:06:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 628 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:07.718386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:07.731740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7675b89-4f43-47d8-bf04-e1f3f27e6ee1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:07.759705 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938da4d-00dc-45ad-90c8-ddff013b4665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:07.760522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938da4d-00dc-45ad-90c8-ddff013b4665 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:07.761293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938da4d-00dc-45ad-90c8-ddff013b4665 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:07.761758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938da4d-00dc-45ad-90c8-ddff013b4665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:07.834881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99f398-06d1-4ada-ab85-dc9387f46bbb None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:07.835424 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99f398-06d1-4ada-ab85-dc9387f46bbb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:07.835913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99f398-06d1-4ada-ab85-dc9387f46bbb None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:07.852666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 910/1780] 10.222.0.64 () {54 vars in 912 bytes} [Thu Jul 21 16:06:07 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:06:07.868515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7b5fb-00b3-45bf-b978-638d1552dd8e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:07.887848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7b5fb-00b3-45bf-b978-638d1552dd8e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:07.890748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7b5fb-00b3-45bf-b978-638d1552dd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:07.985431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5ae7b5fb-00b3-45bf-b978-638d1552dd8e None None] MFA Rules not processed for user `1b46a82ffe92437fb8205bd186a8b05e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:07.990021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5ae7b5fb-00b3-45bf-b978-638d1552dd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:08.026160 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938da4d-00dc-45ad-90c8-ddff013b4665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:08.029025 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938da4d-00dc-45ad-90c8-ddff013b4665 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:08.099846 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 871/1781] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:07 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 640 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:06:08.103234 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cf14b-8bc3-43fc-9d8a-bbc8633cc139 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:08.103461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cf14b-8bc3-43fc-9d8a-bbc8633cc139 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:08.103801 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cf14b-8bc3-43fc-9d8a-bbc8633cc139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:08.155549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 911/1782] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 16:06:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:08.157662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7b5fb-00b3-45bf-b978-638d1552dd8e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:08.159486 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5ae7b5fb-00b3-45bf-b978-638d1552dd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:08.169932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:08.198246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-899cf14b-8bc3-43fc-9d8a-bbc8633cc139 None None] MFA Rules not processed for user `35f595da10d34af4b1eeb5a3ec4a69b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:08.200400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-899cf14b-8bc3-43fc-9d8a-bbc8633cc139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:08.374937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 872/1783] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:08.383668 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cf14b-8bc3-43fc-9d8a-bbc8633cc139 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:08.400110 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cf14b-8bc3-43fc-9d8a-bbc8633cc139 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:08.417724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e4ee5-050d-428d-b2e0-78d707677248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:08.419919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e4ee5-050d-428d-b2e0-78d707677248 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:08.421557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e4ee5-050d-428d-b2e0-78d707677248 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:08.427097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e4ee5-050d-428d-b2e0-78d707677248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:08.449030 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7b5fb-00b3-45bf-b978-638d1552dd8e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:08.474537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77d3b9-2686-4661-8d6f-a121e3880e18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:08.482187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77d3b9-2686-4661-8d6f-a121e3880e18 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:08.482618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77d3b9-2686-4661-8d6f-a121e3880e18 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:08.485339 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77d3b9-2686-4661-8d6f-a121e3880e18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:08.487699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e4ee5-050d-428d-b2e0-78d707677248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:08.491460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e4ee5-050d-428d-b2e0-78d707677248 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:08.521163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77d3b9-2686-4661-8d6f-a121e3880e18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:08.525903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 873/1784] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:08.526790 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e4ee5-050d-428d-b2e0-78d707677248 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:08.528041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77d3b9-2686-4661-8d6f-a121e3880e18 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:08.547850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0b5e4ee5-050d-428d-b2e0-78d707677248 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:08.565649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 912/1785] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:06:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 16:06:08.576666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e4ee5-050d-428d-b2e0-78d707677248 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:08.581378 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b598b4f-71a3-4b50-baca-0ad41ab14bce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:08.582270 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598b4f-71a3-4b50-baca-0ad41ab14bce service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:08.582689 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598b4f-71a3-4b50-baca-0ad41ab14bce service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:08.583161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b598b4f-71a3-4b50-baca-0ad41ab14bce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:08.735136 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b598b4f-71a3-4b50-baca-0ad41ab14bce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:08.737448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b598b4f-71a3-4b50-baca-0ad41ab14bce service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:08.773341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 874/1786] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:08.993547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf758b1c-e8f3-4a33-b99a-c09e36981ad1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:08.994102 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf758b1c-e8f3-4a33-b99a-c09e36981ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:08.994102 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf758b1c-e8f3-4a33-b99a-c09e36981ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:09.041527 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-cf758b1c-e8f3-4a33-b99a-c09e36981ad1 None None] MFA Rules not processed for user `1b46a82ffe92437fb8205bd186a8b05e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:09.042840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cf758b1c-e8f3-4a33-b99a-c09e36981ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:09.061584 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 913/1787] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Jul 21 16:06:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:09.091873 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b598b4f-71a3-4b50-baca-0ad41ab14bce service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:09.106294 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6b598b4f-71a3-4b50-baca-0ad41ab14bce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:09.129883 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b598b4f-71a3-4b50-baca-0ad41ab14bce service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:09.135986 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a74ff-dec8-445d-9887-93db728c9ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:09.137431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a74ff-dec8-445d-9887-93db728c9ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:09.137734 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a74ff-dec8-445d-9887-93db728c9ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:09.138081 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a74ff-dec8-445d-9887-93db728c9ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:09.150845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a74ff-dec8-445d-9887-93db728c9ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:09.157029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a74ff-dec8-445d-9887-93db728c9ec7 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:09.190580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 875/1788] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:13.004764 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff231f98-11b2-437d-9558-5f15b79d4978 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:13.006316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff231f98-11b2-437d-9558-5f15b79d4978 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:13.006978 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff231f98-11b2-437d-9558-5f15b79d4978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:13.094665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ff231f98-11b2-437d-9558-5f15b79d4978 None None] MFA Rules not processed for user `741c771e26b0424abc25b908dc5aa696`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:13.101198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ff231f98-11b2-437d-9558-5f15b79d4978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:13.308285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a74ff-dec8-445d-9887-93db728c9ec7 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:13.348852 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:13.442852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 914/1789] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:13 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:13.542973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a74ff-dec8-445d-9887-93db728c9ec7 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:13.571309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cbefc-58e6-4bec-9f05-f3501fefde74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:13.572765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cbefc-58e6-4bec-9f05-f3501fefde74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:13.573266 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cbefc-58e6-4bec-9f05-f3501fefde74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:13.573694 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9cbefc-58e6-4bec-9f05-f3501fefde74 admin admin] PATH_INFO: `/v3/users/cc1bd57972eb4f02992fe02dcabe2b90` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:13.578632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cbefc-58e6-4bec-9f05-f3501fefde74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1bd57972eb4f02992fe02dcabe2b90)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:13.581029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9cbefc-58e6-4bec-9f05-f3501fefde74 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:13.753562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1b9cbefc-58e6-4bec-9f05-f3501fefde74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1bd57972eb4f02992fe02dcabe2b90'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:13.778866 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1b9cbefc-58e6-4bec-9f05-f3501fefde74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1bd57972eb4f02992fe02dcabe2b90'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:13.806563 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1b9cbefc-58e6-4bec-9f05-f3501fefde74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1bd57972eb4f02992fe02dcabe2b90'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:13.807222 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1b9cbefc-58e6-4bec-9f05-f3501fefde74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1bd57972eb4f02992fe02dcabe2b90'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:13.807990 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1b9cbefc-58e6-4bec-9f05-f3501fefde74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1bd57972eb4f02992fe02dcabe2b90'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:13.847308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 876/1790] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:13 2022] DELETE /identity/v3/users/cc1bd57972eb4f02992fe02dcabe2b90 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:13.852559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851674b3-de09-4abd-a5e9-e42bd12584ff None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:13.853031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851674b3-de09-4abd-a5e9-e42bd12584ff None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:13.853333 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851674b3-de09-4abd-a5e9-e42bd12584ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:13.906142 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-851674b3-de09-4abd-a5e9-e42bd12584ff None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:13.907461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-851674b3-de09-4abd-a5e9-e42bd12584ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:14.159334 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:14.235082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 915/1791] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:14.481124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cbefc-58e6-4bec-9f05-f3501fefde74 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:14.484464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1b9cbefc-58e6-4bec-9f05-f3501fefde74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:14.920347 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9cbefc-58e6-4bec-9f05-f3501fefde74 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:14.966025 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bdab94-8bbc-4447-8798-ebe43259e034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:14.971793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdab94-8bbc-4447-8798-ebe43259e034 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:14.972694 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdab94-8bbc-4447-8798-ebe43259e034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:14.973496 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bdab94-8bbc-4447-8798-ebe43259e034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:15.059402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdab94-8bbc-4447-8798-ebe43259e034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:15.062664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bdab94-8bbc-4447-8798-ebe43259e034 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:15.116683 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 877/1792] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:06:15.358494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851674b3-de09-4abd-a5e9-e42bd12584ff None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:15.363562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-851674b3-de09-4abd-a5e9-e42bd12584ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:15.398227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851674b3-de09-4abd-a5e9-e42bd12584ff None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:15.411159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3ad8f3-139e-4cb4-9e5e-5b60581cb246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:15.415037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ad8f3-139e-4cb4-9e5e-5b60581cb246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:15.415793 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ad8f3-139e-4cb4-9e5e-5b60581cb246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:15.416555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3ad8f3-139e-4cb4-9e5e-5b60581cb246 admin admin] PATH_INFO: `/v3/users/88cadfbcfa384f9b8386b91b5e59b52c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:15.421480 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ad8f3-139e-4cb4-9e5e-5b60581cb246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88cadfbcfa384f9b8386b91b5e59b52c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:15.429773 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3ad8f3-139e-4cb4-9e5e-5b60581cb246 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:15.599391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e082b-5a12-4557-988a-3e33b58fdeb0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:15.600757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e082b-5a12-4557-988a-3e33b58fdeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:15.601493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e082b-5a12-4557-988a-3e33b58fdeb0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:15.604906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 878/1793] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 16:06:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:06:15.639089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ad3ad8f3-139e-4cb4-9e5e-5b60581cb246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88cadfbcfa384f9b8386b91b5e59b52c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:15.679430 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ca560-4c14-4b5f-89ce-8df65c726904 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:15.679765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ca560-4c14-4b5f-89ce-8df65c726904 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:15.680424 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ca560-4c14-4b5f-89ce-8df65c726904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:15.692350 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ad3ad8f3-139e-4cb4-9e5e-5b60581cb246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88cadfbcfa384f9b8386b91b5e59b52c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:15.730319 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d92ca560-4c14-4b5f-89ce-8df65c726904 None None] MFA Rules not processed for user `e9a1ec1f6bb7467dbd63ad1da36d48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:15.732453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ad3ad8f3-139e-4cb4-9e5e-5b60581cb246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88cadfbcfa384f9b8386b91b5e59b52c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:15.735039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d92ca560-4c14-4b5f-89ce-8df65c726904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:15.735221 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ad3ad8f3-139e-4cb4-9e5e-5b60581cb246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88cadfbcfa384f9b8386b91b5e59b52c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:15.769457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ad3ad8f3-139e-4cb4-9e5e-5b60581cb246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88cadfbcfa384f9b8386b91b5e59b52c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:15.813436 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 916/1794] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:15 2022] DELETE /identity/v3/users/88cadfbcfa384f9b8386b91b5e59b52c => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:15.818206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5a258-b351-4720-b983-c68781493406 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:15.818535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5a258-b351-4720-b983-c68781493406 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:15.819015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d5a258-b351-4720-b983-c68781493406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:15.869299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:15.959280 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-83d5a258-b351-4720-b983-c68781493406 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:15.963886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-83d5a258-b351-4720-b983-c68781493406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:16.085708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 879/1795] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 16:06:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:06:16.457974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 917/1796] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 643 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:16.595483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ca560-4c14-4b5f-89ce-8df65c726904 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:16.600143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d92ca560-4c14-4b5f-89ce-8df65c726904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:16.663691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ca560-4c14-4b5f-89ce-8df65c726904 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:16.762788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5a258-b351-4720-b983-c68781493406 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:16.764916 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-83d5a258-b351-4720-b983-c68781493406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:16.802409 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d5a258-b351-4720-b983-c68781493406 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:16.837134 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f0b0c-92e4-49f0-ab07-d923e52c9bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:16.838214 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f0b0c-92e4-49f0-ab07-d923e52c9bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:16.838509 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f0b0c-92e4-49f0-ab07-d923e52c9bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:16.838851 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f0b0c-92e4-49f0-ab07-d923e52c9bc9 admin admin] PATH_INFO: `/v3/users/a26429e4007b42ab803ed54eb7af9c79` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:16.844201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f0b0c-92e4-49f0-ab07-d923e52c9bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26429e4007b42ab803ed54eb7af9c79)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:16.849321 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f0b0c-92e4-49f0-ab07-d923e52c9bc9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:16.966410 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a6879-ccce-4bc4-b5ae-0172e1eedbfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:16.967164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a6879-ccce-4bc4-b5ae-0172e1eedbfd service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:16.972960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a6879-ccce-4bc4-b5ae-0172e1eedbfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:16.974092 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a6879-ccce-4bc4-b5ae-0172e1eedbfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:17.003868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a14f0b0c-92e4-49f0-ab07-d923e52c9bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26429e4007b42ab803ed54eb7af9c79'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:17.005029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a6879-ccce-4bc4-b5ae-0172e1eedbfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:17.018281 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969a6879-ccce-4bc4-b5ae-0172e1eedbfd service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:17.024621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:17.062121 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a14f0b0c-92e4-49f0-ab07-d923e52c9bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26429e4007b42ab803ed54eb7af9c79'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:17.065211 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 880/1797] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:17.066287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a6879-ccce-4bc4-b5ae-0172e1eedbfd service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:17.073106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-969a6879-ccce-4bc4-b5ae-0172e1eedbfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:17.085316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a14f0b0c-92e4-49f0-ab07-d923e52c9bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26429e4007b42ab803ed54eb7af9c79'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:17.087339 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a14f0b0c-92e4-49f0-ab07-d923e52c9bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26429e4007b42ab803ed54eb7af9c79'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:17.113932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a14f0b0c-92e4-49f0-ab07-d923e52c9bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26429e4007b42ab803ed54eb7af9c79'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:17.131058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 918/1798] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:16 2022] DELETE /identity/v3/users/a26429e4007b42ab803ed54eb7af9c79 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:17.137443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c0372-44c4-4b08-872d-874c869ebd37 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:17.137748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c0372-44c4-4b08-872d-874c869ebd37 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:17.138031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c0372-44c4-4b08-872d-874c869ebd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:17.212045 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ed9c0372-44c4-4b08-872d-874c869ebd37 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:17.216531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ed9c0372-44c4-4b08-872d-874c869ebd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:17.296760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a6879-ccce-4bc4-b5ae-0172e1eedbfd service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:17.498980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51c4df-4a77-4952-b001-113e7b2a0b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:17.498980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51c4df-4a77-4952-b001-113e7b2a0b00 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:17.498980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51c4df-4a77-4952-b001-113e7b2a0b00 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:17.498980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51c4df-4a77-4952-b001-113e7b2a0b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:17.499558 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 919/1799] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:17.504420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-da51c4df-4a77-4952-b001-113e7b2a0b00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:17.517246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:17.522961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51c4df-4a77-4952-b001-113e7b2a0b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:17.525300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51c4df-4a77-4952-b001-113e7b2a0b00 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:17.577436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 881/1800] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:18.144224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c0372-44c4-4b08-872d-874c869ebd37 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:18.147866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ed9c0372-44c4-4b08-872d-874c869ebd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:18.307438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c0372-44c4-4b08-872d-874c869ebd37 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:18.328059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481cc6f4-0e38-47c9-b772-a59a7c6c829c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:18.328769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cc6f4-0e38-47c9-b772-a59a7c6c829c service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:18.329099 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cc6f4-0e38-47c9-b772-a59a7c6c829c service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:18.329381 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481cc6f4-0e38-47c9-b772-a59a7c6c829c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:18.369216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481cc6f4-0e38-47c9-b772-a59a7c6c829c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:18.376381 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481cc6f4-0e38-47c9-b772-a59a7c6c829c service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:18.421709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 920/1801] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:19.836552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd32f6f-709b-4ad5-984b-d1cae7c15861 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:19.837501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd32f6f-709b-4ad5-984b-d1cae7c15861 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:19.837501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd32f6f-709b-4ad5-984b-d1cae7c15861 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:19.844337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 882/1802] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 16:06:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:06:20.051525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb629b5-503b-4106-8b77-2e2a26a9baaf None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:20.054162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb629b5-503b-4106-8b77-2e2a26a9baaf None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:20.060881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb629b5-503b-4106-8b77-2e2a26a9baaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:20.131030 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8cb629b5-503b-4106-8b77-2e2a26a9baaf None None] MFA Rules not processed for user `1f4a46a051c241a2a47059052735c930`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:20.132344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8cb629b5-503b-4106-8b77-2e2a26a9baaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:20.258420 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 921/1803] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 16:06:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:20.379868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd32f6f-709b-4ad5-984b-d1cae7c15861 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:20.379868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9bd32f6f-709b-4ad5-984b-d1cae7c15861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:20.438961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd32f6f-709b-4ad5-984b-d1cae7c15861 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:20.457513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb54592-df89-4919-b02e-de50330e42a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:20.462552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb54592-df89-4919-b02e-de50330e42a2 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:20.470372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb54592-df89-4919-b02e-de50330e42a2 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:20.471601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb54592-df89-4919-b02e-de50330e42a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:20.535287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb54592-df89-4919-b02e-de50330e42a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:20.540161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb54592-df89-4919-b02e-de50330e42a2 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:20.591676 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 883/1804] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:20.676168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb629b5-503b-4106-8b77-2e2a26a9baaf None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:20.679370 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8cb629b5-503b-4106-8b77-2e2a26a9baaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:20.738361 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb629b5-503b-4106-8b77-2e2a26a9baaf None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:20.761110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61acc7-8922-4cf2-9a3a-b6323d509e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:20.762027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61acc7-8922-4cf2-9a3a-b6323d509e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:20.762324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61acc7-8922-4cf2-9a3a-b6323d509e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:20.762796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61acc7-8922-4cf2-9a3a-b6323d509e8f admin admin] PATH_INFO: `/v3/projects/6c9170a5dfd949a6a39b5d5157943dc5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:20.764551 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61acc7-8922-4cf2-9a3a-b6323d509e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9170a5dfd949a6a39b5d5157943dc5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:20.767015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61acc7-8922-4cf2-9a3a-b6323d509e8f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:20.796769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:20.857852 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb54592-df89-4919-b02e-de50330e42a2 service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:20.859914 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aeb54592-df89-4919-b02e-de50330e42a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:20.885822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb54592-df89-4919-b02e-de50330e42a2 service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:20.923275 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-da61acc7-8922-4cf2-9a3a-b6323d509e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9170a5dfd949a6a39b5d5157943dc5', 'request_id': 'req-da61acc7-8922-4cf2-9a3a-b6323d509e8f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:20.945577 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-da61acc7-8922-4cf2-9a3a-b6323d509e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9170a5dfd949a6a39b5d5157943dc5', 'request_id': 'req-da61acc7-8922-4cf2-9a3a-b6323d509e8f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:20.957329 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-da61acc7-8922-4cf2-9a3a-b6323d509e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9170a5dfd949a6a39b5d5157943dc5', 'request_id': 'req-da61acc7-8922-4cf2-9a3a-b6323d509e8f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:20.999386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-da61acc7-8922-4cf2-9a3a-b6323d509e8f admin admin] The token cache is being invalidate because project 6c9170a5dfd949a6a39b5d5157943dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:21.000107 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-da61acc7-8922-4cf2-9a3a-b6323d509e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.002274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-da61acc7-8922-4cf2-9a3a-b6323d509e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.010742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 922/1805] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:20 2022] DELETE /identity/v3/projects/6c9170a5dfd949a6a39b5d5157943dc5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:21.014243 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb15d9-2ec8-4294-8e40-f398274f54b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:21.015186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb15d9-2ec8-4294-8e40-f398274f54b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:21.015470 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb15d9-2ec8-4294-8e40-f398274f54b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:21.015746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb15d9-2ec8-4294-8e40-f398274f54b8 admin admin] PATH_INFO: `/v3/projects/8f47a47c140c40f3a46ad9d50e6931e6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:21.021235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb15d9-2ec8-4294-8e40-f398274f54b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f47a47c140c40f3a46ad9d50e6931e6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:21.023471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb15d9-2ec8-4294-8e40-f398274f54b8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:21.030286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61acc7-8922-4cf2-9a3a-b6323d509e8f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:21.033206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-da61acc7-8922-4cf2-9a3a-b6323d509e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:21.077211 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61acc7-8922-4cf2-9a3a-b6323d509e8f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:21.085746 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e556ba-7223-459e-8342-e871e887c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:21.087307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e556ba-7223-459e-8342-e871e887c488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:21.087934 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e556ba-7223-459e-8342-e871e887c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:21.088581 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e556ba-7223-459e-8342-e871e887c488 admin admin] PATH_INFO: `/v3/users/9fb801f94cc8459eaa58921a0d44eb3a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:21.091100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e556ba-7223-459e-8342-e871e887c488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fb801f94cc8459eaa58921a0d44eb3a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:21.093626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e556ba-7223-459e-8342-e871e887c488 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:21.144654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f7cb15d9-2ec8-4294-8e40-f398274f54b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f47a47c140c40f3a46ad9d50e6931e6', 'request_id': 'req-f7cb15d9-2ec8-4294-8e40-f398274f54b8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.152458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f7cb15d9-2ec8-4294-8e40-f398274f54b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f47a47c140c40f3a46ad9d50e6931e6', 'request_id': 'req-f7cb15d9-2ec8-4294-8e40-f398274f54b8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.159682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f7cb15d9-2ec8-4294-8e40-f398274f54b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f47a47c140c40f3a46ad9d50e6931e6', 'request_id': 'req-f7cb15d9-2ec8-4294-8e40-f398274f54b8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.178494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f7cb15d9-2ec8-4294-8e40-f398274f54b8 admin admin] The token cache is being invalidate because project 8f47a47c140c40f3a46ad9d50e6931e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:21.179139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f7cb15d9-2ec8-4294-8e40-f398274f54b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.179833 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f7cb15d9-2ec8-4294-8e40-f398274f54b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.190322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 884/1806] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:20 2022] DELETE /identity/v3/projects/8f47a47c140c40f3a46ad9d50e6931e6 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:21.196749 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb15d9-2ec8-4294-8e40-f398274f54b8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:21.199732 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f7cb15d9-2ec8-4294-8e40-f398274f54b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:21.220243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-82e556ba-7223-459e-8342-e871e887c488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fb801f94cc8459eaa58921a0d44eb3a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.250383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-82e556ba-7223-459e-8342-e871e887c488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fb801f94cc8459eaa58921a0d44eb3a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.273293 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-82e556ba-7223-459e-8342-e871e887c488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fb801f94cc8459eaa58921a0d44eb3a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.273722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-82e556ba-7223-459e-8342-e871e887c488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fb801f94cc8459eaa58921a0d44eb3a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.294236 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-82e556ba-7223-459e-8342-e871e887c488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fb801f94cc8459eaa58921a0d44eb3a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.312862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 923/1807] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:21 2022] DELETE /identity/v3/users/9fb801f94cc8459eaa58921a0d44eb3a => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:21.349903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb15d9-2ec8-4294-8e40-f398274f54b8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:21.400066 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:21.521625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05648d-c4bd-404f-95e7-0b1ad52ac3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:21.526899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05648d-c4bd-404f-95e7-0b1ad52ac3d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:21.527146 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05648d-c4bd-404f-95e7-0b1ad52ac3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:21.527432 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05648d-c4bd-404f-95e7-0b1ad52ac3d6 admin admin] PATH_INFO: `/v3/users/108c7f1017b4444e853aab44b9d22418` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:21.530274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05648d-c4bd-404f-95e7-0b1ad52ac3d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=108c7f1017b4444e853aab44b9d22418)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:21.536685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05648d-c4bd-404f-95e7-0b1ad52ac3d6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:21.678461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8c05648d-c4bd-404f-95e7-0b1ad52ac3d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '108c7f1017b4444e853aab44b9d22418'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.688427 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8c05648d-c4bd-404f-95e7-0b1ad52ac3d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '108c7f1017b4444e853aab44b9d22418'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.712730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8c05648d-c4bd-404f-95e7-0b1ad52ac3d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '108c7f1017b4444e853aab44b9d22418'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.713371 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8c05648d-c4bd-404f-95e7-0b1ad52ac3d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '108c7f1017b4444e853aab44b9d22418'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.714104 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-8c05648d-c4bd-404f-95e7-0b1ad52ac3d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '108c7f1017b4444e853aab44b9d22418'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.725855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e556ba-7223-459e-8342-e871e887c488 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:21.727868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-82e556ba-7223-459e-8342-e871e887c488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:21.762105 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e556ba-7223-459e-8342-e871e887c488 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:21.791115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da74dfc-3156-4e45-bb61-4cba30e9ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:21.794140 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da74dfc-3156-4e45-bb61-4cba30e9ba53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:21.794433 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da74dfc-3156-4e45-bb61-4cba30e9ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:21.794719 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da74dfc-3156-4e45-bb61-4cba30e9ba53 admin admin] PATH_INFO: `/v3/users/cea62586ba2e4a03af70dac52acb4c9e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:21.796512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da74dfc-3156-4e45-bb61-4cba30e9ba53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cea62586ba2e4a03af70dac52acb4c9e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:21.800059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da74dfc-3156-4e45-bb61-4cba30e9ba53 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:21.803027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 885/1808] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:21 2022] DELETE /identity/v3/users/108c7f1017b4444e853aab44b9d22418 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:21.915869 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7da74dfc-3156-4e45-bb61-4cba30e9ba53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cea62586ba2e4a03af70dac52acb4c9e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.955120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7da74dfc-3156-4e45-bb61-4cba30e9ba53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cea62586ba2e4a03af70dac52acb4c9e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.978354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=71,keystone:DELETE=26,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:21.993185 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7da74dfc-3156-4e45-bb61-4cba30e9ba53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cea62586ba2e4a03af70dac52acb4c9e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:21.994143 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7da74dfc-3156-4e45-bb61-4cba30e9ba53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cea62586ba2e4a03af70dac52acb4c9e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:22.024813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7da74dfc-3156-4e45-bb61-4cba30e9ba53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cea62586ba2e4a03af70dac52acb4c9e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:22.050786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 924/1809] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:21 2022] DELETE /identity/v3/users/cea62586ba2e4a03af70dac52acb4c9e => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:22.377271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05648d-c4bd-404f-95e7-0b1ad52ac3d6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:22.379401 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8c05648d-c4bd-404f-95e7-0b1ad52ac3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:22.633367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05648d-c4bd-404f-95e7-0b1ad52ac3d6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:22.683953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da74dfc-3156-4e45-bb61-4cba30e9ba53 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:22.685629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7da74dfc-3156-4e45-bb61-4cba30e9ba53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:22.853533 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:22.928616 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037fe78-3312-4748-9b5b-1e66fdef9ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:22.931469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037fe78-3312-4748-9b5b-1e66fdef9ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:22.931856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037fe78-3312-4748-9b5b-1e66fdef9ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:22.936312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7037fe78-3312-4748-9b5b-1e66fdef9ed5 admin admin] PATH_INFO: `/v3/projects/33389b4e1b8c45df9b1de4a0728e6fe9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:22.943918 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037fe78-3312-4748-9b5b-1e66fdef9ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33389b4e1b8c45df9b1de4a0728e6fe9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:22.952425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7037fe78-3312-4748-9b5b-1e66fdef9ed5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:23.028666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da74dfc-3156-4e45-bb61-4cba30e9ba53 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:23.044089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b287c-2bcf-4510-b9f0-eaa269c79840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:23.045038 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b287c-2bcf-4510-b9f0-eaa269c79840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:23.046169 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b287c-2bcf-4510-b9f0-eaa269c79840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:23.046169 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9b287c-2bcf-4510-b9f0-eaa269c79840 admin admin] PATH_INFO: `/v3/projects/4d5f4a8692fc4ff29b2c11c297e5fddd` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:23.047934 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b287c-2bcf-4510-b9f0-eaa269c79840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d5f4a8692fc4ff29b2c11c297e5fddd)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:23.050407 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9b287c-2bcf-4510-b9f0-eaa269c79840 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:23.258852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4d9b287c-2bcf-4510-b9f0-eaa269c79840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d5f4a8692fc4ff29b2c11c297e5fddd', 'request_id': 'req-4d9b287c-2bcf-4510-b9f0-eaa269c79840'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.290491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4d9b287c-2bcf-4510-b9f0-eaa269c79840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d5f4a8692fc4ff29b2c11c297e5fddd', 'request_id': 'req-4d9b287c-2bcf-4510-b9f0-eaa269c79840'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.318860 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4d9b287c-2bcf-4510-b9f0-eaa269c79840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d5f4a8692fc4ff29b2c11c297e5fddd', 'request_id': 'req-4d9b287c-2bcf-4510-b9f0-eaa269c79840'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.331136 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7037fe78-3312-4748-9b5b-1e66fdef9ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33389b4e1b8c45df9b1de4a0728e6fe9', 'request_id': 'req-7037fe78-3312-4748-9b5b-1e66fdef9ed5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.360823 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7037fe78-3312-4748-9b5b-1e66fdef9ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33389b4e1b8c45df9b1de4a0728e6fe9', 'request_id': 'req-7037fe78-3312-4748-9b5b-1e66fdef9ed5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.367627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4d9b287c-2bcf-4510-b9f0-eaa269c79840 admin admin] The token cache is being invalidate because project 4d5f4a8692fc4ff29b2c11c297e5fddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:23.369961 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4d9b287c-2bcf-4510-b9f0-eaa269c79840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.372144 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-4d9b287c-2bcf-4510-b9f0-eaa269c79840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.382187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 925/1810] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:22 2022] DELETE /identity/v3/projects/4d5f4a8692fc4ff29b2c11c297e5fddd => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:23.383304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b287c-2bcf-4510-b9f0-eaa269c79840 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:23.386192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7037fe78-3312-4748-9b5b-1e66fdef9ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33389b4e1b8c45df9b1de4a0728e6fe9', 'request_id': 'req-7037fe78-3312-4748-9b5b-1e66fdef9ed5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.388346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4d9b287c-2bcf-4510-b9f0-eaa269c79840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:23.456843 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7037fe78-3312-4748-9b5b-1e66fdef9ed5 admin admin] The token cache is being invalidate because project 33389b4e1b8c45df9b1de4a0728e6fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:23.457307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7037fe78-3312-4748-9b5b-1e66fdef9ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.459324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7037fe78-3312-4748-9b5b-1e66fdef9ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.472926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 886/1811] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:22 2022] DELETE /identity/v3/projects/33389b4e1b8c45df9b1de4a0728e6fe9 => generated 0 bytes in 1091 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:23.474767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037fe78-3312-4748-9b5b-1e66fdef9ed5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:23.489791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7037fe78-3312-4748-9b5b-1e66fdef9ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:23.638853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9b287c-2bcf-4510-b9f0-eaa269c79840 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:23.642669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7037fe78-3312-4748-9b5b-1e66fdef9ed5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:23.648752 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9495ed-8967-447b-943b-0bdb17827e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:23.650224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9495ed-8967-447b-943b-0bdb17827e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:23.650747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9495ed-8967-447b-943b-0bdb17827e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:23.651382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9495ed-8967-447b-943b-0bdb17827e46 admin admin] PATH_INFO: `/v3/users/741c771e26b0424abc25b908dc5aa696` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:23.652878 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892422e7-5945-4e67-a5a7-66c34f36f2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:23.653236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9495ed-8967-447b-943b-0bdb17827e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=741c771e26b0424abc25b908dc5aa696)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:23.653964 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892422e7-5945-4e67-a5a7-66c34f36f2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:23.654303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892422e7-5945-4e67-a5a7-66c34f36f2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:23.654670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892422e7-5945-4e67-a5a7-66c34f36f2dd admin admin] PATH_INFO: `/v3/projects/93143567e0994d3a96dad4850123b5ab` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:23.656580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9495ed-8967-447b-943b-0bdb17827e46 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:23.657764 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892422e7-5945-4e67-a5a7-66c34f36f2dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=93143567e0994d3a96dad4850123b5ab)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:23.659981 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892422e7-5945-4e67-a5a7-66c34f36f2dd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:23.687247 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:23.748515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-892422e7-5945-4e67-a5a7-66c34f36f2dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93143567e0994d3a96dad4850123b5ab', 'request_id': 'req-892422e7-5945-4e67-a5a7-66c34f36f2dd'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.761046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-892422e7-5945-4e67-a5a7-66c34f36f2dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93143567e0994d3a96dad4850123b5ab', 'request_id': 'req-892422e7-5945-4e67-a5a7-66c34f36f2dd'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.769481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-892422e7-5945-4e67-a5a7-66c34f36f2dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93143567e0994d3a96dad4850123b5ab', 'request_id': 'req-892422e7-5945-4e67-a5a7-66c34f36f2dd'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.784561 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-892422e7-5945-4e67-a5a7-66c34f36f2dd admin admin] The token cache is being invalidate because project 93143567e0994d3a96dad4850123b5ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:23.785130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-892422e7-5945-4e67-a5a7-66c34f36f2dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.791699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf9495ed-8967-447b-943b-0bdb17827e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '741c771e26b0424abc25b908dc5aa696'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.795784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-892422e7-5945-4e67-a5a7-66c34f36f2dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.798632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 926/1812] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:23 2022] DELETE /identity/v3/projects/93143567e0994d3a96dad4850123b5ab => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:23.801049 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0765dc3-f496-4012-bad7-dead996bf1a7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:23.803386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0765dc3-f496-4012-bad7-dead996bf1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:23.803706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0765dc3-f496-4012-bad7-dead996bf1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:23.812961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf9495ed-8967-447b-943b-0bdb17827e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '741c771e26b0424abc25b908dc5aa696'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.832450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf9495ed-8967-447b-943b-0bdb17827e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '741c771e26b0424abc25b908dc5aa696'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.833862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf9495ed-8967-447b-943b-0bdb17827e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '741c771e26b0424abc25b908dc5aa696'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.835284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cf9495ed-8967-447b-943b-0bdb17827e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '741c771e26b0424abc25b908dc5aa696'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:23.844400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f0765dc3-f496-4012-bad7-dead996bf1a7 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:23.847178 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f0765dc3-f496-4012-bad7-dead996bf1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:23.855890 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:23.870874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 887/1813] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:23 2022] DELETE /identity/v3/users/741c771e26b0424abc25b908dc5aa696 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:23.872131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9495ed-8967-447b-943b-0bdb17827e46 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:23.874395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cf9495ed-8967-447b-943b-0bdb17827e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:23.967040 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 927/1814] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:23.976740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b9331-a610-411a-a229-56f73cc0c774 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:23.977230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b9331-a610-411a-a229-56f73cc0c774 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:23.977617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b9331-a610-411a-a229-56f73cc0c774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:24.000391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9495ed-8967-447b-943b-0bdb17827e46 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:24.011494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd19895-9954-4e33-8ad2-1517e4407593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:24.012736 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd19895-9954-4e33-8ad2-1517e4407593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:24.013255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd19895-9954-4e33-8ad2-1517e4407593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:24.013985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd19895-9954-4e33-8ad2-1517e4407593 admin admin] PATH_INFO: `/v3/users/5da8425099634dcdbe0104b23ed57c06` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:24.016960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd19895-9954-4e33-8ad2-1517e4407593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da8425099634dcdbe0104b23ed57c06)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:24.021597 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9f3b9331-a610-411a-a229-56f73cc0c774 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:24.022713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd19895-9954-4e33-8ad2-1517e4407593 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:24.023111 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9f3b9331-a610-411a-a229-56f73cc0c774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:24.039035 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 928/1815] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:06:24.061716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b9331-a610-411a-a229-56f73cc0c774 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:24.086166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b9331-a610-411a-a229-56f73cc0c774 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:24.098721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0305e7e-9549-4267-b419-78bbbd1a819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:24.099559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0305e7e-9549-4267-b419-78bbbd1a819f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:24.099852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0305e7e-9549-4267-b419-78bbbd1a819f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:24.100198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0305e7e-9549-4267-b419-78bbbd1a819f admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:24.102809 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0305e7e-9549-4267-b419-78bbbd1a819f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:24.102809 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0305e7e-9549-4267-b419-78bbbd1a819f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:24.109351 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0305e7e-9549-4267-b419-78bbbd1a819f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:24.150048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6cd19895-9954-4e33-8ad2-1517e4407593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da8425099634dcdbe0104b23ed57c06'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:24.167113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 929/1816] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:24.169060 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0305e7e-9549-4267-b419-78bbbd1a819f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:24.171793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6cd19895-9954-4e33-8ad2-1517e4407593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da8425099634dcdbe0104b23ed57c06'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:24.201851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6cd19895-9954-4e33-8ad2-1517e4407593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da8425099634dcdbe0104b23ed57c06'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:24.202652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6cd19895-9954-4e33-8ad2-1517e4407593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da8425099634dcdbe0104b23ed57c06'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:24.203920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6cd19895-9954-4e33-8ad2-1517e4407593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da8425099634dcdbe0104b23ed57c06'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:24.206804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0305e7e-9549-4267-b419-78bbbd1a819f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:24.224783 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b651c0-6abb-451e-8767-15c772f0f96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:24.229182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b651c0-6abb-451e-8767-15c772f0f96b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:24.230080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b651c0-6abb-451e-8767-15c772f0f96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:24.231215 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b651c0-6abb-451e-8767-15c772f0f96b admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:24.232039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b651c0-6abb-451e-8767-15c772f0f96b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:24.240160 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b651c0-6abb-451e-8767-15c772f0f96b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:24.260575 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 888/1817] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:23 2022] DELETE /identity/v3/users/5da8425099634dcdbe0104b23ed57c06 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:24.297015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 930/1818] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:24 2022] POST /identity/v3/projects => generated 363 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:24.302390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd19895-9954-4e33-8ad2-1517e4407593 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:24.304001 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6cd19895-9954-4e33-8ad2-1517e4407593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:24.409997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b651c0-6abb-451e-8767-15c772f0f96b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:24.414175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e9b651c0-6abb-451e-8767-15c772f0f96b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:24.507847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd19895-9954-4e33-8ad2-1517e4407593 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:24.555973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:24.619547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b651c0-6abb-451e-8767-15c772f0f96b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:24.626225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37697da-5bf6-4f08-8fb5-773cd37eda8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:24.627525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37697da-5bf6-4f08-8fb5-773cd37eda8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:24.627813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37697da-5bf6-4f08-8fb5-773cd37eda8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:24.628484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37697da-5bf6-4f08-8fb5-773cd37eda8e admin admin] PATH_INFO: `/v3/projects/ad00cea7270a4440b4785c4ff7f4d86a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:24.630672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37697da-5bf6-4f08-8fb5-773cd37eda8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad00cea7270a4440b4785c4ff7f4d86a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:24.633771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37697da-5bf6-4f08-8fb5-773cd37eda8e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:24.644773 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:24.718713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24494658-d32b-4725-beb0-f9296aec7504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:24.720223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24494658-d32b-4725-beb0-f9296aec7504 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:24.720223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24494658-d32b-4725-beb0-f9296aec7504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:24.720223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24494658-d32b-4725-beb0-f9296aec7504 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:24.720754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24494658-d32b-4725-beb0-f9296aec7504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:24.722851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24494658-d32b-4725-beb0-f9296aec7504 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:24.764764 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d37697da-5bf6-4f08-8fb5-773cd37eda8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad00cea7270a4440b4785c4ff7f4d86a', 'request_id': 'req-d37697da-5bf6-4f08-8fb5-773cd37eda8e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:24.784180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d37697da-5bf6-4f08-8fb5-773cd37eda8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad00cea7270a4440b4785c4ff7f4d86a', 'request_id': 'req-d37697da-5bf6-4f08-8fb5-773cd37eda8e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:24.792361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 889/1819] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:24 2022] POST /identity/v3/users => generated 282 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:24.794689 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24494658-d32b-4725-beb0-f9296aec7504 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:24.801095 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-24494658-d32b-4725-beb0-f9296aec7504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:24.806525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d37697da-5bf6-4f08-8fb5-773cd37eda8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad00cea7270a4440b4785c4ff7f4d86a', 'request_id': 'req-d37697da-5bf6-4f08-8fb5-773cd37eda8e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:24.823807 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24494658-d32b-4725-beb0-f9296aec7504 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:24.851754 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d37697da-5bf6-4f08-8fb5-773cd37eda8e admin admin] The token cache is being invalidate because project ad00cea7270a4440b4785c4ff7f4d86a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:24.852056 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d37697da-5bf6-4f08-8fb5-773cd37eda8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:24.855897 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d37697da-5bf6-4f08-8fb5-773cd37eda8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:24.859659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 931/1820] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:24 2022] DELETE /identity/v3/projects/ad00cea7270a4440b4785c4ff7f4d86a => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:24.860798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37697da-5bf6-4f08-8fb5-773cd37eda8e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:24.862255 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d37697da-5bf6-4f08-8fb5-773cd37eda8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:24.943818 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:24.945114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:24.945114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:24.945431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317 admin admin] PATH_INFO: `/v3/projects/ba815fefa2b94e87bf6fc58170f42b66` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:24.946577 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba815fefa2b94e87bf6fc58170f42b66)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:24.948589 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:24.999081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37697da-5bf6-4f08-8fb5-773cd37eda8e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:25.015727 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba815fefa2b94e87bf6fc58170f42b66', 'request_id': 'req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:25.032066 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba815fefa2b94e87bf6fc58170f42b66', 'request_id': 'req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:25.047269 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba815fefa2b94e87bf6fc58170f42b66', 'request_id': 'req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:25.066655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317 admin admin] The token cache is being invalidate because project ba815fefa2b94e87bf6fc58170f42b66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:25.067068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:25.067782 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:25.071039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 890/1821] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:24 2022] DELETE /identity/v3/projects/ba815fefa2b94e87bf6fc58170f42b66 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:25.072012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:25.073559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:25.111102 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492c4ee-b506-4bac-8a1c-c18aaba4d4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:25.112695 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492c4ee-b506-4bac-8a1c-c18aaba4d4cd admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:25.113200 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492c4ee-b506-4bac-8a1c-c18aaba4d4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:25.113699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492c4ee-b506-4bac-8a1c-c18aaba4d4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:25.115128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492c4ee-b506-4bac-8a1c-c18aaba4d4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:25.117944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492c4ee-b506-4bac-8a1c-c18aaba4d4cd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:25.125742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:25.136109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 932/1822] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:25.141258 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90e22-92d1-4044-9ddf-03e43a425e11 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:25.141827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90e22-92d1-4044-9ddf-03e43a425e11 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:25.142209 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d90e22-92d1-4044-9ddf-03e43a425e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:25.154915 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fddeeb-8d5c-4270-967a-7d6ed8a49317 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:25.161758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27ea19b-af42-4222-99f2-d6b0d67c6e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:25.162598 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-91d90e22-92d1-4044-9ddf-03e43a425e11 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:25.162868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea19b-af42-4222-99f2-d6b0d67c6e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:25.163261 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea19b-af42-4222-99f2-d6b0d67c6e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:25.163634 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27ea19b-af42-4222-99f2-d6b0d67c6e01 admin admin] PATH_INFO: `/v3/projects/693488e6281e4ad1b742cdf39302adb3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:25.163909 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-91d90e22-92d1-4044-9ddf-03e43a425e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:25.165033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ea19b-af42-4222-99f2-d6b0d67c6e01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=693488e6281e4ad1b742cdf39302adb3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:25.167116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27ea19b-af42-4222-99f2-d6b0d67c6e01 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:25.172636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 933/1823] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:25.180826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460142d-d62d-444d-a486-daecf6dd0b27 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:25.181118 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460142d-d62d-444d-a486-daecf6dd0b27 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:25.181400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460142d-d62d-444d-a486-daecf6dd0b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:25.201737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f460142d-d62d-444d-a486-daecf6dd0b27 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:25.203012 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f460142d-d62d-444d-a486-daecf6dd0b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:25.211500 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 934/1824] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:25.212371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460142d-d62d-444d-a486-daecf6dd0b27 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:25.213677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f460142d-d62d-444d-a486-daecf6dd0b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:25.226997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460142d-d62d-444d-a486-daecf6dd0b27 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:25.232214 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6981192-2be3-4b9a-b0d8-457e8e3a4b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:25.232923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6981192-2be3-4b9a-b0d8-457e8e3a4b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:25.233205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6981192-2be3-4b9a-b0d8-457e8e3a4b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:25.233482 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6981192-2be3-4b9a-b0d8-457e8e3a4b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:25.234215 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6981192-2be3-4b9a-b0d8-457e8e3a4b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:25.235883 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6981192-2be3-4b9a-b0d8-457e8e3a4b8e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:25.247176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 935/1825] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:25.248532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cae54d-6359-47e2-884c-c4e3b9e7ba8b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:25.248821 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cae54d-6359-47e2-884c-c4e3b9e7ba8b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:25.249102 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cae54d-6359-47e2-884c-c4e3b9e7ba8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:25.252693 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a27ea19b-af42-4222-99f2-d6b0d67c6e01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '693488e6281e4ad1b742cdf39302adb3', 'request_id': 'req-a27ea19b-af42-4222-99f2-d6b0d67c6e01'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:25.265186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a27ea19b-af42-4222-99f2-d6b0d67c6e01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '693488e6281e4ad1b742cdf39302adb3', 'request_id': 'req-a27ea19b-af42-4222-99f2-d6b0d67c6e01'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:25.268244 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-00cae54d-6359-47e2-884c-c4e3b9e7ba8b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:25.269855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-00cae54d-6359-47e2-884c-c4e3b9e7ba8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:25.275203 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a27ea19b-af42-4222-99f2-d6b0d67c6e01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '693488e6281e4ad1b742cdf39302adb3', 'request_id': 'req-a27ea19b-af42-4222-99f2-d6b0d67c6e01'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:25.280197 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:25.295059 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a27ea19b-af42-4222-99f2-d6b0d67c6e01 admin admin] The token cache is being invalidate because project 693488e6281e4ad1b742cdf39302adb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:25.295351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a27ea19b-af42-4222-99f2-d6b0d67c6e01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:25.296088 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a27ea19b-af42-4222-99f2-d6b0d67c6e01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:25.297784 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 891/1826] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:25 2022] DELETE /identity/v3/projects/693488e6281e4ad1b742cdf39302adb3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:25.299782 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471054f3-632c-488a-a9cd-44d720715f53 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:25.299782 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471054f3-632c-488a-a9cd-44d720715f53 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:25.299782 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471054f3-632c-488a-a9cd-44d720715f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:25.320827 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-471054f3-632c-488a-a9cd-44d720715f53 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:25.322536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-471054f3-632c-488a-a9cd-44d720715f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:25.393644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 936/1827] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:25.395285 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cae54d-6359-47e2-884c-c4e3b9e7ba8b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:25.396058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 892/1828] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:25.397304 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c52929-2a99-40b8-9f68-080b0ca80a81 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:25.397675 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c52929-2a99-40b8-9f68-080b0ca80a81 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:25.397953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c52929-2a99-40b8-9f68-080b0ca80a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:25.402556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-00cae54d-6359-47e2-884c-c4e3b9e7ba8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:25.417375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-50c52929-2a99-40b8-9f68-080b0ca80a81 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:25.418643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-50c52929-2a99-40b8-9f68-080b0ca80a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:25.428397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 893/1829] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:25.428975 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cae54d-6359-47e2-884c-c4e3b9e7ba8b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:25.429386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c52929-2a99-40b8-9f68-080b0ca80a81 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:25.440021 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c52929-2a99-40b8-9f68-080b0ca80a81 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:25.445488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f8cbd-3460-4ba8-a5ae-3a02f8906920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:25.446183 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f8cbd-3460-4ba8-a5ae-3a02f8906920 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:25.446468 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f8cbd-3460-4ba8-a5ae-3a02f8906920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:25.446746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f8cbd-3460-4ba8-a5ae-3a02f8906920 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:25.447285 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c1e9d-0322-4c43-befb-c6eaf3a3c12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:25.447536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f8cbd-3460-4ba8-a5ae-3a02f8906920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:25.447851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f8cbd-3460-4ba8-a5ae-3a02f8906920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:25.449519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f8cbd-3460-4ba8-a5ae-3a02f8906920 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:25.450053 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c1e9d-0322-4c43-befb-c6eaf3a3c12c admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:25.450797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c1e9d-0322-4c43-befb-c6eaf3a3c12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:25.451921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c1e9d-0322-4c43-befb-c6eaf3a3c12c admin admin] PATH_INFO: `/v3/projects/1e8a9ef221ca4a0cb32e3808fae60803/users/37e34bd9ae9448fd90c0bef71f6fcf69/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:25.468287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 894/1830] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:25.468287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f8cbd-3460-4ba8-a5ae-3a02f8906920 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:25.476726 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f8cbd-3460-4ba8-a5ae-3a02f8906920 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:25.482909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a86427-a145-428e-a216-868ffad708ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:25.483808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a86427-a145-428e-a216-868ffad708ce admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:25.484149 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a86427-a145-428e-a216-868ffad708ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:25.484524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a86427-a145-428e-a216-868ffad708ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:25.485367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a86427-a145-428e-a216-868ffad708ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:25.485752 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a86427-a145-428e-a216-868ffad708ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:25.487554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a86427-a145-428e-a216-868ffad708ce admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:25.509345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 895/1831] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:25.510911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0b9b9-0ca7-48a3-a56a-004979d60d44 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:25.511207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0b9b9-0ca7-48a3-a56a-004979d60d44 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:25.511500 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0b9b9-0ca7-48a3-a56a-004979d60d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:25.520382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c1e9d-0322-4c43-befb-c6eaf3a3c12c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8a9ef221ca4a0cb32e3808fae60803, user_id=37e34bd9ae9448fd90c0bef71f6fcf69, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:25.524407 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c1e9d-0322-4c43-befb-c6eaf3a3c12c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:25.531686 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-aae0b9b9-0ca7-48a3-a56a-004979d60d44 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:25.533014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-aae0b9b9-0ca7-48a3-a56a-004979d60d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:25.543183 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 896/1832] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:25.544536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0b9b9-0ca7-48a3-a56a-004979d60d44 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:25.552303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 937/1833] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:25 2022] PUT /identity/v3/projects/1e8a9ef221ca4a0cb32e3808fae60803/users/37e34bd9ae9448fd90c0bef71f6fcf69/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:25.554284 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c1e9d-0322-4c43-befb-c6eaf3a3c12c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:25.556119 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0b9b9-0ca7-48a3-a56a-004979d60d44 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:25.607392 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:25.675912 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c1e9d-0322-4c43-befb-c6eaf3a3c12c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:25.676213 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2c126-2bad-4335-badd-a365945c336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:25.676876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2c126-2bad-4335-badd-a365945c336e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:25.677192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2c126-2bad-4335-badd-a365945c336e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:25.677538 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2c126-2bad-4335-badd-a365945c336e admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:25.678290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2c126-2bad-4335-badd-a365945c336e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:25.680351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2c126-2bad-4335-badd-a365945c336e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:25.684757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57694530-4a22-4559-947e-5faf2dc28503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:25.686175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57694530-4a22-4559-947e-5faf2dc28503 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:25.686910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57694530-4a22-4559-947e-5faf2dc28503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:25.687481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57694530-4a22-4559-947e-5faf2dc28503 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:25.688807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57694530-4a22-4559-947e-5faf2dc28503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:25.698383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57694530-4a22-4559-947e-5faf2dc28503 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:25.723639 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 897/1834] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:25 2022] POST /identity/v3/projects => generated 355 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:25.725271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2c126-2bad-4335-badd-a365945c336e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:25.744661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 938/1835] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:25 2022] POST /identity/v3/projects => generated 379 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:25.746624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13690c70-ef96-468f-90a9-f2e523c0cf39 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:25.747047 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13690c70-ef96-468f-90a9-f2e523c0cf39 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:25.747457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13690c70-ef96-468f-90a9-f2e523c0cf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:25.810953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-13690c70-ef96-468f-90a9-f2e523c0cf39 None None] MFA Rules not processed for user `37e34bd9ae9448fd90c0bef71f6fcf69`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:25.813658 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-13690c70-ef96-468f-90a9-f2e523c0cf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:25.850432 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2c126-2bad-4335-badd-a365945c336e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:25.914375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 939/1836] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:25 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:25.914375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13690c70-ef96-468f-90a9-f2e523c0cf39 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:25.920692 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:26.031205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf0a5b-fd41-46ab-b673-a830fef68355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:26.032062 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf0a5b-fd41-46ab-b673-a830fef68355 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:26.032351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf0a5b-fd41-46ab-b673-a830fef68355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:26.032684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf0a5b-fd41-46ab-b673-a830fef68355 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:26.033502 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf0a5b-fd41-46ab-b673-a830fef68355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:26.033859 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf0a5b-fd41-46ab-b673-a830fef68355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:26.036243 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf0a5b-fd41-46ab-b673-a830fef68355 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:26.084873 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 898/1837] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:26.084873 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf0a5b-fd41-46ab-b673-a830fef68355 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:26.095713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13690c70-ef96-468f-90a9-f2e523c0cf39 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:26.109238 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca51b2b-aa35-4af4-a879-8abe8b2fe439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:26.110235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca51b2b-aa35-4af4-a879-8abe8b2fe439 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:26.110235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca51b2b-aa35-4af4-a879-8abe8b2fe439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:26.110481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca51b2b-aa35-4af4-a879-8abe8b2fe439 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:26.111253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca51b2b-aa35-4af4-a879-8abe8b2fe439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:26.113284 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca51b2b-aa35-4af4-a879-8abe8b2fe439 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:26.127066 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf0a5b-fd41-46ab-b673-a830fef68355 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:26.142894 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85974cf-2768-4cf9-bca7-0f263ddda2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:26.143603 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85974cf-2768-4cf9-bca7-0f263ddda2d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:26.143896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85974cf-2768-4cf9-bca7-0f263ddda2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:26.144181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85974cf-2768-4cf9-bca7-0f263ddda2d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:26.144914 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85974cf-2768-4cf9-bca7-0f263ddda2d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:26.147301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85974cf-2768-4cf9-bca7-0f263ddda2d8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:26.182862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 940/1838] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:25 2022] POST /identity/v3/users => generated 278 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:26.187388 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca51b2b-aa35-4af4-a879-8abe8b2fe439 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:26.203458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 899/1839] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:26 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:26.205426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85974cf-2768-4cf9-bca7-0f263ddda2d8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:26.222730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca51b2b-aa35-4af4-a879-8abe8b2fe439 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:26.224302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85974cf-2768-4cf9-bca7-0f263ddda2d8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:26.234947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ce68d-047f-419d-a65a-eebc239e5bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:26.236494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ce68d-047f-419d-a65a-eebc239e5bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:26.237145 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ce68d-047f-419d-a65a-eebc239e5bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:26.237657 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ce68d-047f-419d-a65a-eebc239e5bf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:26.239191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ce68d-047f-419d-a65a-eebc239e5bf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:26.241250 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f824d51-820b-4c07-883f-b5658ed1a492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:26.243006 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ce68d-047f-419d-a65a-eebc239e5bf6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:26.243302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f824d51-820b-4c07-883f-b5658ed1a492 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:26.243796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f824d51-820b-4c07-883f-b5658ed1a492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:26.244285 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f824d51-820b-4c07-883f-b5658ed1a492 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:26.245684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f824d51-820b-4c07-883f-b5658ed1a492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:26.249946 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f824d51-820b-4c07-883f-b5658ed1a492 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:26.295836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 900/1840] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:26 2022] POST /identity/v3/projects => generated 409 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:26.297839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ce68d-047f-419d-a65a-eebc239e5bf6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:26.326201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 941/1841] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:26 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:26.328236 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f824d51-820b-4c07-883f-b5658ed1a492 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:26.372039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:26.476165 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f824d51-820b-4c07-883f-b5658ed1a492 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:26.489025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc90fc3-39e4-4e6e-bb1e-df1c8db808b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:26.489904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc90fc3-39e4-4e6e-bb1e-df1c8db808b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:26.490579 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc90fc3-39e4-4e6e-bb1e-df1c8db808b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:26.491017 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc90fc3-39e4-4e6e-bb1e-df1c8db808b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:26.492060 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc90fc3-39e4-4e6e-bb1e-df1c8db808b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:26.493935 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc90fc3-39e4-4e6e-bb1e-df1c8db808b4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:26.506308 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 942/1842] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:26.511465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ce68d-047f-419d-a65a-eebc239e5bf6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:26.512249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc90fc3-39e4-4e6e-bb1e-df1c8db808b4 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:26.524097 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc90fc3-39e4-4e6e-bb1e-df1c8db808b4 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:26.530026 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3aa9b4-a5f8-4f2e-ae57-94c05efdf74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:26.530868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619da2f0-b874-4a80-9c07-2d80d8e9bc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:26.531475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3aa9b4-a5f8-4f2e-ae57-94c05efdf74e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:26.531969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3aa9b4-a5f8-4f2e-ae57-94c05efdf74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:26.532310 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3aa9b4-a5f8-4f2e-ae57-94c05efdf74e admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:26.532443 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da2f0-b874-4a80-9c07-2d80d8e9bc27 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:26.532860 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da2f0-b874-4a80-9c07-2d80d8e9bc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:26.533175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3aa9b4-a5f8-4f2e-ae57-94c05efdf74e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:26.533279 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da2f0-b874-4a80-9c07-2d80d8e9bc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:26.534438 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619da2f0-b874-4a80-9c07-2d80d8e9bc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:26.535325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3aa9b4-a5f8-4f2e-ae57-94c05efdf74e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:26.537478 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619da2f0-b874-4a80-9c07-2d80d8e9bc27 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:26.562163 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 901/1843] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:26.563794 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619da2f0-b874-4a80-9c07-2d80d8e9bc27 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:26.582375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 943/1844] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:26 2022] POST /identity/v3/users => generated 305 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:26.582375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3aa9b4-a5f8-4f2e-ae57-94c05efdf74e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:26.589516 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619da2f0-b874-4a80-9c07-2d80d8e9bc27 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:26.598201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aed73a-4790-48dd-acd2-97e1d527440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:26.599405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aed73a-4790-48dd-acd2-97e1d527440b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:26.599883 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aed73a-4790-48dd-acd2-97e1d527440b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:26.600361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aed73a-4790-48dd-acd2-97e1d527440b admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:26.602028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aed73a-4790-48dd-acd2-97e1d527440b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:26.605801 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aed73a-4790-48dd-acd2-97e1d527440b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:26.609166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3aa9b4-a5f8-4f2e-ae57-94c05efdf74e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:26.628108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7e59a-f56a-4db9-a27e-1cdcfcc3d3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:26.629976 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7e59a-f56a-4db9-a27e-1cdcfcc3d3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:26.630621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7e59a-f56a-4db9-a27e-1cdcfcc3d3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:26.639229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc7e59a-f56a-4db9-a27e-1cdcfcc3d3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:26.640918 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7e59a-f56a-4db9-a27e-1cdcfcc3d3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:26.644294 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc7e59a-f56a-4db9-a27e-1cdcfcc3d3c9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:26.646168 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 902/1845] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:26 2022] POST /identity/v3/users => generated 289 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:26.651719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aed73a-4790-48dd-acd2-97e1d527440b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:26.667505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aed73a-4790-48dd-acd2-97e1d527440b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:26.673996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55732aaa-77d1-4924-8f4c-dd3213415894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:26.675170 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55732aaa-77d1-4924-8f4c-dd3213415894 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:26.675564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55732aaa-77d1-4924-8f4c-dd3213415894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:26.675910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55732aaa-77d1-4924-8f4c-dd3213415894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:26.677570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55732aaa-77d1-4924-8f4c-dd3213415894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:26.679874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 944/1846] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:26.682368 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7e59a-f56a-4db9-a27e-1cdcfcc3d3c9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:26.683803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55732aaa-77d1-4924-8f4c-dd3213415894 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:26.702362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 903/1847] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:26.711480 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc7e59a-f56a-4db9-a27e-1cdcfcc3d3c9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:26.712265 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55732aaa-77d1-4924-8f4c-dd3213415894 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:26.732077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc8062-e065-49c7-bac9-f9d64a949971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:26.735988 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc8062-e065-49c7-bac9-f9d64a949971 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:26.736460 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc8062-e065-49c7-bac9-f9d64a949971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:26.736943 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc8062-e065-49c7-bac9-f9d64a949971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:26.738288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc8062-e065-49c7-bac9-f9d64a949971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:26.739297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55732aaa-77d1-4924-8f4c-dd3213415894 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:26.741564 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc8062-e065-49c7-bac9-f9d64a949971 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:26.747450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970edc-57f7-41bf-9da1-a469130f87e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:26.749017 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970edc-57f7-41bf-9da1-a469130f87e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:26.749729 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970edc-57f7-41bf-9da1-a469130f87e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:26.750297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb970edc-57f7-41bf-9da1-a469130f87e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:26.752488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb970edc-57f7-41bf-9da1-a469130f87e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:26.756133 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb970edc-57f7-41bf-9da1-a469130f87e5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:26.774608 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 945/1848] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:26.774608 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc8062-e065-49c7-bac9-f9d64a949971 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:26.779069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 904/1849] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:26.781485 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970edc-57f7-41bf-9da1-a469130f87e5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:26.793856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc8062-e065-49c7-bac9-f9d64a949971 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:26.804083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3e082-099f-43a5-acd5-9bfd26f3a33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:26.806161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3e082-099f-43a5-acd5-9bfd26f3a33a admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:26.806855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3e082-099f-43a5-acd5-9bfd26f3a33a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:26.807313 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3e082-099f-43a5-acd5-9bfd26f3a33a admin admin] PATH_INFO: `/v3/projects/33bd6a273259429d88c6104b84750718/users/026bc000cf784fe2b8a76fa68db9b919/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:26.813532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb970edc-57f7-41bf-9da1-a469130f87e5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:26.833966 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd29a5d-0efa-4fd7-870b-9372e89ca7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:26.836103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd29a5d-0efa-4fd7-870b-9372e89ca7e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:26.836367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3e082-099f-43a5-acd5-9bfd26f3a33a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33bd6a273259429d88c6104b84750718, user_id=026bc000cf784fe2b8a76fa68db9b919, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:26.837784 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd29a5d-0efa-4fd7-870b-9372e89ca7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:26.838423 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd29a5d-0efa-4fd7-870b-9372e89ca7e6 admin admin] PATH_INFO: `/v3/projects/f2def50462ba4efcbdc05e343c5f541f/users/260c5bf223a44bb28867676a152814d2/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:26.842384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3e082-099f-43a5-acd5-9bfd26f3a33a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:26.867174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 946/1850] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:26 2022] PUT /identity/v3/projects/33bd6a273259429d88c6104b84750718/users/026bc000cf784fe2b8a76fa68db9b919/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:26.868714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3e082-099f-43a5-acd5-9bfd26f3a33a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:26.883833 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd29a5d-0efa-4fd7-870b-9372e89ca7e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2def50462ba4efcbdc05e343c5f541f, user_id=260c5bf223a44bb28867676a152814d2, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:26.885487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:26.892607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd29a5d-0efa-4fd7-870b-9372e89ca7e6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:26.922643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 905/1851] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:26 2022] PUT /identity/v3/projects/f2def50462ba4efcbdc05e343c5f541f/users/260c5bf223a44bb28867676a152814d2/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:26.923616 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd29a5d-0efa-4fd7-870b-9372e89ca7e6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:27.053513 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3e082-099f-43a5-acd5-9bfd26f3a33a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:27.096518 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd29a5d-0efa-4fd7-870b-9372e89ca7e6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:27.109926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef1bb0a-304b-48c6-a054-94b14046991f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:27.119622 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1bb0a-304b-48c6-a054-94b14046991f admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:27.119898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1bb0a-304b-48c6-a054-94b14046991f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:27.120191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1bb0a-304b-48c6-a054-94b14046991f admin admin] PATH_INFO: `/v3/projects/4b97db2d6d3149529809a7b3ad6d0e72/users/def143e0f9ca483b9c009de2bbae1493/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:27.164833 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1bb0a-304b-48c6-a054-94b14046991f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b97db2d6d3149529809a7b3ad6d0e72, user_id=def143e0f9ca483b9c009de2bbae1493, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:27.169541 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05749292-5346-49b0-8396-4d7585c788b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:27.170480 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05749292-5346-49b0-8396-4d7585c788b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:27.170937 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05749292-5346-49b0-8396-4d7585c788b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:27.171324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05749292-5346-49b0-8396-4d7585c788b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:27.172209 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05749292-5346-49b0-8396-4d7585c788b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:27.174062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05749292-5346-49b0-8396-4d7585c788b9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:27.186557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef1bb0a-304b-48c6-a054-94b14046991f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:27.188690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 947/1852] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:27.196323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935b3cf-5850-4562-8afb-325370ec3c19 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:27.196771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935b3cf-5850-4562-8afb-325370ec3c19 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:27.197344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935b3cf-5850-4562-8afb-325370ec3c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:27.219637 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 906/1853] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:26 2022] PUT /identity/v3/projects/4b97db2d6d3149529809a7b3ad6d0e72/users/def143e0f9ca483b9c009de2bbae1493/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:27.221719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64a8a0-a0ee-431f-a824-6bed23226cd7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:27.222007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64a8a0-a0ee-431f-a824-6bed23226cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:27.222283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64a8a0-a0ee-431f-a824-6bed23226cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:27.262309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4b64a8a0-a0ee-431f-a824-6bed23226cd7 None None] MFA Rules not processed for user `260c5bf223a44bb28867676a152814d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:27.263657 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4b64a8a0-a0ee-431f-a824-6bed23226cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:27.283978 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7935b3cf-5850-4562-8afb-325370ec3c19 None None] MFA Rules not processed for user `026bc000cf784fe2b8a76fa68db9b919`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:27.286003 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7935b3cf-5850-4562-8afb-325370ec3c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:27.312417 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:27.413598 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 907/1854] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:27 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:27.413598 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64a8a0-a0ee-431f-a824-6bed23226cd7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:27.478635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 948/1855] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:27.480256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935b3cf-5850-4562-8afb-325370ec3c19 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:27.597735 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:27.610707 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64a8a0-a0ee-431f-a824-6bed23226cd7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:27.625159 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f44ab-5209-4a37-bf14-02a54fe434ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:27.626098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f44ab-5209-4a37-bf14-02a54fe434ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:27.626378 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f44ab-5209-4a37-bf14-02a54fe434ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:27.626657 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f44ab-5209-4a37-bf14-02a54fe434ce admin admin] PATH_INFO: `/v3/projects/6347e9f87170470997861b8a92e15f7e/users/4f25e615987e418480eac5344d7a325a/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:27.632013 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935b3cf-5850-4562-8afb-325370ec3c19 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:27.637954 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7625d9f-cb9e-4f89-bdc4-4502ef3e2f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:27.638990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625d9f-cb9e-4f89-bdc4-4502ef3e2f23 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:27.639417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625d9f-cb9e-4f89-bdc4-4502ef3e2f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:27.639832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7625d9f-cb9e-4f89-bdc4-4502ef3e2f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:27.642598 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7625d9f-cb9e-4f89-bdc4-4502ef3e2f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:27.645098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7625d9f-cb9e-4f89-bdc4-4502ef3e2f23 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:27.657988 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f44ab-5209-4a37-bf14-02a54fe434ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6347e9f87170470997861b8a92e15f7e, user_id=4f25e615987e418480eac5344d7a325a, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:27.662896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f44ab-5209-4a37-bf14-02a54fe434ce admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:27.668883 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 949/1856] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:27.668883 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7625d9f-cb9e-4f89-bdc4-4502ef3e2f23 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:27.688650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 908/1857] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:27 2022] PUT /identity/v3/projects/6347e9f87170470997861b8a92e15f7e/users/4f25e615987e418480eac5344d7a325a/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:27.691639 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f44ab-5209-4a37-bf14-02a54fe434ce admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:27.695166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7625d9f-cb9e-4f89-bdc4-4502ef3e2f23 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:27.803486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f44ab-5209-4a37-bf14-02a54fe434ce admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:27.808002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb86ca-9643-499c-a678-b00fb05a03d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:27.808802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb86ca-9643-499c-a678-b00fb05a03d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:27.809100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb86ca-9643-499c-a678-b00fb05a03d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:27.809390 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb86ca-9643-499c-a678-b00fb05a03d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:27.810260 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeade3d-f9d1-4215-9364-d679c901c9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:27.810471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb86ca-9643-499c-a678-b00fb05a03d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:27.812052 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeade3d-f9d1-4215-9364-d679c901c9ae admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:27.812462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeade3d-f9d1-4215-9364-d679c901c9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:27.812862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeade3d-f9d1-4215-9364-d679c901c9ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:27.813202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afb86ca-9643-499c-a678-b00fb05a03d5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:27.813813 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeade3d-f9d1-4215-9364-d679c901c9ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:27.816207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeade3d-f9d1-4215-9364-d679c901c9ae admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:27.854064 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 950/1858] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:27 2022] POST /identity/v3/projects => generated 357 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:27.854064 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb86ca-9643-499c-a678-b00fb05a03d5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:27.861512 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 909/1859] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:27 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:27.861512 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef470-266f-42cc-9833-0db057683efa None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:27.861925 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef470-266f-42cc-9833-0db057683efa None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:27.862308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef470-266f-42cc-9833-0db057683efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:27.919413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ef8ef470-266f-42cc-9833-0db057683efa None None] MFA Rules not processed for user `4f25e615987e418480eac5344d7a325a`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:27.920842 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ef8ef470-266f-42cc-9833-0db057683efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:27.946670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:27.956243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb86ca-9643-499c-a678-b00fb05a03d5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:27.998612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 910/1860] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:27 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:27.999385 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef470-266f-42cc-9833-0db057683efa None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:28.035252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b19d0-9a0e-4767-b5b9-ba24212aaa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:28.037713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b19d0-9a0e-4767-b5b9-ba24212aaa79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:28.039638 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b19d0-9a0e-4767-b5b9-ba24212aaa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:28.040498 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b19d0-9a0e-4767-b5b9-ba24212aaa79 admin admin] PATH_INFO: `/v3/projects/4b97db2d6d3149529809a7b3ad6d0e72/users/def143e0f9ca483b9c009de2bbae1493/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:28.047715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b19d0-9a0e-4767-b5b9-ba24212aaa79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b97db2d6d3149529809a7b3ad6d0e72, user_id=def143e0f9ca483b9c009de2bbae1493, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:28.053669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b19d0-9a0e-4767-b5b9-ba24212aaa79 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:28.070575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:28.076484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 951/1861] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:27 2022] PUT /identity/v3/projects/4b97db2d6d3149529809a7b3ad6d0e72/users/def143e0f9ca483b9c009de2bbae1493/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:28.086183 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b19d0-9a0e-4767-b5b9-ba24212aaa79 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:28.108774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef470-266f-42cc-9833-0db057683efa None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:28.185777 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9609678-0186-414f-9635-5dac13f1307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:28.186845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609678-0186-414f-9635-5dac13f1307a admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:28.187165 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609678-0186-414f-9635-5dac13f1307a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:28.187530 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9609678-0186-414f-9635-5dac13f1307a admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:28.188321 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9609678-0186-414f-9635-5dac13f1307a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:28.190390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9609678-0186-414f-9635-5dac13f1307a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:28.205637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b19d0-9a0e-4767-b5b9-ba24212aaa79 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:28.218205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731ac11-7b12-4ed7-b405-bb0d8947b22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:28.219220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731ac11-7b12-4ed7-b405-bb0d8947b22b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:28.219891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731ac11-7b12-4ed7-b405-bb0d8947b22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:28.220372 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731ac11-7b12-4ed7-b405-bb0d8947b22b admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:28.221578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731ac11-7b12-4ed7-b405-bb0d8947b22b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:28.226993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 911/1862] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:27 2022] POST /identity/v3/users => generated 285 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:28.227157 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731ac11-7b12-4ed7-b405-bb0d8947b22b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:28.227233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9609678-0186-414f-9635-5dac13f1307a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:28.244032 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9609678-0186-414f-9635-5dac13f1307a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:28.251709 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688623c-4db1-4f79-a960-935328b64a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:28.252768 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688623c-4db1-4f79-a960-935328b64a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:28.253202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688623c-4db1-4f79-a960-935328b64a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:28.253628 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688623c-4db1-4f79-a960-935328b64a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:28.254809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688623c-4db1-4f79-a960-935328b64a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:28.258251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688623c-4db1-4f79-a960-935328b64a4e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:28.258862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 952/1863] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:28 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:28.265529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794b741-34c8-4ab9-b4cb-4aab1fc3b7bb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:28.266136 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794b741-34c8-4ab9-b4cb-4aab1fc3b7bb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:28.266770 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d794b741-34c8-4ab9-b4cb-4aab1fc3b7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:28.294957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 912/1864] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:28 2022] POST /identity/v3/projects => generated 405 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:28.296178 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688623c-4db1-4f79-a960-935328b64a4e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:28.304608 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d794b741-34c8-4ab9-b4cb-4aab1fc3b7bb None None] MFA Rules not processed for user `def143e0f9ca483b9c009de2bbae1493`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:28.306241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d794b741-34c8-4ab9-b4cb-4aab1fc3b7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:28.355463 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:28.394055 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688623c-4db1-4f79-a960-935328b64a4e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:28.403162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe25b90-3d66-4e25-83c6-d17c251f2bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:28.404148 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe25b90-3d66-4e25-83c6-d17c251f2bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:28.404613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe25b90-3d66-4e25-83c6-d17c251f2bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:28.405065 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe25b90-3d66-4e25-83c6-d17c251f2bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:28.406317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe25b90-3d66-4e25-83c6-d17c251f2bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:28.409842 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe25b90-3d66-4e25-83c6-d17c251f2bb6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:28.425730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 953/1865] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:28.427358 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794b741-34c8-4ab9-b4cb-4aab1fc3b7bb None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:28.439712 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 913/1866] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:28.439712 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe25b90-3d66-4e25-83c6-d17c251f2bb6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:28.456181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe25b90-3d66-4e25-83c6-d17c251f2bb6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:28.460392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d794b741-34c8-4ab9-b4cb-4aab1fc3b7bb None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:28.464320 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fb56f-3537-4b92-97f7-ca6ca7ca258e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:28.465411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fb56f-3537-4b92-97f7-ca6ca7ca258e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:28.465903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fb56f-3537-4b92-97f7-ca6ca7ca258e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:28.466362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fb56f-3537-4b92-97f7-ca6ca7ca258e admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:28.467851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fb56f-3537-4b92-97f7-ca6ca7ca258e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:28.470387 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06e529-f40c-4766-acc0-d07fb74b3059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:28.471316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fb56f-3537-4b92-97f7-ca6ca7ca258e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:28.471713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06e529-f40c-4766-acc0-d07fb74b3059 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:28.472168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06e529-f40c-4766-acc0-d07fb74b3059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:28.472618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06e529-f40c-4766-acc0-d07fb74b3059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:28.474870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06e529-f40c-4766-acc0-d07fb74b3059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:28.477865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06e529-f40c-4766-acc0-d07fb74b3059 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:28.502129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 954/1867] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:28.503559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06e529-f40c-4766-acc0-d07fb74b3059 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:28.508960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 914/1868] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:28 2022] POST /identity/v3/users => generated 309 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:28.510412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fb56f-3537-4b92-97f7-ca6ca7ca258e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:28.512989 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d06fb56f-3537-4b92-97f7-ca6ca7ca258e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:28.522746 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06e529-f40c-4766-acc0-d07fb74b3059 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:28.529787 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65abc27-c974-4efb-aa20-e010158df273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:28.531179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65abc27-c974-4efb-aa20-e010158df273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:28.531988 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65abc27-c974-4efb-aa20-e010158df273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:28.532469 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65abc27-c974-4efb-aa20-e010158df273 admin admin] PATH_INFO: `/v3/projects/f4f16242b06c4ef5b6075e3e4a51fb92/users/bbe8bfaa89fd4b3f801fad7dc5cb1246/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:28.559522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65abc27-c974-4efb-aa20-e010158df273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f16242b06c4ef5b6075e3e4a51fb92, user_id=bbe8bfaa89fd4b3f801fad7dc5cb1246, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:28.563111 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65abc27-c974-4efb-aa20-e010158df273 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:28.591801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 955/1869] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:28 2022] PUT /identity/v3/projects/f4f16242b06c4ef5b6075e3e4a51fb92/users/bbe8bfaa89fd4b3f801fad7dc5cb1246/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:28.593363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65abc27-c974-4efb-aa20-e010158df273 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:28.637072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fb56f-3537-4b92-97f7-ca6ca7ca258e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:28.651738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:28.690146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65abc27-c974-4efb-aa20-e010158df273 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:28.703212 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6e9fd-1954-41f8-9c12-e8a194bfcefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:28.705740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6e9fd-1954-41f8-9c12-e8a194bfcefe admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:28.706079 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6e9fd-1954-41f8-9c12-e8a194bfcefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:28.706471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6e9fd-1954-41f8-9c12-e8a194bfcefe admin admin] PATH_INFO: `/v3/projects/bbc04d97037147ad90a17debae245e19/users/86dce844cdeb47fab7182474cb2b3e0c/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:28.744223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6e9fd-1954-41f8-9c12-e8a194bfcefe admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbc04d97037147ad90a17debae245e19, user_id=86dce844cdeb47fab7182474cb2b3e0c, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:28.749791 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6e9fd-1954-41f8-9c12-e8a194bfcefe admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:28.759936 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee74206-7054-4ff1-adab-5b23c4c03d93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:28.760722 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee74206-7054-4ff1-adab-5b23c4c03d93 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:28.761211 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee74206-7054-4ff1-adab-5b23c4c03d93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:28.761674 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee74206-7054-4ff1-adab-5b23c4c03d93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:28.776789 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 956/1870] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:28 2022] PUT /identity/v3/projects/bbc04d97037147ad90a17debae245e19/users/86dce844cdeb47fab7182474cb2b3e0c/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:28.776789 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6e9fd-1954-41f8-9c12-e8a194bfcefe admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:28.870872 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6e9fd-1954-41f8-9c12-e8a194bfcefe admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:28.881646 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee74206-7054-4ff1-adab-5b23c4c03d93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:28.882119 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d962ad3-641c-4f31-9eb5-7f76587b549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:28.883620 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee74206-7054-4ff1-adab-5b23c4c03d93 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:28.884434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d962ad3-641c-4f31-9eb5-7f76587b549d admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:28.885506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d962ad3-641c-4f31-9eb5-7f76587b549d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:28.886230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d962ad3-641c-4f31-9eb5-7f76587b549d admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:28.900638 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d962ad3-641c-4f31-9eb5-7f76587b549d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:28.901379 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 915/1871] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:28.902695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee74206-7054-4ff1-adab-5b23c4c03d93 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:28.917952 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d962ad3-641c-4f31-9eb5-7f76587b549d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:28.926237 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee74206-7054-4ff1-adab-5b23c4c03d93 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:28.936697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735fe5b-8834-4739-8b8e-e1e4631f4158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:28.938211 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735fe5b-8834-4739-8b8e-e1e4631f4158 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:28.938796 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735fe5b-8834-4739-8b8e-e1e4631f4158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:28.939394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735fe5b-8834-4739-8b8e-e1e4631f4158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:28.941087 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735fe5b-8834-4739-8b8e-e1e4631f4158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:28.945262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735fe5b-8834-4739-8b8e-e1e4631f4158 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:28.969750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 957/1872] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:28.969750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d962ad3-641c-4f31-9eb5-7f76587b549d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:28.972552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 916/1873] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:28.974243 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735fe5b-8834-4739-8b8e-e1e4631f4158 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:29.005836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735fe5b-8834-4739-8b8e-e1e4631f4158 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:29.024563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d962ad3-641c-4f31-9eb5-7f76587b549d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:29.033243 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205e2ca-2e35-45bf-a1f4-b0fac9c468a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:29.037524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205e2ca-2e35-45bf-a1f4-b0fac9c468a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:29.037934 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205e2ca-2e35-45bf-a1f4-b0fac9c468a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:29.038122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205e2ca-2e35-45bf-a1f4-b0fac9c468a9 admin admin] PATH_INFO: `/v3/projects/be3b8a8b3e6d43e0b167436c6b5e0ca4/users/7001574b9171484f9275047c57a4bf3d/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:29.059958 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a00f2-272f-4008-9f70-9dfd201f6869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:29.060665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a00f2-272f-4008-9f70-9dfd201f6869 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:29.060949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a00f2-272f-4008-9f70-9dfd201f6869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:29.061224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a00f2-272f-4008-9f70-9dfd201f6869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:29.061984 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a00f2-272f-4008-9f70-9dfd201f6869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:29.063684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a00f2-272f-4008-9f70-9dfd201f6869 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:29.087452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 958/1874] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:28 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:29.087452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a00f2-272f-4008-9f70-9dfd201f6869 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:29.088402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:29.104506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205e2ca-2e35-45bf-a1f4-b0fac9c468a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3b8a8b3e6d43e0b167436c6b5e0ca4, user_id=7001574b9171484f9275047c57a4bf3d, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:29.105740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a00f2-272f-4008-9f70-9dfd201f6869 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:29.110787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205e2ca-2e35-45bf-a1f4-b0fac9c468a9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:29.111609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a028df-fe8c-42e8-bc0d-53811699ab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:29.112659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a028df-fe8c-42e8-bc0d-53811699ab70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:29.113088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a028df-fe8c-42e8-bc0d-53811699ab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:29.113469 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a028df-fe8c-42e8-bc0d-53811699ab70 admin admin] PATH_INFO: `/v3/projects/f4f16242b06c4ef5b6075e3e4a51fb92/users/bbe8bfaa89fd4b3f801fad7dc5cb1246/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:29.117034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a028df-fe8c-42e8-bc0d-53811699ab70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f16242b06c4ef5b6075e3e4a51fb92, user_id=bbe8bfaa89fd4b3f801fad7dc5cb1246, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:29.120810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a028df-fe8c-42e8-bc0d-53811699ab70 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:29.158081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 959/1875] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:29 2022] PUT /identity/v3/projects/f4f16242b06c4ef5b6075e3e4a51fb92/users/bbe8bfaa89fd4b3f801fad7dc5cb1246/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:29.158081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a028df-fe8c-42e8-bc0d-53811699ab70 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:29.158386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 917/1876] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:28 2022] PUT /identity/v3/projects/be3b8a8b3e6d43e0b167436c6b5e0ca4/users/7001574b9171484f9275047c57a4bf3d/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:29.158482 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f8a028df-fe8c-42e8-bc0d-53811699ab70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:29.159870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205e2ca-2e35-45bf-a1f4-b0fac9c468a9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:29.368830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a028df-fe8c-42e8-bc0d-53811699ab70 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:29.391028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205e2ca-2e35-45bf-a1f4-b0fac9c468a9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:29.398637 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e24cf6-50ec-4f5d-88de-5c7e87cb38fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:29.400302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e24cf6-50ec-4f5d-88de-5c7e87cb38fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:29.400644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e24cf6-50ec-4f5d-88de-5c7e87cb38fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:29.400923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e24cf6-50ec-4f5d-88de-5c7e87cb38fe admin admin] PATH_INFO: `/v3/projects/bbc04d97037147ad90a17debae245e19/users/86dce844cdeb47fab7182474cb2b3e0c/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:29.404112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e24cf6-50ec-4f5d-88de-5c7e87cb38fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbc04d97037147ad90a17debae245e19, user_id=86dce844cdeb47fab7182474cb2b3e0c, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:29.408623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e24cf6-50ec-4f5d-88de-5c7e87cb38fe admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:29.478453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 918/1877] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:29 2022] PUT /identity/v3/projects/bbc04d97037147ad90a17debae245e19/users/86dce844cdeb47fab7182474cb2b3e0c/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:29.480594 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e24cf6-50ec-4f5d-88de-5c7e87cb38fe admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:29.507148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f851f3d-39b9-4ac5-9a47-7b63197f1602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:29.508726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f851f3d-39b9-4ac5-9a47-7b63197f1602 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:29.509484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f851f3d-39b9-4ac5-9a47-7b63197f1602 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:29.509932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f851f3d-39b9-4ac5-9a47-7b63197f1602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:29.515483 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:29.617896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e24cf6-50ec-4f5d-88de-5c7e87cb38fe admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:29.618213 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f851f3d-39b9-4ac5-9a47-7b63197f1602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:29.619701 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f851f3d-39b9-4ac5-9a47-7b63197f1602 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:29.623186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f7633-e8f3-4b51-965a-67cb248a41f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:29.623924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f7633-e8f3-4b51-965a-67cb248a41f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:29.624178 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f7633-e8f3-4b51-965a-67cb248a41f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:29.624465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f7633-e8f3-4b51-965a-67cb248a41f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:29.625205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f7633-e8f3-4b51-965a-67cb248a41f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:29.626928 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f7633-e8f3-4b51-965a-67cb248a41f8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:29.636837 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 960/1878] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:29.638799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 919/1879] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:29.639955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569683e1-3968-44d2-b598-681c70ae3db0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:29.640246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4c108-e94c-434c-bdd7-950c26809d7a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:29.640537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4c108-e94c-434c-bdd7-950c26809d7a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:29.640817 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4c108-e94c-434c-bdd7-950c26809d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:29.641036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569683e1-3968-44d2-b598-681c70ae3db0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:29.641502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569683e1-3968-44d2-b598-681c70ae3db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:29.704897 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-569683e1-3968-44d2-b598-681c70ae3db0 None None] MFA Rules not processed for user `bbe8bfaa89fd4b3f801fad7dc5cb1246`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:29.708609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-569683e1-3968-44d2-b598-681c70ae3db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:29.710758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f2a4c108-e94c-434c-bdd7-950c26809d7a None None] MFA Rules not processed for user `86dce844cdeb47fab7182474cb2b3e0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:29.715337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f2a4c108-e94c-434c-bdd7-950c26809d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:29.863354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 920/1880] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:29.864701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4c108-e94c-434c-bdd7-950c26809d7a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:29.875406 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:29.902761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4c108-e94c-434c-bdd7-950c26809d7a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:29.917918 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7a40b-7deb-4446-8f30-e895ad3e1203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:29.919290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7a40b-7deb-4446-8f30-e895ad3e1203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:29.919760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7a40b-7deb-4446-8f30-e895ad3e1203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:29.920044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d7a40b-7deb-4446-8f30-e895ad3e1203 admin admin] PATH_INFO: `/v3/projects/be3b8a8b3e6d43e0b167436c6b5e0ca4/users/7001574b9171484f9275047c57a4bf3d/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:29.925843 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7a40b-7deb-4446-8f30-e895ad3e1203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be3b8a8b3e6d43e0b167436c6b5e0ca4, user_id=7001574b9171484f9275047c57a4bf3d, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:29.928712 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d7a40b-7deb-4446-8f30-e895ad3e1203 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:29.966277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 921/1881] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:29 2022] PUT /identity/v3/projects/be3b8a8b3e6d43e0b167436c6b5e0ca4/users/7001574b9171484f9275047c57a4bf3d/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:29.975461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 961/1882] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:29 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:29.979740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7a40b-7deb-4446-8f30-e895ad3e1203 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:29.979979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef22a2-66b8-44d8-9f5f-a16fadebee7e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:29.980128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef22a2-66b8-44d8-9f5f-a16fadebee7e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:29.980417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef22a2-66b8-44d8-9f5f-a16fadebee7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:30.028131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ccef22a2-66b8-44d8-9f5f-a16fadebee7e None None] MFA Rules not processed for user `7001574b9171484f9275047c57a4bf3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:30.029526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ccef22a2-66b8-44d8-9f5f-a16fadebee7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:30.070540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d7a40b-7deb-4446-8f30-e895ad3e1203 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:30.077514 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f120f-71bc-41b4-a372-06f6a92f8038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:30.078193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f120f-71bc-41b4-a372-06f6a92f8038 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:30.078472 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f120f-71bc-41b4-a372-06f6a92f8038 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:30.078745 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f120f-71bc-41b4-a372-06f6a92f8038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:30.121259 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 962/1883] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:29 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:30.122197 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef22a2-66b8-44d8-9f5f-a16fadebee7e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:30.139189 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef22a2-66b8-44d8-9f5f-a16fadebee7e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:30.147174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669ce01-84ee-4069-8986-299999b3f945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:30.148383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669ce01-84ee-4069-8986-299999b3f945 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:30.148889 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669ce01-84ee-4069-8986-299999b3f945 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:30.149374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669ce01-84ee-4069-8986-299999b3f945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:30.176169 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:30.177654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f120f-71bc-41b4-a372-06f6a92f8038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:30.179715 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f120f-71bc-41b4-a372-06f6a92f8038 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:30.201555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 922/1884] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:30.227558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f120f-71bc-41b4-a372-06f6a92f8038 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:30.249971 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f120f-71bc-41b4-a372-06f6a92f8038 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:30.261504 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2753128-148b-42fd-bd12-e3e79217a19c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:30.262296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2753128-148b-42fd-bd12-e3e79217a19c service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:30.262611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2753128-148b-42fd-bd12-e3e79217a19c service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:30.262889 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2753128-148b-42fd-bd12-e3e79217a19c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:30.280861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2753128-148b-42fd-bd12-e3e79217a19c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:30.285179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2753128-148b-42fd-bd12-e3e79217a19c service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:30.298460 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669ce01-84ee-4069-8986-299999b3f945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:30.301047 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669ce01-84ee-4069-8986-299999b3f945 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:30.310565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 923/1885] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:30 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:30.314858 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 963/1886] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:30 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:30.482540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2753128-148b-42fd-bd12-e3e79217a19c service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:30.495423 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2753128-148b-42fd-bd12-e3e79217a19c service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:30.508837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35fb05-856a-4a91-b155-718c4a97bf67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:30.509542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35fb05-856a-4a91-b155-718c4a97bf67 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:30.509829 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35fb05-856a-4a91-b155-718c4a97bf67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:30.510106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35fb05-856a-4a91-b155-718c4a97bf67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:30.582801 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35fb05-856a-4a91-b155-718c4a97bf67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:30.584345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35fb05-856a-4a91-b155-718c4a97bf67 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:30.602854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 924/1887] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:30 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:30.644929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669ce01-84ee-4069-8986-299999b3f945 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:30.660238 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669ce01-84ee-4069-8986-299999b3f945 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:30.668584 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440215fb-752c-4c5c-a86c-5575fb06a882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:30.669751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440215fb-752c-4c5c-a86c-5575fb06a882 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:30.670286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440215fb-752c-4c5c-a86c-5575fb06a882 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:30.670855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440215fb-752c-4c5c-a86c-5575fb06a882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:30.790896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440215fb-752c-4c5c-a86c-5575fb06a882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:30.793760 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440215fb-752c-4c5c-a86c-5575fb06a882 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:30.813109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 964/1888] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:30 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:30.826067 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35fb05-856a-4a91-b155-718c4a97bf67 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:30.850110 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35fb05-856a-4a91-b155-718c4a97bf67 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:30.858398 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d564e-e5fb-4923-966f-ea902205d6be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:30.860061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d564e-e5fb-4923-966f-ea902205d6be service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:30.860620 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d564e-e5fb-4923-966f-ea902205d6be service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:30.861097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d564e-e5fb-4923-966f-ea902205d6be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:30.921061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:31.031530 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d564e-e5fb-4923-966f-ea902205d6be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:31.034391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d564e-e5fb-4923-966f-ea902205d6be service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:31.068208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 925/1889] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:33.199162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707b2cb-4e8c-44dd-9c29-1889359dae81 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:33.199975 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707b2cb-4e8c-44dd-9c29-1889359dae81 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:33.199975 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707b2cb-4e8c-44dd-9c29-1889359dae81 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:33.202746 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 965/1890] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 16:06:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:06:33.225294 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45b1fd-881a-4390-864f-4e4e4b63dfea None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:33.226164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45b1fd-881a-4390-864f-4e4e4b63dfea None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:33.226592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45b1fd-881a-4390-864f-4e4e4b63dfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:33.249187 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5b45b1fd-881a-4390-864f-4e4e4b63dfea None None] MFA Rules not processed for user `e9a1ec1f6bb7467dbd63ad1da36d48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:33.250746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5b45b1fd-881a-4390-864f-4e4e4b63dfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:33.412580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 926/1891] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 16:06:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:06:33.608298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707b2cb-4e8c-44dd-9c29-1889359dae81 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:33.621449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d707b2cb-4e8c-44dd-9c29-1889359dae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:33.685518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707b2cb-4e8c-44dd-9c29-1889359dae81 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:33.702155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e0eea-8859-448c-ba0a-dbdecd302f33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:33.702155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e0eea-8859-448c-ba0a-dbdecd302f33 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:33.702155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e0eea-8859-448c-ba0a-dbdecd302f33 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:33.702155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e0eea-8859-448c-ba0a-dbdecd302f33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:33.721508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e0eea-8859-448c-ba0a-dbdecd302f33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:33.725484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e0eea-8859-448c-ba0a-dbdecd302f33 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:33.747371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 966/1892] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:35.002518 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45b1fd-881a-4390-864f-4e4e4b63dfea None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:35.110749 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45b1fd-881a-4390-864f-4e4e4b63dfea None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:35.118010 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143a60f-8854-4f46-baba-96804bec6817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:35.120048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143a60f-8854-4f46-baba-96804bec6817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:35.120321 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143a60f-8854-4f46-baba-96804bec6817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:35.121355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143a60f-8854-4f46-baba-96804bec6817 admin admin] PATH_INFO: `/v3/users/026bc000cf784fe2b8a76fa68db9b919` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:35.123585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143a60f-8854-4f46-baba-96804bec6817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=026bc000cf784fe2b8a76fa68db9b919)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:35.127126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143a60f-8854-4f46-baba-96804bec6817 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:35.218728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3143a60f-8854-4f46-baba-96804bec6817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026bc000cf784fe2b8a76fa68db9b919'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:35.227685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3143a60f-8854-4f46-baba-96804bec6817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026bc000cf784fe2b8a76fa68db9b919'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:35.229728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:35.242064 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3143a60f-8854-4f46-baba-96804bec6817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026bc000cf784fe2b8a76fa68db9b919'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:35.243183 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3143a60f-8854-4f46-baba-96804bec6817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026bc000cf784fe2b8a76fa68db9b919'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:35.243939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3143a60f-8854-4f46-baba-96804bec6817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026bc000cf784fe2b8a76fa68db9b919'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:35.280836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 927/1893] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:35 2022] DELETE /identity/v3/users/026bc000cf784fe2b8a76fa68db9b919 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:35.283624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e1f2c-6851-4d57-b6a5-f425904d0d4e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:35.284910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e1f2c-6851-4d57-b6a5-f425904d0d4e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:35.285409 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e1f2c-6851-4d57-b6a5-f425904d0d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:35.310200 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-bc0e1f2c-6851-4d57-b6a5-f425904d0d4e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:35.311615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bc0e1f2c-6851-4d57-b6a5-f425904d0d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:35.414932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 967/1894] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:35.426166 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143a60f-8854-4f46-baba-96804bec6817 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:35.431296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3143a60f-8854-4f46-baba-96804bec6817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:35.549523 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143a60f-8854-4f46-baba-96804bec6817 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:35.554721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93da63f-4f43-428a-a47d-be921fbff50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:35.555351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93da63f-4f43-428a-a47d-be921fbff50c service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:35.555351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93da63f-4f43-428a-a47d-be921fbff50c service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:35.555804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93da63f-4f43-428a-a47d-be921fbff50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:35.575029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93da63f-4f43-428a-a47d-be921fbff50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:35.576533 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93da63f-4f43-428a-a47d-be921fbff50c service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:35.592110 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 928/1895] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:06:36.286854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e1f2c-6851-4d57-b6a5-f425904d0d4e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:36.289836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bc0e1f2c-6851-4d57-b6a5-f425904d0d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:36.304365 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e1f2c-6851-4d57-b6a5-f425904d0d4e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:36.319651 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632e243-e7af-4c33-904b-b600343a6813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:36.321310 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632e243-e7af-4c33-904b-b600343a6813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:36.321780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632e243-e7af-4c33-904b-b600343a6813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:36.322216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c632e243-e7af-4c33-904b-b600343a6813 admin admin] PATH_INFO: `/v3/projects/33bd6a273259429d88c6104b84750718` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:36.323705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632e243-e7af-4c33-904b-b600343a6813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33bd6a273259429d88c6104b84750718)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:36.325856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c632e243-e7af-4c33-904b-b600343a6813 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:36.386402 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:36.408946 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c632e243-e7af-4c33-904b-b600343a6813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33bd6a273259429d88c6104b84750718', 'request_id': 'req-c632e243-e7af-4c33-904b-b600343a6813'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:36.419127 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c632e243-e7af-4c33-904b-b600343a6813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33bd6a273259429d88c6104b84750718', 'request_id': 'req-c632e243-e7af-4c33-904b-b600343a6813'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:36.433104 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c632e243-e7af-4c33-904b-b600343a6813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33bd6a273259429d88c6104b84750718', 'request_id': 'req-c632e243-e7af-4c33-904b-b600343a6813'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:36.451021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c632e243-e7af-4c33-904b-b600343a6813 admin admin] The token cache is being invalidate because project 33bd6a273259429d88c6104b84750718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:36.451344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c632e243-e7af-4c33-904b-b600343a6813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:36.452383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c632e243-e7af-4c33-904b-b600343a6813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:36.454223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 968/1896] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:36 2022] DELETE /identity/v3/projects/33bd6a273259429d88c6104b84750718 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:36.458753 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93da63f-4f43-428a-a47d-be921fbff50c service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:36.472772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93da63f-4f43-428a-a47d-be921fbff50c service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:36.549959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e034f-eee4-448d-ac9c-af36d08a3ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:36.551038 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e034f-eee4-448d-ac9c-af36d08a3ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:36.551392 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e034f-eee4-448d-ac9c-af36d08a3ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:36.551730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e034f-eee4-448d-ac9c-af36d08a3ec1 admin admin] PATH_INFO: `/v3/users/86dce844cdeb47fab7182474cb2b3e0c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:36.554642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e034f-eee4-448d-ac9c-af36d08a3ec1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86dce844cdeb47fab7182474cb2b3e0c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:36.557283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e034f-eee4-448d-ac9c-af36d08a3ec1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:36.616378 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-939e034f-eee4-448d-ac9c-af36d08a3ec1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86dce844cdeb47fab7182474cb2b3e0c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:36.625854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-939e034f-eee4-448d-ac9c-af36d08a3ec1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86dce844cdeb47fab7182474cb2b3e0c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:36.637722 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-939e034f-eee4-448d-ac9c-af36d08a3ec1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86dce844cdeb47fab7182474cb2b3e0c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:36.638557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-939e034f-eee4-448d-ac9c-af36d08a3ec1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86dce844cdeb47fab7182474cb2b3e0c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:36.639232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-939e034f-eee4-448d-ac9c-af36d08a3ec1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86dce844cdeb47fab7182474cb2b3e0c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:36.658520 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:36.674063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 929/1897] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:36 2022] DELETE /identity/v3/users/86dce844cdeb47fab7182474cb2b3e0c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:06:37.046721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632e243-e7af-4c33-904b-b600343a6813 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:37.050157 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c632e243-e7af-4c33-904b-b600343a6813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:37.081063 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c632e243-e7af-4c33-904b-b600343a6813 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:37.184554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d0d64-ff7c-4455-8248-53adf11dfa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:37.187267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d0d64-ff7c-4455-8248-53adf11dfa7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:37.187481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d0d64-ff7c-4455-8248-53adf11dfa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:37.187632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d0d64-ff7c-4455-8248-53adf11dfa7c admin admin] PATH_INFO: `/v3/projects/bbc04d97037147ad90a17debae245e19` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:37.189112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d0d64-ff7c-4455-8248-53adf11dfa7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbc04d97037147ad90a17debae245e19)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:37.191388 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d0d64-ff7c-4455-8248-53adf11dfa7c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:37.292924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c35d0d64-ff7c-4455-8248-53adf11dfa7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbc04d97037147ad90a17debae245e19', 'request_id': 'req-c35d0d64-ff7c-4455-8248-53adf11dfa7c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:37.304956 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c35d0d64-ff7c-4455-8248-53adf11dfa7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbc04d97037147ad90a17debae245e19', 'request_id': 'req-c35d0d64-ff7c-4455-8248-53adf11dfa7c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:37.314526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c35d0d64-ff7c-4455-8248-53adf11dfa7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbc04d97037147ad90a17debae245e19', 'request_id': 'req-c35d0d64-ff7c-4455-8248-53adf11dfa7c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:37.339659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c35d0d64-ff7c-4455-8248-53adf11dfa7c admin admin] The token cache is being invalidate because project bbc04d97037147ad90a17debae245e19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:37.340191 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c35d0d64-ff7c-4455-8248-53adf11dfa7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:37.341255 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c35d0d64-ff7c-4455-8248-53adf11dfa7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:37.343917 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 969/1898] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:37 2022] DELETE /identity/v3/projects/bbc04d97037147ad90a17debae245e19 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:37.348936 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743be029-6ced-4dcc-8a06-a5987f357bf2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:37.349233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743be029-6ced-4dcc-8a06-a5987f357bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:37.349508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743be029-6ced-4dcc-8a06-a5987f357bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:37.426089 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-743be029-6ced-4dcc-8a06-a5987f357bf2 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:37.427377 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-743be029-6ced-4dcc-8a06-a5987f357bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:37.457950 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d0d64-ff7c-4455-8248-53adf11dfa7c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:37.460609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c35d0d64-ff7c-4455-8248-53adf11dfa7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:37.563250 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:37.615869 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d0d64-ff7c-4455-8248-53adf11dfa7c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:37.651069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 930/1899] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:06:37.656831 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3832cc-29d0-47cb-ac08-5af738c68812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:37.663552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640e469-eb15-465f-a4c0-8b464601370e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:37.663845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640e469-eb15-465f-a4c0-8b464601370e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:37.664012 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3832cc-29d0-47cb-ac08-5af738c68812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:37.664411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640e469-eb15-465f-a4c0-8b464601370e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:37.664955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3832cc-29d0-47cb-ac08-5af738c68812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:37.665645 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3832cc-29d0-47cb-ac08-5af738c68812 admin admin] PATH_INFO: `/v3/users/4f25e615987e418480eac5344d7a325a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:37.670315 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3832cc-29d0-47cb-ac08-5af738c68812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f25e615987e418480eac5344d7a325a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:37.682232 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3832cc-29d0-47cb-ac08-5af738c68812 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:37.697561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e640e469-eb15-465f-a4c0-8b464601370e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:37.700647 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e640e469-eb15-465f-a4c0-8b464601370e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:37.743824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 931/1900] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:37.745116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640e469-eb15-465f-a4c0-8b464601370e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:37.766434 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640e469-eb15-465f-a4c0-8b464601370e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:37.779236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba511b-6a52-4b15-9bfc-e0e468294e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:37.782929 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba511b-6a52-4b15-9bfc-e0e468294e60 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:37.784260 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba511b-6a52-4b15-9bfc-e0e468294e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:37.786116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba511b-6a52-4b15-9bfc-e0e468294e60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:37.789168 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba511b-6a52-4b15-9bfc-e0e468294e60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:37.790506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba511b-6a52-4b15-9bfc-e0e468294e60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:37.794592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba511b-6a52-4b15-9bfc-e0e468294e60 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:37.796127 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5b3832cc-29d0-47cb-ac08-5af738c68812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f25e615987e418480eac5344d7a325a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:37.827341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5b3832cc-29d0-47cb-ac08-5af738c68812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f25e615987e418480eac5344d7a325a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:37.831958 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 932/1901] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:37.837271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba511b-6a52-4b15-9bfc-e0e468294e60 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:37.847425 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5b3832cc-29d0-47cb-ac08-5af738c68812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f25e615987e418480eac5344d7a325a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:37.848548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5b3832cc-29d0-47cb-ac08-5af738c68812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f25e615987e418480eac5344d7a325a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:37.863265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5b3832cc-29d0-47cb-ac08-5af738c68812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f25e615987e418480eac5344d7a325a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:37.871838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 970/1902] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:37 2022] DELETE /identity/v3/users/4f25e615987e418480eac5344d7a325a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:06:37.879927 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b44a5c-c700-45f7-ae60-da20722e4735 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:37.880714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b44a5c-c700-45f7-ae60-da20722e4735 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:37.883263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b44a5c-c700-45f7-ae60-da20722e4735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:37.889427 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba511b-6a52-4b15-9bfc-e0e468294e60 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:37.920007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a0b44a5c-c700-45f7-ae60-da20722e4735 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:37.921820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a0b44a5c-c700-45f7-ae60-da20722e4735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:38.015280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05d2f9-c575-4241-b142-01133a123e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:38.016502 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05d2f9-c575-4241-b142-01133a123e97 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:38.017075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05d2f9-c575-4241-b142-01133a123e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:38.017635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05d2f9-c575-4241-b142-01133a123e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:38.018957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05d2f9-c575-4241-b142-01133a123e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:38.021382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05d2f9-c575-4241-b142-01133a123e97 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:38.063177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 933/1903] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:37 2022] POST /identity/v3/projects => generated 383 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:38.063267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 971/1904] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:38.077545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05d2f9-c575-4241-b142-01133a123e97 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:38.077933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b44a5c-c700-45f7-ae60-da20722e4735 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:38.080235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a0b44a5c-c700-45f7-ae60-da20722e4735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:38.080875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0f05d2f9-c575-4241-b142-01133a123e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:38.171566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05d2f9-c575-4241-b142-01133a123e97 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:38.201425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2060f-eb0c-4d12-9d64-75b4283d0d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:38.203598 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2060f-eb0c-4d12-9d64-75b4283d0d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:38.203941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2060f-eb0c-4d12-9d64-75b4283d0d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:38.204156 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2060f-eb0c-4d12-9d64-75b4283d0d2e admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:38.206476 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2060f-eb0c-4d12-9d64-75b4283d0d2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:38.208531 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2060f-eb0c-4d12-9d64-75b4283d0d2e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:38.225773 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b44a5c-c700-45f7-ae60-da20722e4735 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:38.231975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:38.261879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 934/1905] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:38 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:38.262796 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2060f-eb0c-4d12-9d64-75b4283d0d2e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:38.286589 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2060f-eb0c-4d12-9d64-75b4283d0d2e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:38.294156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:38.302429 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49546a0b-e6e6-491a-950b-121e7fdbc777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:38.303226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49546a0b-e6e6-491a-950b-121e7fdbc777 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:38.303647 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49546a0b-e6e6-491a-950b-121e7fdbc777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:38.303932 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49546a0b-e6e6-491a-950b-121e7fdbc777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:38.304765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49546a0b-e6e6-491a-950b-121e7fdbc777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:38.306489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49546a0b-e6e6-491a-950b-121e7fdbc777 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:38.337593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 935/1906] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:38.341759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49546a0b-e6e6-491a-950b-121e7fdbc777 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:38.341944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e39f0-b284-4290-87b3-f4d166bea405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:38.343093 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e39f0-b284-4290-87b3-f4d166bea405 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:38.343390 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e39f0-b284-4290-87b3-f4d166bea405 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:38.343677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e39f0-b284-4290-87b3-f4d166bea405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:38.356980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e39f0-b284-4290-87b3-f4d166bea405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:38.358520 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e39f0-b284-4290-87b3-f4d166bea405 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:38.363236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49546a0b-e6e6-491a-950b-121e7fdbc777 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:38.373259 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211d94b1-59d3-489b-8fa7-c7ddc0939a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:38.373982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 972/1907] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:38.380787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d94b1-59d3-489b-8fa7-c7ddc0939a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:38.381227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d94b1-59d3-489b-8fa7-c7ddc0939a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:38.381473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211d94b1-59d3-489b-8fa7-c7ddc0939a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:38.382255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d94b1-59d3-489b-8fa7-c7ddc0939a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:38.383974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211d94b1-59d3-489b-8fa7-c7ddc0939a0c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:38.420217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 936/1908] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:06:38.422701 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e39f0-b284-4290-87b3-f4d166bea405 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:38.442618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e39f0-b284-4290-87b3-f4d166bea405 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:38.453142 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968c3e4-1053-4b73-bdad-4cf05b0196ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:38.454443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c3e4-1053-4b73-bdad-4cf05b0196ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:38.454443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c3e4-1053-4b73-bdad-4cf05b0196ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:38.454696 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c3e4-1053-4b73-bdad-4cf05b0196ba admin admin] PATH_INFO: `/v3/projects/bf0fd724541e440bb0702051ea8a6946/users/afd7f4f61cc24b5d8c9b76d2a2fe2457/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:38.493872 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968c3e4-1053-4b73-bdad-4cf05b0196ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0fd724541e440bb0702051ea8a6946, user_id=afd7f4f61cc24b5d8c9b76d2a2fe2457, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:38.501777 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968c3e4-1053-4b73-bdad-4cf05b0196ba admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:38.543585 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 973/1909] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:38 2022] PUT /identity/v3/projects/bf0fd724541e440bb0702051ea8a6946/users/afd7f4f61cc24b5d8c9b76d2a2fe2457/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:38.555510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce3c4f-39d3-4e38-a97a-3bfc2b7240bc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:38.557897 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce3c4f-39d3-4e38-a97a-3bfc2b7240bc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:38.559312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce3c4f-39d3-4e38-a97a-3bfc2b7240bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:38.608911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d9ce3c4f-39d3-4e38-a97a-3bfc2b7240bc None None] MFA Rules not processed for user `afd7f4f61cc24b5d8c9b76d2a2fe2457`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:38.610339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d9ce3c4f-39d3-4e38-a97a-3bfc2b7240bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:38.759410 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 937/1910] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:06:38.764509 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968c3e4-1053-4b73-bdad-4cf05b0196ba admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:38.956636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968c3e4-1053-4b73-bdad-4cf05b0196ba admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:38.970258 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c57144-d936-449e-a4f6-0f7b87922c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:38.970998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c57144-d936-449e-a4f6-0f7b87922c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:38.971428 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c57144-d936-449e-a4f6-0f7b87922c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:38.971632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c57144-d936-449e-a4f6-0f7b87922c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:38.972344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c57144-d936-449e-a4f6-0f7b87922c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:38.975840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c57144-d936-449e-a4f6-0f7b87922c6e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:39.033269 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 974/1911] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:38 2022] POST /identity/v3/projects => generated 379 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:06:39.033452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce3c4f-39d3-4e38-a97a-3bfc2b7240bc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:39.046954 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce3c4f-39d3-4e38-a97a-3bfc2b7240bc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:39.166229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8339d-6f55-4f78-9256-77fa712f86b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:39.167169 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8339d-6f55-4f78-9256-77fa712f86b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:39.168371 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8339d-6f55-4f78-9256-77fa712f86b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:39.168584 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c8339d-6f55-4f78-9256-77fa712f86b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:39.169639 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8339d-6f55-4f78-9256-77fa712f86b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:39.174781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c8339d-6f55-4f78-9256-77fa712f86b4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:39.180237 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c57144-d936-449e-a4f6-0f7b87922c6e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:39.183766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e1c57144-d936-449e-a4f6-0f7b87922c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:39.210522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c57144-d936-449e-a4f6-0f7b87922c6e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:39.241068 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95f8a8-ec22-4a0e-a543-a160050d8fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:39.242065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95f8a8-ec22-4a0e-a543-a160050d8fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:39.242354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95f8a8-ec22-4a0e-a543-a160050d8fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:39.242779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95f8a8-ec22-4a0e-a543-a160050d8fc9 admin admin] PATH_INFO: `/v3/users/37e34bd9ae9448fd90c0bef71f6fcf69` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:39.244648 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95f8a8-ec22-4a0e-a543-a160050d8fc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e34bd9ae9448fd90c0bef71f6fcf69)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:39.246621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95f8a8-ec22-4a0e-a543-a160050d8fc9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:39.252099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 938/1912] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:39 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:06:39.256359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8339d-6f55-4f78-9256-77fa712f86b4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:39.279474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c8339d-6f55-4f78-9256-77fa712f86b4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:39.285501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72c2ef-1541-478d-b328-9c43c4036175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:39.286297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72c2ef-1541-478d-b328-9c43c4036175 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:39.286591 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72c2ef-1541-478d-b328-9c43c4036175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:39.286897 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72c2ef-1541-478d-b328-9c43c4036175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:39.287735 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72c2ef-1541-478d-b328-9c43c4036175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:39.289561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72c2ef-1541-478d-b328-9c43c4036175 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:39.303513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 939/1913] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:39.310200 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72c2ef-1541-478d-b328-9c43c4036175 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:39.323880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5f95f8a8-ec22-4a0e-a543-a160050d8fc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e34bd9ae9448fd90c0bef71f6fcf69'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:39.325565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72c2ef-1541-478d-b328-9c43c4036175 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:39.331292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb290c5-1fef-4223-ba8d-1681cca60e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:39.332602 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb290c5-1fef-4223-ba8d-1681cca60e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:39.332986 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb290c5-1fef-4223-ba8d-1681cca60e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:39.333326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb290c5-1fef-4223-ba8d-1681cca60e4d admin admin] PATH_INFO: `/v3/projects/36da467eda3349a385599dbced7b2370/users/0fda427439f0424e9c3a50a6e76bf701/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:39.350163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5f95f8a8-ec22-4a0e-a543-a160050d8fc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e34bd9ae9448fd90c0bef71f6fcf69'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:39.354996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb290c5-1fef-4223-ba8d-1681cca60e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=36da467eda3349a385599dbced7b2370, user_id=0fda427439f0424e9c3a50a6e76bf701, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:39.359701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb290c5-1fef-4223-ba8d-1681cca60e4d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:39.365983 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5f95f8a8-ec22-4a0e-a543-a160050d8fc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e34bd9ae9448fd90c0bef71f6fcf69'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:39.366935 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5f95f8a8-ec22-4a0e-a543-a160050d8fc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e34bd9ae9448fd90c0bef71f6fcf69'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:39.389497 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 940/1914] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:39 2022] PUT /identity/v3/projects/36da467eda3349a385599dbced7b2370/users/0fda427439f0424e9c3a50a6e76bf701/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:39.389497 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb290c5-1fef-4223-ba8d-1681cca60e4d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:39.389980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5f95f8a8-ec22-4a0e-a543-a160050d8fc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e34bd9ae9448fd90c0bef71f6fcf69'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:39.390556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4fb290c5-1fef-4223-ba8d-1681cca60e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:39.397624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:39.401580 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 975/1915] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:39 2022] DELETE /identity/v3/users/37e34bd9ae9448fd90c0bef71f6fcf69 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:39.406806 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95f8a8-ec22-4a0e-a543-a160050d8fc9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:39.410410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5f95f8a8-ec22-4a0e-a543-a160050d8fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:39.418355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:39.490147 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95f8a8-ec22-4a0e-a543-a160050d8fc9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:39.492821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb290c5-1fef-4223-ba8d-1681cca60e4d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:39.496800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4faedf-8594-468d-9429-797e82e88e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:39.497882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4faedf-8594-468d-9429-797e82e88e8a admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:39.498353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4faedf-8594-468d-9429-797e82e88e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:39.498849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4faedf-8594-468d-9429-797e82e88e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:39.499297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461fa29-a8c5-481f-815e-67761735b6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:39.500113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4faedf-8594-468d-9429-797e82e88e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:39.500783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461fa29-a8c5-481f-815e-67761735b6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:39.501204 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461fa29-a8c5-481f-815e-67761735b6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:39.501715 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461fa29-a8c5-481f-815e-67761735b6ea admin admin] PATH_INFO: `/v3/projects/6347e9f87170470997861b8a92e15f7e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:39.503532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4faedf-8594-468d-9429-797e82e88e8a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:39.503730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461fa29-a8c5-481f-815e-67761735b6ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=6347e9f87170470997861b8a92e15f7e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:39.506236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3461fa29-a8c5-481f-815e-67761735b6ea admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:39.517953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 976/1916] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:39.519852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854800a1-d3d9-42d0-a66e-d464e93a72f4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:39.520568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854800a1-d3d9-42d0-a66e-d464e93a72f4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:39.521101 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854800a1-d3d9-42d0-a66e-d464e93a72f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:39.542536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-854800a1-d3d9-42d0-a66e-d464e93a72f4 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:39.544167 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-854800a1-d3d9-42d0-a66e-d464e93a72f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:39.555859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 977/1917] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:39.557300 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854800a1-d3d9-42d0-a66e-d464e93a72f4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:39.571689 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854800a1-d3d9-42d0-a66e-d464e93a72f4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:39.581809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3461fa29-a8c5-481f-815e-67761735b6ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6347e9f87170470997861b8a92e15f7e', 'request_id': 'req-3461fa29-a8c5-481f-815e-67761735b6ea'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:39.591540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3461fa29-a8c5-481f-815e-67761735b6ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6347e9f87170470997861b8a92e15f7e', 'request_id': 'req-3461fa29-a8c5-481f-815e-67761735b6ea'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:39.602178 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3461fa29-a8c5-481f-815e-67761735b6ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6347e9f87170470997861b8a92e15f7e', 'request_id': 'req-3461fa29-a8c5-481f-815e-67761735b6ea'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:39.624638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3461fa29-a8c5-481f-815e-67761735b6ea admin admin] The token cache is being invalidate because project 6347e9f87170470997861b8a92e15f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:39.624992 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3461fa29-a8c5-481f-815e-67761735b6ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:39.625686 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3461fa29-a8c5-481f-815e-67761735b6ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:39.627583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 941/1918] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:39 2022] DELETE /identity/v3/projects/6347e9f87170470997861b8a92e15f7e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:39.628414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461fa29-a8c5-481f-815e-67761735b6ea admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:39.629924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3461fa29-a8c5-481f-815e-67761735b6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:39.655906 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4b598-5fa7-4dd2-9345-7693074b8cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:39.656862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4b598-5fa7-4dd2-9345-7693074b8cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:39.657149 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4b598-5fa7-4dd2-9345-7693074b8cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:39.657428 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb4b598-5fa7-4dd2-9345-7693074b8cc6 admin admin] PATH_INFO: `/v3/projects/36da467eda3349a385599dbced7b2370/users/0fda427439f0424e9c3a50a6e76bf701/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:39.660352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4b598-5fa7-4dd2-9345-7693074b8cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36da467eda3349a385599dbced7b2370, user_id=0fda427439f0424e9c3a50a6e76bf701, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:39.662698 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb4b598-5fa7-4dd2-9345-7693074b8cc6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:39.677077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 978/1919] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:39 2022] PUT /identity/v3/projects/36da467eda3349a385599dbced7b2370/users/0fda427439f0424e9c3a50a6e76bf701/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:39.678211 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4b598-5fa7-4dd2-9345-7693074b8cc6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:39.680193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6fb4b598-5fa7-4dd2-9345-7693074b8cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:39.743149 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461fa29-a8c5-481f-815e-67761735b6ea admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:39.780612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb4b598-5fa7-4dd2-9345-7693074b8cc6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:39.786619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55029d5-5211-4ff5-8605-622c1568db66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:39.787819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55029d5-5211-4ff5-8605-622c1568db66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:39.788103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55029d5-5211-4ff5-8605-622c1568db66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:39.788402 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55029d5-5211-4ff5-8605-622c1568db66 admin admin] PATH_INFO: `/v3/users/7001574b9171484f9275047c57a4bf3d` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:39.790355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55029d5-5211-4ff5-8605-622c1568db66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7001574b9171484f9275047c57a4bf3d)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:39.792895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55029d5-5211-4ff5-8605-622c1568db66 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:39.825037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64551145-8bb8-4593-8da8-5b2ba22b211b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:39.825860 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64551145-8bb8-4593-8da8-5b2ba22b211b service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:39.825997 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64551145-8bb8-4593-8da8-5b2ba22b211b service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:39.826359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64551145-8bb8-4593-8da8-5b2ba22b211b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:39.828363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-64551145-8bb8-4593-8da8-5b2ba22b211b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:39.837392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:39.843495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64551145-8bb8-4593-8da8-5b2ba22b211b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:39.845114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64551145-8bb8-4593-8da8-5b2ba22b211b service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:39.858431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 942/1920] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:39.859917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1233861-4b6e-44e5-8d77-3b56d3ce4f4b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:39.860214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1233861-4b6e-44e5-8d77-3b56d3ce4f4b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:39.860474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1233861-4b6e-44e5-8d77-3b56d3ce4f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:39.873894 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:39.879424 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d55029d5-5211-4ff5-8605-622c1568db66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7001574b9171484f9275047c57a4bf3d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:39.921210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f1233861-4b6e-44e5-8d77-3b56d3ce4f4b None None] MFA Rules not processed for user `0fda427439f0424e9c3a50a6e76bf701`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:39.923732 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f1233861-4b6e-44e5-8d77-3b56d3ce4f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:39.926354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d55029d5-5211-4ff5-8605-622c1568db66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7001574b9171484f9275047c57a4bf3d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:39.950693 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d55029d5-5211-4ff5-8605-622c1568db66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7001574b9171484f9275047c57a4bf3d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:39.952716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d55029d5-5211-4ff5-8605-622c1568db66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7001574b9171484f9275047c57a4bf3d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:39.981484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d55029d5-5211-4ff5-8605-622c1568db66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7001574b9171484f9275047c57a4bf3d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:40.054721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 943/1921] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:40.076354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 979/1922] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:39 2022] DELETE /identity/v3/users/7001574b9171484f9275047c57a4bf3d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:40.101936 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1233861-4b6e-44e5-8d77-3b56d3ce4f4b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:40.103536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f1233861-4b6e-44e5-8d77-3b56d3ce4f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:40.316770 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1233861-4b6e-44e5-8d77-3b56d3ce4f4b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:40.342402 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55029d5-5211-4ff5-8605-622c1568db66 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:40.344116 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d55029d5-5211-4ff5-8605-622c1568db66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:40.471662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55029d5-5211-4ff5-8605-622c1568db66 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:40.477543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc4492-ae25-4198-9fa2-f6fa68ffbd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:40.478593 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc4492-ae25-4198-9fa2-f6fa68ffbd66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:40.479060 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc4492-ae25-4198-9fa2-f6fa68ffbd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:40.479354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc4492-ae25-4198-9fa2-f6fa68ffbd66 admin admin] PATH_INFO: `/v3/projects/1e8a9ef221ca4a0cb32e3808fae60803` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:40.480805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc4492-ae25-4198-9fa2-f6fa68ffbd66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e8a9ef221ca4a0cb32e3808fae60803)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:40.481919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55823c-ac24-4459-82b5-09305bd36f48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:40.482952 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc4492-ae25-4198-9fa2-f6fa68ffbd66 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:40.483628 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55823c-ac24-4459-82b5-09305bd36f48 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:40.484093 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55823c-ac24-4459-82b5-09305bd36f48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:40.484788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55823c-ac24-4459-82b5-09305bd36f48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:40.591791 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-debc4492-ae25-4198-9fa2-f6fa68ffbd66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8a9ef221ca4a0cb32e3808fae60803', 'request_id': 'req-debc4492-ae25-4198-9fa2-f6fa68ffbd66'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:40.607410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-debc4492-ae25-4198-9fa2-f6fa68ffbd66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8a9ef221ca4a0cb32e3808fae60803', 'request_id': 'req-debc4492-ae25-4198-9fa2-f6fa68ffbd66'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:40.617685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-debc4492-ae25-4198-9fa2-f6fa68ffbd66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8a9ef221ca4a0cb32e3808fae60803', 'request_id': 'req-debc4492-ae25-4198-9fa2-f6fa68ffbd66'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:40.630149 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:40.640331 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-debc4492-ae25-4198-9fa2-f6fa68ffbd66 admin admin] The token cache is being invalidate because project 1e8a9ef221ca4a0cb32e3808fae60803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:40.640492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-debc4492-ae25-4198-9fa2-f6fa68ffbd66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:40.641653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55823c-ac24-4459-82b5-09305bd36f48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:40.643359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55823c-ac24-4459-82b5-09305bd36f48 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:40.645365 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-debc4492-ae25-4198-9fa2-f6fa68ffbd66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:40.649664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 980/1923] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:40 2022] DELETE /identity/v3/projects/1e8a9ef221ca4a0cb32e3808fae60803 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:06:40.655676 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc4492-ae25-4198-9fa2-f6fa68ffbd66 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:40.657494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-debc4492-ae25-4198-9fa2-f6fa68ffbd66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:40.670544 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 944/1924] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:06:40.756095 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:40.838110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc4492-ae25-4198-9fa2-f6fa68ffbd66 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:40.856515 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55823c-ac24-4459-82b5-09305bd36f48 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:40.858325 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9b55823c-ac24-4459-82b5-09305bd36f48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:40.881951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81365f-eaa4-4f5b-9240-53658e0af294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:40.883022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81365f-eaa4-4f5b-9240-53658e0af294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:40.883314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81365f-eaa4-4f5b-9240-53658e0af294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:40.883597 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81365f-eaa4-4f5b-9240-53658e0af294 admin admin] PATH_INFO: `/v3/users/def143e0f9ca483b9c009de2bbae1493` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:40.885095 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81365f-eaa4-4f5b-9240-53658e0af294 admin admin] RBAC: Authorizing `identity:delete_user(user_id=def143e0f9ca483b9c009de2bbae1493)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:40.891133 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81365f-eaa4-4f5b-9240-53658e0af294 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:40.895581 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55823c-ac24-4459-82b5-09305bd36f48 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:40.918509 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93454a2a-c1a9-47bd-a1b3-428f7f6d7c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:40.920283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93454a2a-c1a9-47bd-a1b3-428f7f6d7c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:40.922287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93454a2a-c1a9-47bd-a1b3-428f7f6d7c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:40.922887 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93454a2a-c1a9-47bd-a1b3-428f7f6d7c5e admin admin] PATH_INFO: `/v3/projects/be3b8a8b3e6d43e0b167436c6b5e0ca4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:40.927589 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93454a2a-c1a9-47bd-a1b3-428f7f6d7c5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=be3b8a8b3e6d43e0b167436c6b5e0ca4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:40.937849 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93454a2a-c1a9-47bd-a1b3-428f7f6d7c5e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:41.044128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e81365f-eaa4-4f5b-9240-53658e0af294 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def143e0f9ca483b9c009de2bbae1493'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:41.086681 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e81365f-eaa4-4f5b-9240-53658e0af294 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def143e0f9ca483b9c009de2bbae1493'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:41.105485 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e81365f-eaa4-4f5b-9240-53658e0af294 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def143e0f9ca483b9c009de2bbae1493'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:41.106549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e81365f-eaa4-4f5b-9240-53658e0af294 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def143e0f9ca483b9c009de2bbae1493'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:41.138925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e81365f-eaa4-4f5b-9240-53658e0af294 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def143e0f9ca483b9c009de2bbae1493'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:41.140471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-93454a2a-c1a9-47bd-a1b3-428f7f6d7c5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be3b8a8b3e6d43e0b167436c6b5e0ca4', 'request_id': 'req-93454a2a-c1a9-47bd-a1b3-428f7f6d7c5e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:41.150010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 981/1925] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:40 2022] DELETE /identity/v3/users/def143e0f9ca483b9c009de2bbae1493 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:06:41.151232 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81365f-eaa4-4f5b-9240-53658e0af294 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:41.156091 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3e81365f-eaa4-4f5b-9240-53658e0af294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:41.160070 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-93454a2a-c1a9-47bd-a1b3-428f7f6d7c5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be3b8a8b3e6d43e0b167436c6b5e0ca4', 'request_id': 'req-93454a2a-c1a9-47bd-a1b3-428f7f6d7c5e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:41.171090 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-93454a2a-c1a9-47bd-a1b3-428f7f6d7c5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be3b8a8b3e6d43e0b167436c6b5e0ca4', 'request_id': 'req-93454a2a-c1a9-47bd-a1b3-428f7f6d7c5e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:41.202558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-93454a2a-c1a9-47bd-a1b3-428f7f6d7c5e admin admin] The token cache is being invalidate because project be3b8a8b3e6d43e0b167436c6b5e0ca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:41.203907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-93454a2a-c1a9-47bd-a1b3-428f7f6d7c5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:41.205207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-93454a2a-c1a9-47bd-a1b3-428f7f6d7c5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:41.212875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 945/1926] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:40 2022] DELETE /identity/v3/projects/be3b8a8b3e6d43e0b167436c6b5e0ca4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:06:41.215587 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a3ade-bb98-4254-969e-b6387ef42bbd None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:41.216328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a3ade-bb98-4254-969e-b6387ef42bbd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:41.216977 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a3ade-bb98-4254-969e-b6387ef42bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:41.268920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d41a3ade-bb98-4254-969e-b6387ef42bbd None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:41.271140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d41a3ade-bb98-4254-969e-b6387ef42bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:41.316492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81365f-eaa4-4f5b-9240-53658e0af294 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:41.321998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec388f-e5bc-4373-9d60-0ac2468e8f79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:41.323076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec388f-e5bc-4373-9d60-0ac2468e8f79 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:41.323534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec388f-e5bc-4373-9d60-0ac2468e8f79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:41.324499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec388f-e5bc-4373-9d60-0ac2468e8f79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:41.326687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a2ec388f-e5bc-4373-9d60-0ac2468e8f79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:41.420917 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec388f-e5bc-4373-9d60-0ac2468e8f79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:41.422929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec388f-e5bc-4373-9d60-0ac2468e8f79 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:41.436853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 982/1927] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:41.483373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 946/1928] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:06:41.486659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bfe88-3edf-4f08-9228-c4f46e59adc6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:41.486955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bfe88-3edf-4f08-9228-c4f46e59adc6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:41.487233 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17bfe88-3edf-4f08-9228-c4f46e59adc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:41.511481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:41.520508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c17bfe88-3edf-4f08-9228-c4f46e59adc6 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:41.521986 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c17bfe88-3edf-4f08-9228-c4f46e59adc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:41.555560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 983/1929] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:41.556779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a3ade-bb98-4254-969e-b6387ef42bbd None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:41.572064 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a3ade-bb98-4254-969e-b6387ef42bbd None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:41.577744 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cf4c1-7dc6-4450-a259-667995fb546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:41.578778 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cf4c1-7dc6-4450-a259-667995fb546f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:41.579347 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cf4c1-7dc6-4450-a259-667995fb546f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:41.579751 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7cf4c1-7dc6-4450-a259-667995fb546f admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:41.581002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cf4c1-7dc6-4450-a259-667995fb546f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:41.581327 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cf4c1-7dc6-4450-a259-667995fb546f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:41.583307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7cf4c1-7dc6-4450-a259-667995fb546f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:41.602328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 947/1930] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:41.602905 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bfe88-3edf-4f08-9228-c4f46e59adc6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:41.615929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17bfe88-3edf-4f08-9228-c4f46e59adc6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:41.621365 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d5e8c-5b35-4e4a-88a3-50463ae9649b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:41.622465 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d5e8c-5b35-4e4a-88a3-50463ae9649b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:41.623128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d5e8c-5b35-4e4a-88a3-50463ae9649b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:41.623653 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d5e8c-5b35-4e4a-88a3-50463ae9649b admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:41.624739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d5e8c-5b35-4e4a-88a3-50463ae9649b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:41.627957 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d5e8c-5b35-4e4a-88a3-50463ae9649b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:41.679860 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cf4c1-7dc6-4450-a259-667995fb546f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:41.681283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 984/1931] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:41 2022] POST /identity/v3/projects => generated 373 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:41.695418 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7cf4c1-7dc6-4450-a259-667995fb546f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:41.862163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d5e8c-5b35-4e4a-88a3-50463ae9649b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:41.865019 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c53d5e8c-5b35-4e4a-88a3-50463ae9649b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:41.890773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bf59a-1509-48df-9ade-da64b0e39219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:41.893754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bf59a-1509-48df-9ade-da64b0e39219 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:41.893754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bf59a-1509-48df-9ade-da64b0e39219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:41.909244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585bf59a-1509-48df-9ade-da64b0e39219 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:41.912639 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bf59a-1509-48df-9ade-da64b0e39219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:41.920726 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585bf59a-1509-48df-9ade-da64b0e39219 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:41.962952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:42.024666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 948/1932] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:41 2022] POST /identity/v3/users => generated 287 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:06:42.029409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bf59a-1509-48df-9ade-da64b0e39219 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:42.051114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585bf59a-1509-48df-9ade-da64b0e39219 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:42.063140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0751691-099b-40f6-9e27-73580195703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:42.064615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0751691-099b-40f6-9e27-73580195703f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:42.065200 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0751691-099b-40f6-9e27-73580195703f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:42.065956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0751691-099b-40f6-9e27-73580195703f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:42.066493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d5e8c-5b35-4e4a-88a3-50463ae9649b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:42.067238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0751691-099b-40f6-9e27-73580195703f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:42.070178 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0751691-099b-40f6-9e27-73580195703f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:42.074733 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcedfe-2b80-4ec3-989e-45e8846c2956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:42.076220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcedfe-2b80-4ec3-989e-45e8846c2956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:42.076672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcedfe-2b80-4ec3-989e-45e8846c2956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:42.077167 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcedfe-2b80-4ec3-989e-45e8846c2956 admin admin] PATH_INFO: `/v3/projects/4b97db2d6d3149529809a7b3ad6d0e72` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:42.080272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcedfe-2b80-4ec3-989e-45e8846c2956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b97db2d6d3149529809a7b3ad6d0e72)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:42.083381 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcedfe-2b80-4ec3-989e-45e8846c2956 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:42.090263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 949/1933] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:42.092023 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0751691-099b-40f6-9e27-73580195703f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:42.094797 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e0751691-099b-40f6-9e27-73580195703f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:42.116076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0751691-099b-40f6-9e27-73580195703f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:42.122499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19fa10-8027-4c67-8d2d-44aa771173ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:42.123924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19fa10-8027-4c67-8d2d-44aa771173ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:42.124458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19fa10-8027-4c67-8d2d-44aa771173ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:42.124823 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19fa10-8027-4c67-8d2d-44aa771173ff admin admin] PATH_INFO: `/v3/users/afd7f4f61cc24b5d8c9b76d2a2fe2457` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:42.126891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19fa10-8027-4c67-8d2d-44aa771173ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd7f4f61cc24b5d8c9b76d2a2fe2457)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:42.130335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19fa10-8027-4c67-8d2d-44aa771173ff admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:42.154268 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c5bcedfe-2b80-4ec3-989e-45e8846c2956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b97db2d6d3149529809a7b3ad6d0e72', 'request_id': 'req-c5bcedfe-2b80-4ec3-989e-45e8846c2956'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:42.163674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c5bcedfe-2b80-4ec3-989e-45e8846c2956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b97db2d6d3149529809a7b3ad6d0e72', 'request_id': 'req-c5bcedfe-2b80-4ec3-989e-45e8846c2956'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:42.176707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c5bcedfe-2b80-4ec3-989e-45e8846c2956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b97db2d6d3149529809a7b3ad6d0e72', 'request_id': 'req-c5bcedfe-2b80-4ec3-989e-45e8846c2956'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:42.193457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c5bcedfe-2b80-4ec3-989e-45e8846c2956 admin admin] The token cache is being invalidate because project 4b97db2d6d3149529809a7b3ad6d0e72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:42.194009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c5bcedfe-2b80-4ec3-989e-45e8846c2956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:42.194869 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c5bcedfe-2b80-4ec3-989e-45e8846c2956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:42.199616 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 985/1934] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:41 2022] DELETE /identity/v3/projects/4b97db2d6d3149529809a7b3ad6d0e72 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:06:42.200803 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcedfe-2b80-4ec3-989e-45e8846c2956 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:42.202426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c5bcedfe-2b80-4ec3-989e-45e8846c2956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:42.209373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd19fa10-8027-4c67-8d2d-44aa771173ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd7f4f61cc24b5d8c9b76d2a2fe2457'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:42.224018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd19fa10-8027-4c67-8d2d-44aa771173ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd7f4f61cc24b5d8c9b76d2a2fe2457'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:42.236848 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd19fa10-8027-4c67-8d2d-44aa771173ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd7f4f61cc24b5d8c9b76d2a2fe2457'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:42.237911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd19fa10-8027-4c67-8d2d-44aa771173ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd7f4f61cc24b5d8c9b76d2a2fe2457'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:42.239009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dd19fa10-8027-4c67-8d2d-44aa771173ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd7f4f61cc24b5d8c9b76d2a2fe2457'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:42.271036 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 950/1935] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:42 2022] DELETE /identity/v3/users/afd7f4f61cc24b5d8c9b76d2a2fe2457 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:42.272731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847e7c5-c85a-4333-874c-1449c489cbd6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:42.273021 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847e7c5-c85a-4333-874c-1449c489cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:42.273295 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847e7c5-c85a-4333-874c-1449c489cbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:42.296837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6847e7c5-c85a-4333-874c-1449c489cbd6 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:42.298314 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6847e7c5-c85a-4333-874c-1449c489cbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:42.341826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcedfe-2b80-4ec3-989e-45e8846c2956 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:42.358456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:42.414795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 951/1936] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:42.414795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a20dd-adcf-4289-b818-759663d93288 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:42.414795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a20dd-adcf-4289-b818-759663d93288 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:42.414795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a20dd-adcf-4289-b818-759663d93288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:42.436586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf95420-1bdd-4558-9733-146125977578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:42.437562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf95420-1bdd-4558-9733-146125977578 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:42.437855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf95420-1bdd-4558-9733-146125977578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:42.438246 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf95420-1bdd-4558-9733-146125977578 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:42.439080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf95420-1bdd-4558-9733-146125977578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:42.440931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf95420-1bdd-4558-9733-146125977578 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:42.443628 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-304a20dd-adcf-4289-b818-759663d93288 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:42.445728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-304a20dd-adcf-4289-b818-759663d93288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:42.455988 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 952/1937] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:42.457657 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f44dc-fb3b-4601-a077-b37f8816e290 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:42.457933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f44dc-fb3b-4601-a077-b37f8816e290 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:42.458265 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45f44dc-fb3b-4601-a077-b37f8816e290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:42.479196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 986/1938] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:42.480417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf95420-1bdd-4558-9733-146125977578 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:42.482225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ccf95420-1bdd-4558-9733-146125977578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:42.498277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e45f44dc-fb3b-4601-a077-b37f8816e290 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:42.502365 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e45f44dc-fb3b-4601-a077-b37f8816e290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:42.529185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 953/1939] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:42.530367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f44dc-fb3b-4601-a077-b37f8816e290 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:42.532511 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e45f44dc-fb3b-4601-a077-b37f8816e290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:42.554171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45f44dc-fb3b-4601-a077-b37f8816e290 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:42.562944 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c56db-db2f-4b7a-9efe-ae711987dc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:42.564095 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c56db-db2f-4b7a-9efe-ae711987dc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:42.564624 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c56db-db2f-4b7a-9efe-ae711987dc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:42.565021 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c56db-db2f-4b7a-9efe-ae711987dc3a admin admin] PATH_INFO: `/v3/projects/b52ba7a907a74d2da3987e3f49bd64be/users/891f6ff7bfd841cea69da9a1c01b1cc7/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:42.587558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c56db-db2f-4b7a-9efe-ae711987dc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52ba7a907a74d2da3987e3f49bd64be, user_id=891f6ff7bfd841cea69da9a1c01b1cc7, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:42.590694 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c56db-db2f-4b7a-9efe-ae711987dc3a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:42.611167 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf95420-1bdd-4558-9733-146125977578 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:42.617563 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 954/1940] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:42 2022] PUT /identity/v3/projects/b52ba7a907a74d2da3987e3f49bd64be/users/891f6ff7bfd841cea69da9a1c01b1cc7/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:42.618648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c56db-db2f-4b7a-9efe-ae711987dc3a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:42.660668 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:42.705216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cb556-4cb7-4a0e-bf53-8a1086284b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:42.705934 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cb556-4cb7-4a0e-bf53-8a1086284b23 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:42.706235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cb556-4cb7-4a0e-bf53-8a1086284b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:42.706513 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cb556-4cb7-4a0e-bf53-8a1086284b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:42.745283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c56db-db2f-4b7a-9efe-ae711987dc3a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:42.751622 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f25048-2b84-4746-b7c7-e62c5047eb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:42.752541 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f25048-2b84-4746-b7c7-e62c5047eb27 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:42.753096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f25048-2b84-4746-b7c7-e62c5047eb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:42.753913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f25048-2b84-4746-b7c7-e62c5047eb27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:42.754265 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f25048-2b84-4746-b7c7-e62c5047eb27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:42.754579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f25048-2b84-4746-b7c7-e62c5047eb27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:42.756731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f25048-2b84-4746-b7c7-e62c5047eb27 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:42.776132 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 955/1941] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:42.776132 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1890bf-a61c-482b-b238-857031e13df7 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:42.776132 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1890bf-a61c-482b-b238-857031e13df7 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:42.776132 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1890bf-a61c-482b-b238-857031e13df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:42.805035 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cb556-4cb7-4a0e-bf53-8a1086284b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:42.806501 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cb556-4cb7-4a0e-bf53-8a1086284b23 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:42.818599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bf1890bf-a61c-482b-b238-857031e13df7 None None] MFA Rules not processed for user `891f6ff7bfd841cea69da9a1c01b1cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:42.821624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 987/1942] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:42.823099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bf1890bf-a61c-482b-b238-857031e13df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:42.824275 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cb556-4cb7-4a0e-bf53-8a1086284b23 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:42.851122 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cb556-4cb7-4a0e-bf53-8a1086284b23 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:42.862136 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eec581-df58-4e0d-8c60-e6d5f2314b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:42.863709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eec581-df58-4e0d-8c60-e6d5f2314b77 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:42.864097 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eec581-df58-4e0d-8c60-e6d5f2314b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:42.864781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eec581-df58-4e0d-8c60-e6d5f2314b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:42.866536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eec581-df58-4e0d-8c60-e6d5f2314b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:42.871666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eec581-df58-4e0d-8c60-e6d5f2314b77 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:42.904756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:42.939110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 988/1943] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:42 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:42.943541 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eec581-df58-4e0d-8c60-e6d5f2314b77 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:42.971067 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 956/1944] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:43.040704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1890bf-a61c-482b-b238-857031e13df7 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:43.042800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bf1890bf-a61c-482b-b238-857031e13df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:43.112260 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eec581-df58-4e0d-8c60-e6d5f2314b77 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:43.128772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8d7b6-b8a8-43af-abd8-4974cee6da83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:43.130710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8d7b6-b8a8-43af-abd8-4974cee6da83 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:43.132355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8d7b6-b8a8-43af-abd8-4974cee6da83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:43.132665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8d7b6-b8a8-43af-abd8-4974cee6da83 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:43.134645 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8d7b6-b8a8-43af-abd8-4974cee6da83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:43.140371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8d7b6-b8a8-43af-abd8-4974cee6da83 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:43.160822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1890bf-a61c-482b-b238-857031e13df7 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:43.198067 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 989/1945] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:42 2022] POST /identity/v3/users => generated 289 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:43.200114 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8d7b6-b8a8-43af-abd8-4974cee6da83 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:43.216469 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8d7b6-b8a8-43af-abd8-4974cee6da83 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:43.234044 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ced88-9890-4b9e-8833-da575f5cf3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:43.234867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ced88-9890-4b9e-8833-da575f5cf3fe admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:43.235239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ced88-9890-4b9e-8833-da575f5cf3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:43.235592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ced88-9890-4b9e-8833-da575f5cf3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:43.236532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ced88-9890-4b9e-8833-da575f5cf3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:43.238306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067ced88-9890-4b9e-8833-da575f5cf3fe admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:43.265103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 990/1946] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:43.267933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91f2b9-1376-4db7-9141-ff91fe509def service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:43.268795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91f2b9-1376-4db7-9141-ff91fe509def service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:43.269082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91f2b9-1376-4db7-9141-ff91fe509def service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:43.269299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ced88-9890-4b9e-8833-da575f5cf3fe admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:43.269440 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91f2b9-1376-4db7-9141-ff91fe509def service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:43.281932 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:43.293650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ced88-9890-4b9e-8833-da575f5cf3fe admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:43.302776 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766208a-f132-48b8-ab78-8de98b35bc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:43.303904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766208a-f132-48b8-ab78-8de98b35bc1b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:43.304357 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766208a-f132-48b8-ab78-8de98b35bc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:43.304799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766208a-f132-48b8-ab78-8de98b35bc1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:43.306092 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766208a-f132-48b8-ab78-8de98b35bc1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:43.308988 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766208a-f132-48b8-ab78-8de98b35bc1b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:43.330291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 991/1947] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:43.335365 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766208a-f132-48b8-ab78-8de98b35bc1b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:43.354521 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91f2b9-1376-4db7-9141-ff91fe509def service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:43.358392 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a91f2b9-1376-4db7-9141-ff91fe509def service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:43.359439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766208a-f132-48b8-ab78-8de98b35bc1b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:43.371194 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca91be-bd3b-4ba9-aa76-98f63f919331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:43.373077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca91be-bd3b-4ba9-aa76-98f63f919331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:43.373670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca91be-bd3b-4ba9-aa76-98f63f919331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:43.374107 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca91be-bd3b-4ba9-aa76-98f63f919331 admin admin] PATH_INFO: `/v3/projects/cd41b47a5d834defb62f7896f65d4ce4/users/4deb4e490c934d3785cba63542095bb0/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:43.393806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 957/1948] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:06:43.401916 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca91be-bd3b-4ba9-aa76-98f63f919331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd41b47a5d834defb62f7896f65d4ce4, user_id=4deb4e490c934d3785cba63542095bb0, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:43.405016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca91be-bd3b-4ba9-aa76-98f63f919331 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:43.427578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 992/1949] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:43 2022] PUT /identity/v3/projects/cd41b47a5d834defb62f7896f65d4ce4/users/4deb4e490c934d3785cba63542095bb0/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:43.432065 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91f2b9-1376-4db7-9141-ff91fe509def service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:43.449344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392eb404-b21e-4d25-9ce4-18cc27ee6b2d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:43.449974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392eb404-b21e-4d25-9ce4-18cc27ee6b2d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:43.450277 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392eb404-b21e-4d25-9ce4-18cc27ee6b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:43.450386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91f2b9-1376-4db7-9141-ff91fe509def service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:43.486997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-392eb404-b21e-4d25-9ce4-18cc27ee6b2d None None] MFA Rules not processed for user `4deb4e490c934d3785cba63542095bb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:43.488671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-392eb404-b21e-4d25-9ce4-18cc27ee6b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:43.548201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0f4db-0f3c-4b81-b203-8a46b04353b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:43.549931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0f4db-0f3c-4b81-b203-8a46b04353b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:43.551585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0f4db-0f3c-4b81-b203-8a46b04353b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:43.552081 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0f4db-0f3c-4b81-b203-8a46b04353b8 admin admin] PATH_INFO: `/v3/users/891f6ff7bfd841cea69da9a1c01b1cc7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:43.554003 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0f4db-0f3c-4b81-b203-8a46b04353b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=891f6ff7bfd841cea69da9a1c01b1cc7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:43.559053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0f4db-0f3c-4b81-b203-8a46b04353b8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:43.627644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 993/1950] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:06:43.634725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392eb404-b21e-4d25-9ce4-18cc27ee6b2d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:43.682339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43a0f4db-0f3c-4b81-b203-8a46b04353b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '891f6ff7bfd841cea69da9a1c01b1cc7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:43.685143 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392eb404-b21e-4d25-9ce4-18cc27ee6b2d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:43.704428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43a0f4db-0f3c-4b81-b203-8a46b04353b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '891f6ff7bfd841cea69da9a1c01b1cc7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:43.721246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43a0f4db-0f3c-4b81-b203-8a46b04353b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '891f6ff7bfd841cea69da9a1c01b1cc7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:43.723332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43a0f4db-0f3c-4b81-b203-8a46b04353b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '891f6ff7bfd841cea69da9a1c01b1cc7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:43.725202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43a0f4db-0f3c-4b81-b203-8a46b04353b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '891f6ff7bfd841cea69da9a1c01b1cc7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:43.737278 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f89b9-e3b0-4ac9-92f0-0a85c352ee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:43.738786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f89b9-e3b0-4ac9-92f0-0a85c352ee44 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:43.740179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f89b9-e3b0-4ac9-92f0-0a85c352ee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:43.740791 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f89b9-e3b0-4ac9-92f0-0a85c352ee44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:43.741538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f89b9-e3b0-4ac9-92f0-0a85c352ee44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:43.743715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f89b9-e3b0-4ac9-92f0-0a85c352ee44 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:43.796374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 958/1951] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:43 2022] DELETE /identity/v3/users/891f6ff7bfd841cea69da9a1c01b1cc7 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:43.797379 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0f4db-0f3c-4b81-b203-8a46b04353b8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:43.800409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-43a0f4db-0f3c-4b81-b203-8a46b04353b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:43.820016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 994/1952] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:43 2022] POST /identity/v3/projects => generated 379 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:43.824521 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14243d1-9598-482d-bea4-450454fd47f2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:43.824751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14243d1-9598-482d-bea4-450454fd47f2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:43.825920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14243d1-9598-482d-bea4-450454fd47f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:43.852369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:43.857053 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e14243d1-9598-482d-bea4-450454fd47f2 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:43.858599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e14243d1-9598-482d-bea4-450454fd47f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:43.935029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:43.971054 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 995/1953] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:43.976385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14243d1-9598-482d-bea4-450454fd47f2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:43.982997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e14243d1-9598-482d-bea4-450454fd47f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:43.983613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0f4db-0f3c-4b81-b203-8a46b04353b8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:43.989906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a59f3-3e82-411f-aaa5-6377baaaa68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:43.991865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a59f3-3e82-411f-aaa5-6377baaaa68d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:43.992788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a59f3-3e82-411f-aaa5-6377baaaa68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:43.993345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a59f3-3e82-411f-aaa5-6377baaaa68d admin admin] PATH_INFO: `/v3/projects/bf0fd724541e440bb0702051ea8a6946` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:43.995317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a59f3-3e82-411f-aaa5-6377baaaa68d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0fd724541e440bb0702051ea8a6946)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:43.998103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a59f3-3e82-411f-aaa5-6377baaaa68d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:44.008684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14243d1-9598-482d-bea4-450454fd47f2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:44.018952 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cd362-52a7-431e-963e-49b8fc323b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:44.019987 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cd362-52a7-431e-963e-49b8fc323b18 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:44.020569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cd362-52a7-431e-963e-49b8fc323b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:44.020991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cd362-52a7-431e-963e-49b8fc323b18 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:44.022482 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cd362-52a7-431e-963e-49b8fc323b18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:44.034259 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21cd362-52a7-431e-963e-49b8fc323b18 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:44.072095 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 996/1954] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:43 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:44.072095 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cd362-52a7-431e-963e-49b8fc323b18 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:44.074317 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a21cd362-52a7-431e-963e-49b8fc323b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:44.088913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cd362-52a7-431e-963e-49b8fc323b18 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:44.126943 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d39a59f3-3e82-411f-aaa5-6377baaaa68d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0fd724541e440bb0702051ea8a6946', 'request_id': 'req-d39a59f3-3e82-411f-aaa5-6377baaaa68d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:44.146899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d39a59f3-3e82-411f-aaa5-6377baaaa68d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0fd724541e440bb0702051ea8a6946', 'request_id': 'req-d39a59f3-3e82-411f-aaa5-6377baaaa68d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:44.206723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d39a59f3-3e82-411f-aaa5-6377baaaa68d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0fd724541e440bb0702051ea8a6946', 'request_id': 'req-d39a59f3-3e82-411f-aaa5-6377baaaa68d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:44.235175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d39a59f3-3e82-411f-aaa5-6377baaaa68d admin admin] The token cache is being invalidate because project bf0fd724541e440bb0702051ea8a6946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:44.235620 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d39a59f3-3e82-411f-aaa5-6377baaaa68d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:44.236508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d39a59f3-3e82-411f-aaa5-6377baaaa68d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:44.238867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 959/1955] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:43 2022] DELETE /identity/v3/projects/bf0fd724541e440bb0702051ea8a6946 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:44.239682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a59f3-3e82-411f-aaa5-6377baaaa68d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:44.241370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d39a59f3-3e82-411f-aaa5-6377baaaa68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:44.246301 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9933f-80a2-4672-968d-2196132b0014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:44.247953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9933f-80a2-4672-968d-2196132b0014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:44.248772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9933f-80a2-4672-968d-2196132b0014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:44.249265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9933f-80a2-4672-968d-2196132b0014 admin admin] PATH_INFO: `/v3/users/a7f78b875b7e4e8cab842e24750b8fdb` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:44.252168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9933f-80a2-4672-968d-2196132b0014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7f78b875b7e4e8cab842e24750b8fdb)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:44.256204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d9933f-80a2-4672-968d-2196132b0014 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:44.333297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a59f3-3e82-411f-aaa5-6377baaaa68d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:44.341155 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31182e0-bfc6-40ff-83c0-00794955a545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:44.341845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31182e0-bfc6-40ff-83c0-00794955a545 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:44.342144 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31182e0-bfc6-40ff-83c0-00794955a545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:44.342575 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31182e0-bfc6-40ff-83c0-00794955a545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:44.344407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b31182e0-bfc6-40ff-83c0-00794955a545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:44.357581 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-75d9933f-80a2-4672-968d-2196132b0014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7f78b875b7e4e8cab842e24750b8fdb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:44.364228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31182e0-bfc6-40ff-83c0-00794955a545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:44.366496 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31182e0-bfc6-40ff-83c0-00794955a545 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:44.374296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-75d9933f-80a2-4672-968d-2196132b0014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7f78b875b7e4e8cab842e24750b8fdb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:44.382094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 960/1956] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:44.382790 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31182e0-bfc6-40ff-83c0-00794955a545 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:44.384983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b31182e0-bfc6-40ff-83c0-00794955a545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:44.389020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-75d9933f-80a2-4672-968d-2196132b0014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7f78b875b7e4e8cab842e24750b8fdb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:44.390078 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-75d9933f-80a2-4672-968d-2196132b0014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7f78b875b7e4e8cab842e24750b8fdb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:44.403235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-75d9933f-80a2-4672-968d-2196132b0014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7f78b875b7e4e8cab842e24750b8fdb'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:44.411411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31182e0-bfc6-40ff-83c0-00794955a545 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:44.411762 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 997/1957] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:44 2022] DELETE /identity/v3/users/a7f78b875b7e4e8cab842e24750b8fdb => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:44.416241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9933f-80a2-4672-968d-2196132b0014 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:44.418415 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-75d9933f-80a2-4672-968d-2196132b0014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:44.433771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:44.515219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f08d5d-9fcf-4aec-af4f-cc43576a90b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:44.516477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f08d5d-9fcf-4aec-af4f-cc43576a90b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:44.517200 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f08d5d-9fcf-4aec-af4f-cc43576a90b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:44.517691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f08d5d-9fcf-4aec-af4f-cc43576a90b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:44.518710 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f08d5d-9fcf-4aec-af4f-cc43576a90b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:44.520782 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f08d5d-9fcf-4aec-af4f-cc43576a90b6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:44.528235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:44.541235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9933f-80a2-4672-968d-2196132b0014 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:44.547493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 961/1958] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:44.551645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6280f-3fdb-4d34-ba31-9c2fa1aaaefa None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:44.551970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6280f-3fdb-4d34-ba31-9c2fa1aaaefa None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:44.553172 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6280f-3fdb-4d34-ba31-9c2fa1aaaefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:44.557831 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a260f-b7b1-4d69-9623-d5b0f8955817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:44.560549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a260f-b7b1-4d69-9623-d5b0f8955817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:44.561143 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a260f-b7b1-4d69-9623-d5b0f8955817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:44.561536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a260f-b7b1-4d69-9623-d5b0f8955817 admin admin] PATH_INFO: `/v3/users/0fda427439f0424e9c3a50a6e76bf701` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:44.563672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a260f-b7b1-4d69-9623-d5b0f8955817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fda427439f0424e9c3a50a6e76bf701)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:44.569094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a260f-b7b1-4d69-9623-d5b0f8955817 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:44.577574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3db6280f-3fdb-4d34-ba31-9c2fa1aaaefa None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:44.578899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3db6280f-3fdb-4d34-ba31-9c2fa1aaaefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:44.596112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 962/1959] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:44.597047 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6280f-3fdb-4d34-ba31-9c2fa1aaaefa None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:44.603290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3db6280f-3fdb-4d34-ba31-9c2fa1aaaefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:44.623693 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6280f-3fdb-4d34-ba31-9c2fa1aaaefa None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:44.628642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96261cb6-56f5-4a41-bdef-dcd76f95a5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:44.629946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96261cb6-56f5-4a41-bdef-dcd76f95a5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:44.630805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96261cb6-56f5-4a41-bdef-dcd76f95a5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:44.630805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96261cb6-56f5-4a41-bdef-dcd76f95a5b5 admin admin] PATH_INFO: `/v3/projects/16d6ae0275264baaba2c0b089f4232c2/users/c63892450ae246d196353136ddb85b5a/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:44.644070 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7b5a260f-b7b1-4d69-9623-d5b0f8955817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fda427439f0424e9c3a50a6e76bf701'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:44.650332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96261cb6-56f5-4a41-bdef-dcd76f95a5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d6ae0275264baaba2c0b089f4232c2, user_id=c63892450ae246d196353136ddb85b5a, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:44.653738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96261cb6-56f5-4a41-bdef-dcd76f95a5b5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:44.666123 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7b5a260f-b7b1-4d69-9623-d5b0f8955817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fda427439f0424e9c3a50a6e76bf701'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:44.670974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 963/1960] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:44 2022] PUT /identity/v3/projects/16d6ae0275264baaba2c0b089f4232c2/users/c63892450ae246d196353136ddb85b5a/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:44.671917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96261cb6-56f5-4a41-bdef-dcd76f95a5b5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:44.676095 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-96261cb6-56f5-4a41-bdef-dcd76f95a5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:44.682885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7b5a260f-b7b1-4d69-9623-d5b0f8955817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fda427439f0424e9c3a50a6e76bf701'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:44.683924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7b5a260f-b7b1-4d69-9623-d5b0f8955817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fda427439f0424e9c3a50a6e76bf701'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:44.696716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7b5a260f-b7b1-4d69-9623-d5b0f8955817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fda427439f0424e9c3a50a6e76bf701'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:44.709777 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 998/1961] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:44 2022] DELETE /identity/v3/users/0fda427439f0424e9c3a50a6e76bf701 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:44.711360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a260f-b7b1-4d69-9623-d5b0f8955817 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:44.713837 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7b5a260f-b7b1-4d69-9623-d5b0f8955817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:44.800852 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96261cb6-56f5-4a41-bdef-dcd76f95a5b5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:44.889980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a260f-b7b1-4d69-9623-d5b0f8955817 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:44.894880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f5757-13d7-4c5b-818d-d3a46a407fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:44.895909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f5757-13d7-4c5b-818d-d3a46a407fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:44.895909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f5757-13d7-4c5b-818d-d3a46a407fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:44.896548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f5757-13d7-4c5b-818d-d3a46a407fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:44.898971 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-168f5757-13d7-4c5b-818d-d3a46a407fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:44.903846 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6263a-bea1-401c-af66-9568a59ae1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:44.905824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6263a-bea1-401c-af66-9568a59ae1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:44.906621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6263a-bea1-401c-af66-9568a59ae1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:44.907660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6263a-bea1-401c-af66-9568a59ae1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:44.909626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6263a-bea1-401c-af66-9568a59ae1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:44.915857 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6263a-bea1-401c-af66-9568a59ae1e0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:44.917204 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f5757-13d7-4c5b-818d-d3a46a407fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:44.918721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f5757-13d7-4c5b-818d-d3a46a407fd6 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:44.952018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 999/1962] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:44.953272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6263a-bea1-401c-af66-9568a59ae1e0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:44.956349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 964/1963] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:44.971199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6263a-bea1-401c-af66-9568a59ae1e0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:44.979238 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079a4a6-39eb-4d82-80e8-91c8fcc371de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:44.980696 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079a4a6-39eb-4d82-80e8-91c8fcc371de admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:44.981179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079a4a6-39eb-4d82-80e8-91c8fcc371de admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:44.981798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079a4a6-39eb-4d82-80e8-91c8fcc371de admin admin] PATH_INFO: `/v3/projects/16d6ae0275264baaba2c0b089f4232c2/users/c63892450ae246d196353136ddb85b5a/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:44.984400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079a4a6-39eb-4d82-80e8-91c8fcc371de admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d6ae0275264baaba2c0b089f4232c2, user_id=c63892450ae246d196353136ddb85b5a, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:44.988574 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079a4a6-39eb-4d82-80e8-91c8fcc371de admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:45.032242 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1000/1964] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:44 2022] PUT /identity/v3/projects/16d6ae0275264baaba2c0b089f4232c2/users/c63892450ae246d196353136ddb85b5a/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:45.034492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bb027-3cc4-4386-97f2-34de211e381c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:45.036246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bb027-3cc4-4386-97f2-34de211e381c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:45.036789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bb027-3cc4-4386-97f2-34de211e381c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:45.101443 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0b8bb027-3cc4-4386-97f2-34de211e381c None None] MFA Rules not processed for user `c63892450ae246d196353136ddb85b5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:45.102721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0b8bb027-3cc4-4386-97f2-34de211e381c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:45.233156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079a4a6-39eb-4d82-80e8-91c8fcc371de admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:45.243585 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d079a4a6-39eb-4d82-80e8-91c8fcc371de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:45.279051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:45.287169 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 965/1965] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:45.297370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bb027-3cc4-4386-97f2-34de211e381c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:45.305640 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0b8bb027-3cc4-4386-97f2-34de211e381c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:45.339106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:45.370988 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079a4a6-39eb-4d82-80e8-91c8fcc371de admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:45.380272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b2f4a-8ef1-4d50-829f-7c050d7f82e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:45.381510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b2f4a-8ef1-4d50-829f-7c050d7f82e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:45.381797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b2f4a-8ef1-4d50-829f-7c050d7f82e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:45.382087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b2f4a-8ef1-4d50-829f-7c050d7f82e0 admin admin] PATH_INFO: `/v3/projects/b52ba7a907a74d2da3987e3f49bd64be` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:45.384591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b2f4a-8ef1-4d50-829f-7c050d7f82e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52ba7a907a74d2da3987e3f49bd64be)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:45.391073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b2f4a-8ef1-4d50-829f-7c050d7f82e0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:45.428209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bb027-3cc4-4386-97f2-34de211e381c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:45.435209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118a52d-d035-4a4a-8d2d-703b774f942e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:45.436401 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118a52d-d035-4a4a-8d2d-703b774f942e service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:45.436865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118a52d-d035-4a4a-8d2d-703b774f942e service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:45.437372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118a52d-d035-4a4a-8d2d-703b774f942e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:45.439945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a118a52d-d035-4a4a-8d2d-703b774f942e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:45.490791 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-554b2f4a-8ef1-4d50-829f-7c050d7f82e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52ba7a907a74d2da3987e3f49bd64be', 'request_id': 'req-554b2f4a-8ef1-4d50-829f-7c050d7f82e0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:45.504582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-554b2f4a-8ef1-4d50-829f-7c050d7f82e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52ba7a907a74d2da3987e3f49bd64be', 'request_id': 'req-554b2f4a-8ef1-4d50-829f-7c050d7f82e0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:45.530293 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-554b2f4a-8ef1-4d50-829f-7c050d7f82e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52ba7a907a74d2da3987e3f49bd64be', 'request_id': 'req-554b2f4a-8ef1-4d50-829f-7c050d7f82e0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:45.574698 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-554b2f4a-8ef1-4d50-829f-7c050d7f82e0 admin admin] The token cache is being invalidate because project b52ba7a907a74d2da3987e3f49bd64be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:45.575458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-554b2f4a-8ef1-4d50-829f-7c050d7f82e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:45.575977 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-554b2f4a-8ef1-4d50-829f-7c050d7f82e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:45.579175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118a52d-d035-4a4a-8d2d-703b774f942e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:45.580007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1001/1966] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:45 2022] DELETE /identity/v3/projects/b52ba7a907a74d2da3987e3f49bd64be => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:45.583839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118a52d-d035-4a4a-8d2d-703b774f942e service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:45.595039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00662c18-329a-41f8-b77b-51b50754d6eb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:45.595333 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00662c18-329a-41f8-b77b-51b50754d6eb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:45.595617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00662c18-329a-41f8-b77b-51b50754d6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:45.596414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 966/1967] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:45.635411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-00662c18-329a-41f8-b77b-51b50754d6eb None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:45.636684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-00662c18-329a-41f8-b77b-51b50754d6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:45.810755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1002/1968] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:45.822691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a80da-a886-43e7-aa67-bf7517014142 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:45.823006 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a80da-a886-43e7-aa67-bf7517014142 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:45.823287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a80da-a886-43e7-aa67-bf7517014142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:45.825807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00662c18-329a-41f8-b77b-51b50754d6eb None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:45.829433 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-00662c18-329a-41f8-b77b-51b50754d6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:45.848041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00662c18-329a-41f8-b77b-51b50754d6eb None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:45.849139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e92a80da-a886-43e7-aa67-bf7517014142 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:45.867105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e92a80da-a886-43e7-aa67-bf7517014142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:45.867498 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66695b-c356-4a3a-95e5-2ea90f63a35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:45.868856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66695b-c356-4a3a-95e5-2ea90f63a35f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:45.869355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66695b-c356-4a3a-95e5-2ea90f63a35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:45.870016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66695b-c356-4a3a-95e5-2ea90f63a35f admin admin] PATH_INFO: `/v3/projects/36da467eda3349a385599dbced7b2370` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:45.881881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66695b-c356-4a3a-95e5-2ea90f63a35f admin admin] RBAC: Authorizing `identity:delete_project(project_id=36da467eda3349a385599dbced7b2370)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:45.883161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 967/1969] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:45.886876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a80da-a886-43e7-aa67-bf7517014142 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:45.886876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e92a80da-a886-43e7-aa67-bf7517014142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:45.887100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66695b-c356-4a3a-95e5-2ea90f63a35f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:45.911210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a80da-a886-43e7-aa67-bf7517014142 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:45.918362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde1b83-ac04-44ff-b84f-45137ba1345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:45.919458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde1b83-ac04-44ff-b84f-45137ba1345f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:45.919934 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde1b83-ac04-44ff-b84f-45137ba1345f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:45.920436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde1b83-ac04-44ff-b84f-45137ba1345f admin admin] PATH_INFO: `/v3/projects/0a67a9fc90e14213b2a81800192a63cc` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:45.924501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde1b83-ac04-44ff-b84f-45137ba1345f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a67a9fc90e14213b2a81800192a63cc)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:45.927655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde1b83-ac04-44ff-b84f-45137ba1345f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:45.962333 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:45.978606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ed66695b-c356-4a3a-95e5-2ea90f63a35f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36da467eda3349a385599dbced7b2370', 'request_id': 'req-ed66695b-c356-4a3a-95e5-2ea90f63a35f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:45.992131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ed66695b-c356-4a3a-95e5-2ea90f63a35f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36da467eda3349a385599dbced7b2370', 'request_id': 'req-ed66695b-c356-4a3a-95e5-2ea90f63a35f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:46.005514 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ed66695b-c356-4a3a-95e5-2ea90f63a35f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36da467eda3349a385599dbced7b2370', 'request_id': 'req-ed66695b-c356-4a3a-95e5-2ea90f63a35f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:46.024608 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fbde1b83-ac04-44ff-b84f-45137ba1345f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a67a9fc90e14213b2a81800192a63cc', 'request_id': 'req-fbde1b83-ac04-44ff-b84f-45137ba1345f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:46.025272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ed66695b-c356-4a3a-95e5-2ea90f63a35f admin admin] The token cache is being invalidate because project 36da467eda3349a385599dbced7b2370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:46.025759 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ed66695b-c356-4a3a-95e5-2ea90f63a35f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:46.026993 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ed66695b-c356-4a3a-95e5-2ea90f63a35f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:46.030017 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1003/1970] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:45 2022] DELETE /identity/v3/projects/36da467eda3349a385599dbced7b2370 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:46.031046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66695b-c356-4a3a-95e5-2ea90f63a35f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:46.035545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ed66695b-c356-4a3a-95e5-2ea90f63a35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:46.038084 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fbde1b83-ac04-44ff-b84f-45137ba1345f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a67a9fc90e14213b2a81800192a63cc', 'request_id': 'req-fbde1b83-ac04-44ff-b84f-45137ba1345f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:46.061559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fbde1b83-ac04-44ff-b84f-45137ba1345f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a67a9fc90e14213b2a81800192a63cc', 'request_id': 'req-fbde1b83-ac04-44ff-b84f-45137ba1345f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:46.082874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fbde1b83-ac04-44ff-b84f-45137ba1345f admin admin] The token cache is being invalidate because project 0a67a9fc90e14213b2a81800192a63cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:46.085936 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fbde1b83-ac04-44ff-b84f-45137ba1345f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:46.088032 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fbde1b83-ac04-44ff-b84f-45137ba1345f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:46.090911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 968/1971] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:45 2022] DELETE /identity/v3/projects/0a67a9fc90e14213b2a81800192a63cc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:46.093593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d104-93d9-4829-bbaf-f9ad77d52c4d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:46.093925 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d104-93d9-4829-bbaf-f9ad77d52c4d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:46.095166 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00d104-93d9-4829-bbaf-f9ad77d52c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:46.125471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3a00d104-93d9-4829-bbaf-f9ad77d52c4d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:46.131287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3a00d104-93d9-4829-bbaf-f9ad77d52c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:46.180363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66695b-c356-4a3a-95e5-2ea90f63a35f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:46.252556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:46.287176 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 969/1972] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:46.288178 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d104-93d9-4829-bbaf-f9ad77d52c4d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:46.290087 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3a00d104-93d9-4829-bbaf-f9ad77d52c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:46.309448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00d104-93d9-4829-bbaf-f9ad77d52c4d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:46.311481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeca0b3-0b73-48a7-b05d-729fc5b7f2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:46.312319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca0b3-0b73-48a7-b05d-729fc5b7f2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:46.312712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca0b3-0b73-48a7-b05d-729fc5b7f2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:46.313161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeca0b3-0b73-48a7-b05d-729fc5b7f2f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:46.313893 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeca0b3-0b73-48a7-b05d-729fc5b7f2f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:46.314230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeca0b3-0b73-48a7-b05d-729fc5b7f2f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:46.316187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeca0b3-0b73-48a7-b05d-729fc5b7f2f9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:46.317611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d99242-1910-4fef-b8bf-14fae2ae64b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:46.319584 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d99242-1910-4fef-b8bf-14fae2ae64b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:46.319905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d99242-1910-4fef-b8bf-14fae2ae64b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:46.322420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d99242-1910-4fef-b8bf-14fae2ae64b1 admin admin] PATH_INFO: `/v3/users/d446f929b95640468c6f1481e37472ed` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:46.324111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d99242-1910-4fef-b8bf-14fae2ae64b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d446f929b95640468c6f1481e37472ed)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:46.326101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d99242-1910-4fef-b8bf-14fae2ae64b1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:46.335371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1004/1973] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:46.335371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818269b7-a234-4d87-8a1d-7f2d963e80fa None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:46.335371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818269b7-a234-4d87-8a1d-7f2d963e80fa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:46.335371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818269b7-a234-4d87-8a1d-7f2d963e80fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:46.371106 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-818269b7-a234-4d87-8a1d-7f2d963e80fa None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:46.372929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-818269b7-a234-4d87-8a1d-7f2d963e80fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:46.384193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1005/1974] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:46.387756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818269b7-a234-4d87-8a1d-7f2d963e80fa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:46.387756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-818269b7-a234-4d87-8a1d-7f2d963e80fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:46.399428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-51d99242-1910-4fef-b8bf-14fae2ae64b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd446f929b95640468c6f1481e37472ed'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:46.402905 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818269b7-a234-4d87-8a1d-7f2d963e80fa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:46.409125 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-51d99242-1910-4fef-b8bf-14fae2ae64b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd446f929b95640468c6f1481e37472ed'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:46.409392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddacf7-0bfe-4a7e-a0f4-7be92ecc3bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:46.410317 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddacf7-0bfe-4a7e-a0f4-7be92ecc3bf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:46.410758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddacf7-0bfe-4a7e-a0f4-7be92ecc3bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:46.411182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ddacf7-0bfe-4a7e-a0f4-7be92ecc3bf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:46.412168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddacf7-0bfe-4a7e-a0f4-7be92ecc3bf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:46.415055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ddacf7-0bfe-4a7e-a0f4-7be92ecc3bf0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:46.420109 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-51d99242-1910-4fef-b8bf-14fae2ae64b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd446f929b95640468c6f1481e37472ed'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:46.421151 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-51d99242-1910-4fef-b8bf-14fae2ae64b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd446f929b95640468c6f1481e37472ed'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:46.422183 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-51d99242-1910-4fef-b8bf-14fae2ae64b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd446f929b95640468c6f1481e37472ed'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:46.449086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 970/1975] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:46 2022] DELETE /identity/v3/users/d446f929b95640468c6f1481e37472ed => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:46.450018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d99242-1910-4fef-b8bf-14fae2ae64b1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:46.451420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-51d99242-1910-4fef-b8bf-14fae2ae64b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:46.460569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1006/1976] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:46 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:46.461704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddacf7-0bfe-4a7e-a0f4-7be92ecc3bf0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:46.463457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-10ddacf7-0bfe-4a7e-a0f4-7be92ecc3bf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:46.528135 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:46.542640 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d99242-1910-4fef-b8bf-14fae2ae64b1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:46.572016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ddacf7-0bfe-4a7e-a0f4-7be92ecc3bf0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:46.579370 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd502c-8e9a-4b14-ac7a-2b85f92e25d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:46.581933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd502c-8e9a-4b14-ac7a-2b85f92e25d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:46.582432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd502c-8e9a-4b14-ac7a-2b85f92e25d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:46.582884 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd502c-8e9a-4b14-ac7a-2b85f92e25d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:46.583899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd502c-8e9a-4b14-ac7a-2b85f92e25d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:46.587824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd502c-8e9a-4b14-ac7a-2b85f92e25d9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:46.616722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1007/1977] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:46 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:06:46.621470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd502c-8e9a-4b14-ac7a-2b85f92e25d9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:46.628004 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc10f0b-cfae-4bd3-bd9a-52d3bdfe7295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:46.628932 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc10f0b-cfae-4bd3-bd9a-52d3bdfe7295 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:46.629273 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc10f0b-cfae-4bd3-bd9a-52d3bdfe7295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:46.629899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc10f0b-cfae-4bd3-bd9a-52d3bdfe7295 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:46.630807 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc10f0b-cfae-4bd3-bd9a-52d3bdfe7295 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:46.631773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc10f0b-cfae-4bd3-bd9a-52d3bdfe7295 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:46.633215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc10f0b-cfae-4bd3-bd9a-52d3bdfe7295 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:46.634854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd502c-8e9a-4b14-ac7a-2b85f92e25d9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:46.641048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19290270-0898-4f8f-8693-9bc445c4d179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:46.641945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:46.643150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19290270-0898-4f8f-8693-9bc445c4d179 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:46.643416 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19290270-0898-4f8f-8693-9bc445c4d179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:46.643790 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19290270-0898-4f8f-8693-9bc445c4d179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:46.644660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19290270-0898-4f8f-8693-9bc445c4d179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:46.646760 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19290270-0898-4f8f-8693-9bc445c4d179 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:46.655624 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 971/1978] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:46.657262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc10f0b-cfae-4bd3-bd9a-52d3bdfe7295 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:46.669845 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1008/1979] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:46.670870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19290270-0898-4f8f-8693-9bc445c4d179 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:46.684819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19290270-0898-4f8f-8693-9bc445c4d179 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:46.689488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc10f0b-cfae-4bd3-bd9a-52d3bdfe7295 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:46.690015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a39b8-56ff-4fe5-b580-0b9af63569b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:46.691053 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a39b8-56ff-4fe5-b580-0b9af63569b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:46.691354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a39b8-56ff-4fe5-b580-0b9af63569b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:46.691619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a39b8-56ff-4fe5-b580-0b9af63569b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:46.692372 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a39b8-56ff-4fe5-b580-0b9af63569b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:46.694398 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a39b8-56ff-4fe5-b580-0b9af63569b8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:46.699781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8251ab-7839-4901-871d-abc57dc13ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:46.700634 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8251ab-7839-4901-871d-abc57dc13ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:46.700930 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8251ab-7839-4901-871d-abc57dc13ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:46.701563 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8251ab-7839-4901-871d-abc57dc13ff1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:46.701912 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8251ab-7839-4901-871d-abc57dc13ff1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:46.704358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8251ab-7839-4901-871d-abc57dc13ff1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:46.723855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1009/1980] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:46.728164 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a39b8-56ff-4fe5-b580-0b9af63569b8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:46.741671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a39b8-56ff-4fe5-b580-0b9af63569b8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:46.760755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e457ea2-296b-4733-81b1-ed5f0eb2ee92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:46.761515 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 972/1981] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:46 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:46.761624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e457ea2-296b-4733-81b1-ed5f0eb2ee92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:46.761891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e457ea2-296b-4733-81b1-ed5f0eb2ee92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:46.762229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e457ea2-296b-4733-81b1-ed5f0eb2ee92 admin admin] PATH_INFO: `/v3/projects/925c835f8bdc4153ac07243e579762c0/users/292469a3b5724f7da048fb0c6472e92e/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:46.764171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8251ab-7839-4901-871d-abc57dc13ff1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:46.781595 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e457ea2-296b-4733-81b1-ed5f0eb2ee92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=925c835f8bdc4153ac07243e579762c0, user_id=292469a3b5724f7da048fb0c6472e92e, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:46.785021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e457ea2-296b-4733-81b1-ed5f0eb2ee92 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:46.803299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1010/1982] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:46 2022] PUT /identity/v3/projects/925c835f8bdc4153ac07243e579762c0/users/292469a3b5724f7da048fb0c6472e92e/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:46.816363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb0704-80bd-43fb-85fd-49882a806564 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:46.816692 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb0704-80bd-43fb-85fd-49882a806564 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:46.816931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb0704-80bd-43fb-85fd-49882a806564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:46.881713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-dabb0704-80bd-43fb-85fd-49882a806564 None None] MFA Rules not processed for user `292469a3b5724f7da048fb0c6472e92e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:46.884133 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dabb0704-80bd-43fb-85fd-49882a806564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:46.913992 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8251ab-7839-4901-871d-abc57dc13ff1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:47.029911 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1011/1983] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:06:47.030962 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb0704-80bd-43fb-85fd-49882a806564 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:47.037218 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-dabb0704-80bd-43fb-85fd-49882a806564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:47.077865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1090f77-b4a2-4907-a8d4-0c220cef6722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:47.078651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1090f77-b4a2-4907-a8d4-0c220cef6722 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:47.078961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1090f77-b4a2-4907-a8d4-0c220cef6722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:47.079866 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1090f77-b4a2-4907-a8d4-0c220cef6722 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:47.081764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1090f77-b4a2-4907-a8d4-0c220cef6722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:47.092245 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1090f77-b4a2-4907-a8d4-0c220cef6722 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:47.140048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 973/1984] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:46 2022] POST /identity/v3/users => generated 293 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:47.141363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1090f77-b4a2-4907-a8d4-0c220cef6722 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:47.143984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f1090f77-b4a2-4907-a8d4-0c220cef6722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:47.191836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb0704-80bd-43fb-85fd-49882a806564 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:47.198407 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d2a4d-4d60-43ef-ace2-129cf52ad5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:47.199767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d2a4d-4d60-43ef-ace2-129cf52ad5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:47.200264 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d2a4d-4d60-43ef-ace2-129cf52ad5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:47.200728 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d2a4d-4d60-43ef-ace2-129cf52ad5f0 admin admin] PATH_INFO: `/v3/projects/119150c43e8c44d0a0a3d4043dd6eed0` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:47.203286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d2a4d-4d60-43ef-ace2-129cf52ad5f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119150c43e8c44d0a0a3d4043dd6eed0)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:47.207597 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d2a4d-4d60-43ef-ace2-129cf52ad5f0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:47.223203 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1090f77-b4a2-4907-a8d4-0c220cef6722 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:47.229439 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368b7fe-b4ba-405c-8bdf-0f396f66cac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:47.230202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368b7fe-b4ba-405c-8bdf-0f396f66cac5 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:47.230550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368b7fe-b4ba-405c-8bdf-0f396f66cac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:47.230970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368b7fe-b4ba-405c-8bdf-0f396f66cac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:47.233406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:47.243137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368b7fe-b4ba-405c-8bdf-0f396f66cac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:47.245688 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368b7fe-b4ba-405c-8bdf-0f396f66cac5 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:47.257303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 974/1985] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:47.258290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368b7fe-b4ba-405c-8bdf-0f396f66cac5 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:47.275097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368b7fe-b4ba-405c-8bdf-0f396f66cac5 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:47.281215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fb0c6-e0b7-4d0f-85d2-66467ccf5c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:47.282238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fb0c6-e0b7-4d0f-85d2-66467ccf5c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:47.282238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fb0c6-e0b7-4d0f-85d2-66467ccf5c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:47.282632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963fb0c6-e0b7-4d0f-85d2-66467ccf5c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:47.283405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fb0c6-e0b7-4d0f-85d2-66467ccf5c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:47.285376 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963fb0c6-e0b7-4d0f-85d2-66467ccf5c0f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:47.299026 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 975/1986] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:47.303341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fb0c6-e0b7-4d0f-85d2-66467ccf5c0f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:47.312380 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:47.338467 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963fb0c6-e0b7-4d0f-85d2-66467ccf5c0f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:47.341536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8a9d2a4d-4d60-43ef-ace2-129cf52ad5f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119150c43e8c44d0a0a3d4043dd6eed0', 'request_id': 'req-8a9d2a4d-4d60-43ef-ace2-129cf52ad5f0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:47.367936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8a9d2a4d-4d60-43ef-ace2-129cf52ad5f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119150c43e8c44d0a0a3d4043dd6eed0', 'request_id': 'req-8a9d2a4d-4d60-43ef-ace2-129cf52ad5f0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:47.378694 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8a9d2a4d-4d60-43ef-ace2-129cf52ad5f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119150c43e8c44d0a0a3d4043dd6eed0', 'request_id': 'req-8a9d2a4d-4d60-43ef-ace2-129cf52ad5f0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:47.408500 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8a9d2a4d-4d60-43ef-ace2-129cf52ad5f0 admin admin] The token cache is being invalidate because project 119150c43e8c44d0a0a3d4043dd6eed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:47.408852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8a9d2a4d-4d60-43ef-ace2-129cf52ad5f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:47.413788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8a9d2a4d-4d60-43ef-ace2-129cf52ad5f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:47.416138 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1012/1987] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:47 2022] DELETE /identity/v3/projects/119150c43e8c44d0a0a3d4043dd6eed0 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:47.424907 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd1a8e-c0a9-4463-92c3-995bf757bfa5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:47.425288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd1a8e-c0a9-4463-92c3-995bf757bfa5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:47.426224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd1a8e-c0a9-4463-92c3-995bf757bfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:47.459237 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-effd1a8e-c0a9-4463-92c3-995bf757bfa5 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:47.461850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-effd1a8e-c0a9-4463-92c3-995bf757bfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:47.508632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21781b0-d2f9-465d-831f-52c7c1f34dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:47.509442 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21781b0-d2f9-465d-831f-52c7c1f34dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:47.509724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21781b0-d2f9-465d-831f-52c7c1f34dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:47.510656 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21781b0-d2f9-465d-831f-52c7c1f34dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:47.511649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21781b0-d2f9-465d-831f-52c7c1f34dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:47.516367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21781b0-d2f9-465d-831f-52c7c1f34dd6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:47.551366 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 976/1988] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:47.554693 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21781b0-d2f9-465d-831f-52c7c1f34dd6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:47.557266 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d21781b0-d2f9-465d-831f-52c7c1f34dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:47.575744 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21781b0-d2f9-465d-831f-52c7c1f34dd6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:47.583086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92a559-cfa6-4524-83b4-c08ba5bd11c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:47.584391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92a559-cfa6-4524-83b4-c08ba5bd11c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:47.585110 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92a559-cfa6-4524-83b4-c08ba5bd11c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:47.585568 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92a559-cfa6-4524-83b4-c08ba5bd11c7 admin admin] PATH_INFO: `/v3/projects/557ac086902442c0b9f6a855d3d946ab/users/0a1ca689ca2e42729f28aa50f2cb3984/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:47.612632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92a559-cfa6-4524-83b4-c08ba5bd11c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=557ac086902442c0b9f6a855d3d946ab, user_id=0a1ca689ca2e42729f28aa50f2cb3984, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:47.615742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92a559-cfa6-4524-83b4-c08ba5bd11c7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:47.632484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1013/1989] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:47.634945 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd1a8e-c0a9-4463-92c3-995bf757bfa5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:47.637132 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-effd1a8e-c0a9-4463-92c3-995bf757bfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:47.646851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 977/1990] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:47 2022] PUT /identity/v3/projects/557ac086902442c0b9f6a855d3d946ab/users/0a1ca689ca2e42729f28aa50f2cb3984/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:47.646851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5300e9-c64a-4384-a79a-5c07aae2b7b6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:47.646851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5300e9-c64a-4384-a79a-5c07aae2b7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:47.646851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5300e9-c64a-4384-a79a-5c07aae2b7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:47.670188 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3c5300e9-c64a-4384-a79a-5c07aae2b7b6 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:47.673196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3c5300e9-c64a-4384-a79a-5c07aae2b7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:47.784118 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd1a8e-c0a9-4463-92c3-995bf757bfa5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:47.840987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 978/1991] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:06:47.842143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c68d8-0564-403d-b939-e6810ac10e27 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:47.842589 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c68d8-0564-403d-b939-e6810ac10e27 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:47.844524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c68d8-0564-403d-b939-e6810ac10e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:47.884822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-404c68d8-0564-403d-b939-e6810ac10e27 None None] MFA Rules not processed for user `0a1ca689ca2e42729f28aa50f2cb3984`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:47.886125 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-404c68d8-0564-403d-b939-e6810ac10e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:47.918666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c30c9-17cb-4132-a31d-84e4f9aa810f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:47.919532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c30c9-17cb-4132-a31d-84e4f9aa810f service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:47.919824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c30c9-17cb-4132-a31d-84e4f9aa810f service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:47.920218 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c30c9-17cb-4132-a31d-84e4f9aa810f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:47.925960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a97c30c9-17cb-4132-a31d-84e4f9aa810f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:47.959525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:48.060146 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 979/1992] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:48.060146 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c68d8-0564-403d-b939-e6810ac10e27 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:48.082550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c68d8-0564-403d-b939-e6810ac10e27 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:48.090005 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57906abd-fc10-436b-8b60-1c501b28ac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:48.090993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57906abd-fc10-436b-8b60-1c501b28ac2b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:48.091368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57906abd-fc10-436b-8b60-1c501b28ac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:48.091864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57906abd-fc10-436b-8b60-1c501b28ac2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:48.092713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57906abd-fc10-436b-8b60-1c501b28ac2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:48.093261 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57906abd-fc10-436b-8b60-1c501b28ac2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:48.095099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57906abd-fc10-436b-8b60-1c501b28ac2b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:48.097686 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:48.099729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c30c9-17cb-4132-a31d-84e4f9aa810f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:48.101754 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c30c9-17cb-4132-a31d-84e4f9aa810f service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:48.115361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 980/1993] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:48.121459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57906abd-fc10-436b-8b60-1c501b28ac2b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:48.135190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1014/1994] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:48.137437 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57906abd-fc10-436b-8b60-1c501b28ac2b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:48.151134 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6798b-6186-4555-ba67-a2d0f601b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:48.151853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6798b-6186-4555-ba67-a2d0f601b5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:48.152140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6798b-6186-4555-ba67-a2d0f601b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:48.152423 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6798b-6186-4555-ba67-a2d0f601b5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:48.153152 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6798b-6186-4555-ba67-a2d0f601b5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:48.156207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6798b-6186-4555-ba67-a2d0f601b5e6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:48.216953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 981/1995] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:48 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:48.218253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c30c9-17cb-4132-a31d-84e4f9aa810f service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:48.244431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6798b-6186-4555-ba67-a2d0f601b5e6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:48.248089 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bfb6798b-6186-4555-ba67-a2d0f601b5e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:48.257956 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c30c9-17cb-4132-a31d-84e4f9aa810f service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:48.389539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6798b-6186-4555-ba67-a2d0f601b5e6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:48.399550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c8a60-cfcf-4929-b1fe-d285195f865c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:48.399796 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c8a60-cfcf-4929-b1fe-d285195f865c service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:48.400060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c8a60-cfcf-4929-b1fe-d285195f865c service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:48.400337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c8a60-cfcf-4929-b1fe-d285195f865c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:48.419819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c67292-3403-4461-a9af-9c7c87063206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:48.421359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c67292-3403-4461-a9af-9c7c87063206 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:48.421641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c67292-3403-4461-a9af-9c7c87063206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:48.424114 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c67292-3403-4461-a9af-9c7c87063206 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:48.427727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c67292-3403-4461-a9af-9c7c87063206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:48.433540 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c67292-3403-4461-a9af-9c7c87063206 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:48.472208 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1015/1996] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:48 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:48.475435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c67292-3403-4461-a9af-9c7c87063206 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:48.497943 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c67292-3403-4461-a9af-9c7c87063206 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:48.513392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd40617-31e0-43ca-a43f-c2d9fd0056c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:48.514112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd40617-31e0-43ca-a43f-c2d9fd0056c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:48.514569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd40617-31e0-43ca-a43f-c2d9fd0056c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:48.514883 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd40617-31e0-43ca-a43f-c2d9fd0056c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:48.518355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd40617-31e0-43ca-a43f-c2d9fd0056c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:48.523621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd40617-31e0-43ca-a43f-c2d9fd0056c0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:48.551506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1016/1997] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:06:48.556056 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c8a60-cfcf-4929-b1fe-d285195f865c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:48.557609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c8a60-cfcf-4929-b1fe-d285195f865c service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:48.564594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd40617-31e0-43ca-a43f-c2d9fd0056c0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:48.575367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 982/1998] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:06:48.599143 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd40617-31e0-43ca-a43f-c2d9fd0056c0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:48.611032 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c8a60-cfcf-4929-b1fe-d285195f865c service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:48.614456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67414b-7044-40a0-adfa-10698e1e88fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:48.615273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67414b-7044-40a0-adfa-10698e1e88fd admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:48.615696 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67414b-7044-40a0-adfa-10698e1e88fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:48.615993 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67414b-7044-40a0-adfa-10698e1e88fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:48.616943 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67414b-7044-40a0-adfa-10698e1e88fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:48.619425 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67414b-7044-40a0-adfa-10698e1e88fd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:48.646376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1017/1999] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:48.651108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c8a60-cfcf-4929-b1fe-d285195f865c service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:48.651530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67414b-7044-40a0-adfa-10698e1e88fd admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:48.661758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a69d3-d3f0-4ae0-93b1-de8a506b1bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:48.662909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a69d3-d3f0-4ae0-93b1-de8a506b1bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:48.663315 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a69d3-d3f0-4ae0-93b1-de8a506b1bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:48.663671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a69d3-d3f0-4ae0-93b1-de8a506b1bca admin admin] PATH_INFO: `/v3/users/0a1ca689ca2e42729f28aa50f2cb3984` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:48.675913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a69d3-d3f0-4ae0-93b1-de8a506b1bca admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a1ca689ca2e42729f28aa50f2cb3984)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:48.677982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a69d3-d3f0-4ae0-93b1-de8a506b1bca admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:48.682742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67414b-7044-40a0-adfa-10698e1e88fd admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:48.696249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd7533-c733-4153-874b-6f238b9eb725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:48.698688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd7533-c733-4153-874b-6f238b9eb725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:48.699240 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd7533-c733-4153-874b-6f238b9eb725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:48.706331 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd7533-c733-4153-874b-6f238b9eb725 admin admin] PATH_INFO: `/v3/projects/88652b4751f347cab5cd85ff6bddfd2a/users/cc6353d2796847ff89a4cf47872bee44/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:48.744723 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd7533-c733-4153-874b-6f238b9eb725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88652b4751f347cab5cd85ff6bddfd2a, user_id=cc6353d2796847ff89a4cf47872bee44, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:48.751205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd7533-c733-4153-874b-6f238b9eb725 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:48.785922 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9b3a69d3-d3f0-4ae0-93b1-de8a506b1bca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a1ca689ca2e42729f28aa50f2cb3984'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:48.795645 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1018/2000] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:48 2022] PUT /identity/v3/projects/88652b4751f347cab5cd85ff6bddfd2a/users/cc6353d2796847ff89a4cf47872bee44/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:48.811558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9b3a69d3-d3f0-4ae0-93b1-de8a506b1bca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a1ca689ca2e42729f28aa50f2cb3984'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:48.811965 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd16993-405b-44cb-b5c6-cc9180c801b4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:48.812128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd16993-405b-44cb-b5c6-cc9180c801b4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:48.812415 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd16993-405b-44cb-b5c6-cc9180c801b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:48.822587 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9b3a69d3-d3f0-4ae0-93b1-de8a506b1bca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a1ca689ca2e42729f28aa50f2cb3984'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:48.823729 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9b3a69d3-d3f0-4ae0-93b1-de8a506b1bca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a1ca689ca2e42729f28aa50f2cb3984'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:48.824082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9b3a69d3-d3f0-4ae0-93b1-de8a506b1bca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a1ca689ca2e42729f28aa50f2cb3984'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:48.846196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:48.851242 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2fd16993-405b-44cb-b5c6-cc9180c801b4 None None] MFA Rules not processed for user `cc6353d2796847ff89a4cf47872bee44`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:48.852877 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2fd16993-405b-44cb-b5c6-cc9180c801b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:48.854868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 983/2001] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:48 2022] DELETE /identity/v3/users/0a1ca689ca2e42729f28aa50f2cb3984 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:48.859196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b93831-4de6-4b3d-be8b-a1b42c9090a2 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:48.860055 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b93831-4de6-4b3d-be8b-a1b42c9090a2 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:48.860346 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b93831-4de6-4b3d-be8b-a1b42c9090a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:48.883069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d9b93831-4de6-4b3d-be8b-a1b42c9090a2 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:48.885217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d9b93831-4de6-4b3d-be8b-a1b42c9090a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:48.901053 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:48.937838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1019/2002] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:48.952944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd16993-405b-44cb-b5c6-cc9180c801b4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:48.956383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2fd16993-405b-44cb-b5c6-cc9180c801b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:48.978139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 984/2003] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:06:48.990977 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b93831-4de6-4b3d-be8b-a1b42c9090a2 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:48.993432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd16993-405b-44cb-b5c6-cc9180c801b4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:48.998631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d9b93831-4de6-4b3d-be8b-a1b42c9090a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:49.000555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f197c8e-8e2e-4238-ae2e-b95d3c0b5484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:49.001393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f197c8e-8e2e-4238-ae2e-b95d3c0b5484 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:49.001683 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f197c8e-8e2e-4238-ae2e-b95d3c0b5484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:49.002041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f197c8e-8e2e-4238-ae2e-b95d3c0b5484 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:49.003010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f197c8e-8e2e-4238-ae2e-b95d3c0b5484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:49.005690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f197c8e-8e2e-4238-ae2e-b95d3c0b5484 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:49.044748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1020/2004] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:48 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:49.048869 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f197c8e-8e2e-4238-ae2e-b95d3c0b5484 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:49.090383 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b93831-4de6-4b3d-be8b-a1b42c9090a2 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:49.129001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f197c8e-8e2e-4238-ae2e-b95d3c0b5484 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:49.133930 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a6170-77fe-40e0-a70a-143bd3a42ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:49.134622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a6170-77fe-40e0-a70a-143bd3a42ded admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:49.135025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a6170-77fe-40e0-a70a-143bd3a42ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:49.135292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a6170-77fe-40e0-a70a-143bd3a42ded admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:49.136129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a6170-77fe-40e0-a70a-143bd3a42ded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:49.138343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a6170-77fe-40e0-a70a-143bd3a42ded admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:49.145675 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379fad4-83a4-49d8-9d39-cb8b98ba8bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:49.146799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379fad4-83a4-49d8-9d39-cb8b98ba8bba service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:49.146799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379fad4-83a4-49d8-9d39-cb8b98ba8bba service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:49.146986 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379fad4-83a4-49d8-9d39-cb8b98ba8bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:49.157786 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379fad4-83a4-49d8-9d39-cb8b98ba8bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:49.159283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379fad4-83a4-49d8-9d39-cb8b98ba8bba service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:49.165069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1021/2005] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:49 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:49.166169 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a6170-77fe-40e0-a70a-143bd3a42ded admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:49.169926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 985/2006] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:49.177731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a6170-77fe-40e0-a70a-143bd3a42ded admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:49.182745 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f07f5b-ac1d-4e5c-b2c4-9abfa679f910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:49.183543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f07f5b-ac1d-4e5c-b2c4-9abfa679f910 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:49.183897 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f07f5b-ac1d-4e5c-b2c4-9abfa679f910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:49.184261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f07f5b-ac1d-4e5c-b2c4-9abfa679f910 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:49.185059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f07f5b-ac1d-4e5c-b2c4-9abfa679f910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:49.186668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f07f5b-ac1d-4e5c-b2c4-9abfa679f910 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:49.197660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1022/2007] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:49.202717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379fad4-83a4-49d8-9d39-cb8b98ba8bba service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:49.212726 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379fad4-83a4-49d8-9d39-cb8b98ba8bba service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:49.218187 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461af44-74c6-459d-a9ce-5075be84330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:49.219328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461af44-74c6-459d-a9ce-5075be84330a admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:49.219595 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461af44-74c6-459d-a9ce-5075be84330a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:49.219891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461af44-74c6-459d-a9ce-5075be84330a admin admin] PATH_INFO: `/v3/projects/bfcf308632f748579ca98bbe40fc55aa/users/c12db5b36e7d4abd9fe21ab98484de8c/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:49.236632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461af44-74c6-459d-a9ce-5075be84330a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfcf308632f748579ca98bbe40fc55aa, user_id=c12db5b36e7d4abd9fe21ab98484de8c, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:49.239375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461af44-74c6-459d-a9ce-5075be84330a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:49.255913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 986/2008] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:49 2022] PUT /identity/v3/projects/bfcf308632f748579ca98bbe40fc55aa/users/c12db5b36e7d4abd9fe21ab98484de8c/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:49.259988 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f07f5b-ac1d-4e5c-b2c4-9abfa679f910 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:49.270703 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f07f5b-ac1d-4e5c-b2c4-9abfa679f910 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:49.347302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca9c82-ed24-4b20-aeed-f90373388b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:49.348251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca9c82-ed24-4b20-aeed-f90373388b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:49.348606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca9c82-ed24-4b20-aeed-f90373388b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:49.349119 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca9c82-ed24-4b20-aeed-f90373388b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:49.350217 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca9c82-ed24-4b20-aeed-f90373388b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:49.352123 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca9c82-ed24-4b20-aeed-f90373388b4c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:49.365792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1023/2009] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:49.369947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461af44-74c6-459d-a9ce-5075be84330a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:49.382653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461af44-74c6-459d-a9ce-5075be84330a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:49.389327 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705366a-ba0f-4f42-b768-1697455f5176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:49.390311 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705366a-ba0f-4f42-b768-1697455f5176 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:49.390622 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705366a-ba0f-4f42-b768-1697455f5176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:49.390941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b705366a-ba0f-4f42-b768-1697455f5176 admin admin] PATH_INFO: `/v3/projects/bfcf308632f748579ca98bbe40fc55aa/users/c12db5b36e7d4abd9fe21ab98484de8c/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:49.393345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705366a-ba0f-4f42-b768-1697455f5176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfcf308632f748579ca98bbe40fc55aa, user_id=c12db5b36e7d4abd9fe21ab98484de8c, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:49.396592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b705366a-ba0f-4f42-b768-1697455f5176 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:49.410562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 987/2010] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:49 2022] PUT /identity/v3/projects/bfcf308632f748579ca98bbe40fc55aa/users/c12db5b36e7d4abd9fe21ab98484de8c/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:49.421710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6331aa6-4ea1-465a-b8ae-3c6e632cf240 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:49.422638 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6331aa6-4ea1-465a-b8ae-3c6e632cf240 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:49.422638 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6331aa6-4ea1-465a-b8ae-3c6e632cf240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:49.459003 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a6331aa6-4ea1-465a-b8ae-3c6e632cf240 None None] MFA Rules not processed for user `c12db5b36e7d4abd9fe21ab98484de8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:49.460325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a6331aa6-4ea1-465a-b8ae-3c6e632cf240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:49.505572 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:49.591174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1024/2011] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:49.603562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705366a-ba0f-4f42-b768-1697455f5176 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:49.606327 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b705366a-ba0f-4f42-b768-1697455f5176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:49.637487 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:49.659768 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6331aa6-4ea1-465a-b8ae-3c6e632cf240 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:49.661853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a6331aa6-4ea1-465a-b8ae-3c6e632cf240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:49.684861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b705366a-ba0f-4f42-b768-1697455f5176 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:49.688850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c9ae0-3740-4975-9e00-8043598b4488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:49.689538 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c9ae0-3740-4975-9e00-8043598b4488 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:49.689889 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c9ae0-3740-4975-9e00-8043598b4488 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:49.690378 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c9ae0-3740-4975-9e00-8043598b4488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:49.700690 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c9ae0-3740-4975-9e00-8043598b4488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:49.702192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c9ae0-3740-4975-9e00-8043598b4488 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:49.712378 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 988/2012] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:49.741535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6331aa6-4ea1-465a-b8ae-3c6e632cf240 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:49.746378 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494c73d-b326-4fa6-90c1-9e93f3f5467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:49.747298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494c73d-b326-4fa6-90c1-9e93f3f5467c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:49.747559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494c73d-b326-4fa6-90c1-9e93f3f5467c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:49.747863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494c73d-b326-4fa6-90c1-9e93f3f5467c admin admin] PATH_INFO: `/v3/projects/557ac086902442c0b9f6a855d3d946ab` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:49.749186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494c73d-b326-4fa6-90c1-9e93f3f5467c admin admin] RBAC: Authorizing `identity:delete_project(project_id=557ac086902442c0b9f6a855d3d946ab)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:49.751204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494c73d-b326-4fa6-90c1-9e93f3f5467c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:49.813538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9494c73d-b326-4fa6-90c1-9e93f3f5467c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '557ac086902442c0b9f6a855d3d946ab', 'request_id': 'req-9494c73d-b326-4fa6-90c1-9e93f3f5467c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:49.827404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9494c73d-b326-4fa6-90c1-9e93f3f5467c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '557ac086902442c0b9f6a855d3d946ab', 'request_id': 'req-9494c73d-b326-4fa6-90c1-9e93f3f5467c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:49.836545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9494c73d-b326-4fa6-90c1-9e93f3f5467c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '557ac086902442c0b9f6a855d3d946ab', 'request_id': 'req-9494c73d-b326-4fa6-90c1-9e93f3f5467c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:49.852109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9494c73d-b326-4fa6-90c1-9e93f3f5467c admin admin] The token cache is being invalidate because project 557ac086902442c0b9f6a855d3d946ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:49.852494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9494c73d-b326-4fa6-90c1-9e93f3f5467c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:49.853159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9494c73d-b326-4fa6-90c1-9e93f3f5467c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:49.855343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1025/2013] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:49 2022] DELETE /identity/v3/projects/557ac086902442c0b9f6a855d3d946ab => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:49.860162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbdd58-9f40-4a69-a52d-ab98e0603058 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:49.860663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbdd58-9f40-4a69-a52d-ab98e0603058 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:49.861010 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fbdd58-9f40-4a69-a52d-ab98e0603058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:49.881201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-17fbdd58-9f40-4a69-a52d-ab98e0603058 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:49.882562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-17fbdd58-9f40-4a69-a52d-ab98e0603058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:49.973224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 989/2014] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:06:49.983172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c22e29-a95e-4db1-97a6-90ddcebfd877 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:49.983460 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c22e29-a95e-4db1-97a6-90ddcebfd877 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:49.983738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c22e29-a95e-4db1-97a6-90ddcebfd877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:50.009456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d3c22e29-a95e-4db1-97a6-90ddcebfd877 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:50.011015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d3c22e29-a95e-4db1-97a6-90ddcebfd877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:50.022075 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1026/2015] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:50.026845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbdd58-9f40-4a69-a52d-ab98e0603058 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:50.037832 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fbdd58-9f40-4a69-a52d-ab98e0603058 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:50.042758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082602d-d445-460a-8aeb-18f7354f0d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:50.043461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082602d-d445-460a-8aeb-18f7354f0d29 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:50.043742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082602d-d445-460a-8aeb-18f7354f0d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:50.044018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082602d-d445-460a-8aeb-18f7354f0d29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:50.045021 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082602d-d445-460a-8aeb-18f7354f0d29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:50.045342 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082602d-d445-460a-8aeb-18f7354f0d29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:50.047440 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9082602d-d445-460a-8aeb-18f7354f0d29 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:50.070058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 990/2016] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:50.071012 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c22e29-a95e-4db1-97a6-90ddcebfd877 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:50.083036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c22e29-a95e-4db1-97a6-90ddcebfd877 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:50.088311 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacd11e-741e-4efb-9b55-2aa6d147f574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:50.089380 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacd11e-741e-4efb-9b55-2aa6d147f574 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:50.090059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacd11e-741e-4efb-9b55-2aa6d147f574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:50.090671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacd11e-741e-4efb-9b55-2aa6d147f574 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:50.092048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacd11e-741e-4efb-9b55-2aa6d147f574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:50.093957 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacd11e-741e-4efb-9b55-2aa6d147f574 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:50.126374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1027/2017] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:50 2022] POST /identity/v3/projects => generated 359 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:06:50.131132 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082602d-d445-460a-8aeb-18f7354f0d29 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:50.143946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082602d-d445-460a-8aeb-18f7354f0d29 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:50.259655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb0bec-e21d-4009-a0a6-c412d5c05304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:50.260892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb0bec-e21d-4009-a0a6-c412d5c05304 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:50.261473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb0bec-e21d-4009-a0a6-c412d5c05304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:50.262043 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb0bec-e21d-4009-a0a6-c412d5c05304 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:50.262923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb0bec-e21d-4009-a0a6-c412d5c05304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:50.265302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb0bec-e21d-4009-a0a6-c412d5c05304 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:50.293717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 991/2018] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:50 2022] POST /identity/v3/users => generated 280 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:50.297733 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacd11e-741e-4efb-9b55-2aa6d147f574 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:50.308487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacd11e-741e-4efb-9b55-2aa6d147f574 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:50.320797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccad4c-a85f-41cd-8fdc-78ddd68d5097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:50.321763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccad4c-a85f-41cd-8fdc-78ddd68d5097 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:50.322438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccad4c-a85f-41cd-8fdc-78ddd68d5097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:50.322921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccad4c-a85f-41cd-8fdc-78ddd68d5097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:50.324000 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddccad4c-a85f-41cd-8fdc-78ddd68d5097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:50.326917 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddccad4c-a85f-41cd-8fdc-78ddd68d5097 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:50.344443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1028/2019] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:50.348557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb0bec-e21d-4009-a0a6-c412d5c05304 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:50.364961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb0bec-e21d-4009-a0a6-c412d5c05304 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:50.372339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0189e-9561-4077-b4b5-025658c4577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:50.373241 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0189e-9561-4077-b4b5-025658c4577c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:50.374693 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0189e-9561-4077-b4b5-025658c4577c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:50.375113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0189e-9561-4077-b4b5-025658c4577c admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:50.376040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0189e-9561-4077-b4b5-025658c4577c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:50.378700 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0189e-9561-4077-b4b5-025658c4577c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:50.402052 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccad4c-a85f-41cd-8fdc-78ddd68d5097 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:50.406915 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 992/2020] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:50.416428 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccad4c-a85f-41cd-8fdc-78ddd68d5097 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:50.425420 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbef87c-a423-48ff-b0b9-72fb2981bb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:50.426357 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbef87c-a423-48ff-b0b9-72fb2981bb7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:50.426641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbef87c-a423-48ff-b0b9-72fb2981bb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:50.426999 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbef87c-a423-48ff-b0b9-72fb2981bb7d admin admin] PATH_INFO: `/v3/projects/1d20d580e6fb4cbc886d7c0b69a7234b/users/50083002aa9b4cd0bf6771f87946dc26/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:50.446597 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:50.472790 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbef87c-a423-48ff-b0b9-72fb2981bb7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d20d580e6fb4cbc886d7c0b69a7234b, user_id=50083002aa9b4cd0bf6771f87946dc26, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:50.478147 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbef87c-a423-48ff-b0b9-72fb2981bb7d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:50.500602 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1029/2021] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:50 2022] PUT /identity/v3/projects/1d20d580e6fb4cbc886d7c0b69a7234b/users/50083002aa9b4cd0bf6771f87946dc26/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:50.507972 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c01fe5-4531-40db-9c9a-1390929a174b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:50.508282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c01fe5-4531-40db-9c9a-1390929a174b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:50.508664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c01fe5-4531-40db-9c9a-1390929a174b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:50.558566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbef87c-a423-48ff-b0b9-72fb2981bb7d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:50.561910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6fbef87c-a423-48ff-b0b9-72fb2981bb7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:50.572114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e2c01fe5-4531-40db-9c9a-1390929a174b None None] MFA Rules not processed for user `50083002aa9b4cd0bf6771f87946dc26`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:50.574599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e2c01fe5-4531-40db-9c9a-1390929a174b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:50.603306 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:50.655548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbef87c-a423-48ff-b0b9-72fb2981bb7d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:50.665270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008f585-5bda-4a8e-8f8b-c112a32a48f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:50.666328 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008f585-5bda-4a8e-8f8b-c112a32a48f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:50.666608 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008f585-5bda-4a8e-8f8b-c112a32a48f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:50.666907 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008f585-5bda-4a8e-8f8b-c112a32a48f0 admin admin] PATH_INFO: `/v3/users/260c5bf223a44bb28867676a152814d2` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:50.670637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008f585-5bda-4a8e-8f8b-c112a32a48f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=260c5bf223a44bb28867676a152814d2)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:50.672636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008f585-5bda-4a8e-8f8b-c112a32a48f0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:50.699124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 993/2022] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:50 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:50.699893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c01fe5-4531-40db-9c9a-1390929a174b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:50.701391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e2c01fe5-4531-40db-9c9a-1390929a174b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:50.723662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c01fe5-4531-40db-9c9a-1390929a174b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:50.735641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e93264-2216-451d-ad9a-5b41a55b4f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:50.737341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e93264-2216-451d-ad9a-5b41a55b4f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:50.737984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e93264-2216-451d-ad9a-5b41a55b4f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:50.739075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e93264-2216-451d-ad9a-5b41a55b4f7f admin admin] PATH_INFO: `/v3/users/cc6353d2796847ff89a4cf47872bee44` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:50.741033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e93264-2216-451d-ad9a-5b41a55b4f7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc6353d2796847ff89a4cf47872bee44)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:50.743673 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e93264-2216-451d-ad9a-5b41a55b4f7f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:50.754807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9008f585-5bda-4a8e-8f8b-c112a32a48f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260c5bf223a44bb28867676a152814d2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:50.775316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9008f585-5bda-4a8e-8f8b-c112a32a48f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260c5bf223a44bb28867676a152814d2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:50.786772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9008f585-5bda-4a8e-8f8b-c112a32a48f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260c5bf223a44bb28867676a152814d2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:50.788627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9008f585-5bda-4a8e-8f8b-c112a32a48f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260c5bf223a44bb28867676a152814d2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:50.799086 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9008f585-5bda-4a8e-8f8b-c112a32a48f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260c5bf223a44bb28867676a152814d2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:50.806108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1030/2023] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:50 2022] DELETE /identity/v3/users/260c5bf223a44bb28867676a152814d2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:50.809356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008f585-5bda-4a8e-8f8b-c112a32a48f0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:50.809356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9008f585-5bda-4a8e-8f8b-c112a32a48f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:50.811135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-52e93264-2216-451d-ad9a-5b41a55b4f7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc6353d2796847ff89a4cf47872bee44'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:50.824965 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-52e93264-2216-451d-ad9a-5b41a55b4f7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc6353d2796847ff89a4cf47872bee44'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:50.842615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-52e93264-2216-451d-ad9a-5b41a55b4f7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc6353d2796847ff89a4cf47872bee44'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:50.843385 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-52e93264-2216-451d-ad9a-5b41a55b4f7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc6353d2796847ff89a4cf47872bee44'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:50.843996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-52e93264-2216-451d-ad9a-5b41a55b4f7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc6353d2796847ff89a4cf47872bee44'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:50.870323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 994/2024] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:50 2022] DELETE /identity/v3/users/cc6353d2796847ff89a4cf47872bee44 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:50.871469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828b813-3247-46c3-95d5-aff6c60ebf9f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:50.871762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828b813-3247-46c3-95d5-aff6c60ebf9f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:50.872040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828b813-3247-46c3-95d5-aff6c60ebf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:50.876926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008f585-5bda-4a8e-8f8b-c112a32a48f0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:50.894659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5828b813-3247-46c3-95d5-aff6c60ebf9f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:50.895971 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5828b813-3247-46c3-95d5-aff6c60ebf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:50.900449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:50.948462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c64f5-408d-451e-9920-05681f4399e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:50.949530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c64f5-408d-451e-9920-05681f4399e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:50.950390 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c64f5-408d-451e-9920-05681f4399e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:50.950678 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c64f5-408d-451e-9920-05681f4399e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:50.953367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-142c64f5-408d-451e-9920-05681f4399e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:50.996948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 995/2025] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:51.002136 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250ddbd-bacc-4066-8f47-67b24e851024 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:51.002428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250ddbd-bacc-4066-8f47-67b24e851024 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:51.002883 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250ddbd-bacc-4066-8f47-67b24e851024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:51.021718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e250ddbd-bacc-4066-8f47-67b24e851024 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:51.023112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e250ddbd-bacc-4066-8f47-67b24e851024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:51.032909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 996/2026] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:51.033944 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250ddbd-bacc-4066-8f47-67b24e851024 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:51.037145 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e250ddbd-bacc-4066-8f47-67b24e851024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:51.055064 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c64f5-408d-451e-9920-05681f4399e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:51.055064 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c64f5-408d-451e-9920-05681f4399e6 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:51.065638 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1031/2027] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:50 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:51.066798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c64f5-408d-451e-9920-05681f4399e6 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:51.068181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-142c64f5-408d-451e-9920-05681f4399e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:51.091072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:51.131204 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250ddbd-bacc-4066-8f47-67b24e851024 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:51.136138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6d91b-5868-4825-b45f-614ea4852581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:51.137033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6d91b-5868-4825-b45f-614ea4852581 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:51.137255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6d91b-5868-4825-b45f-614ea4852581 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:51.137535 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc6d91b-5868-4825-b45f-614ea4852581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:51.154807 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6d91b-5868-4825-b45f-614ea4852581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:51.155422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c64f5-408d-451e-9920-05681f4399e6 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:51.156206 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc6d91b-5868-4825-b45f-614ea4852581 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:51.161519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94ae61-ea6c-4612-92ef-d39f41fe2752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:51.162384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94ae61-ea6c-4612-92ef-d39f41fe2752 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:51.162881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94ae61-ea6c-4612-92ef-d39f41fe2752 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:51.163296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94ae61-ea6c-4612-92ef-d39f41fe2752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:51.167349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 997/2028] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:51.167899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6d91b-5868-4825-b45f-614ea4852581 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:51.169269 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8cc6d91b-5868-4825-b45f-614ea4852581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:51.180539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94ae61-ea6c-4612-92ef-d39f41fe2752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:51.182837 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94ae61-ea6c-4612-92ef-d39f41fe2752 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:51.203829 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1032/2029] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:51.214504 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc6d91b-5868-4825-b45f-614ea4852581 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:51.233857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c498-deed-4f64-8de1-43b7db230d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:51.235723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c498-deed-4f64-8de1-43b7db230d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:51.237597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c498-deed-4f64-8de1-43b7db230d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:51.237891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218c498-deed-4f64-8de1-43b7db230d6c admin admin] PATH_INFO: `/v3/users/50083002aa9b4cd0bf6771f87946dc26` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:51.242331 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218c498-deed-4f64-8de1-43b7db230d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50083002aa9b4cd0bf6771f87946dc26)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:51.244360 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5218c498-deed-4f64-8de1-43b7db230d6c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:51.383958 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5218c498-deed-4f64-8de1-43b7db230d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50083002aa9b4cd0bf6771f87946dc26'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:51.397363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5218c498-deed-4f64-8de1-43b7db230d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50083002aa9b4cd0bf6771f87946dc26'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:51.424891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5218c498-deed-4f64-8de1-43b7db230d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50083002aa9b4cd0bf6771f87946dc26'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:51.425600 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5218c498-deed-4f64-8de1-43b7db230d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50083002aa9b4cd0bf6771f87946dc26'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:51.426226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5218c498-deed-4f64-8de1-43b7db230d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50083002aa9b4cd0bf6771f87946dc26'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:51.483911 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 998/2030] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:51 2022] DELETE /identity/v3/users/50083002aa9b4cd0bf6771f87946dc26 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:51.488931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991dfde-dc2f-4432-8f9c-914fd0673f48 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:51.489268 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991dfde-dc2f-4432-8f9c-914fd0673f48 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:51.489666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991dfde-dc2f-4432-8f9c-914fd0673f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:51.512015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e991dfde-dc2f-4432-8f9c-914fd0673f48 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:51.513236 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e991dfde-dc2f-4432-8f9c-914fd0673f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:51.627731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1033/2031] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:51.642275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c498-deed-4f64-8de1-43b7db230d6c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:51.644350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5218c498-deed-4f64-8de1-43b7db230d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:51.690501 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991dfde-dc2f-4432-8f9c-914fd0673f48 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:51.692942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e991dfde-dc2f-4432-8f9c-914fd0673f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:51.715411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991dfde-dc2f-4432-8f9c-914fd0673f48 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:51.725242 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344962b-3483-451f-8dd9-52bc3a065e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:51.727599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344962b-3483-451f-8dd9-52bc3a065e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:51.728061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344962b-3483-451f-8dd9-52bc3a065e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:51.728494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344962b-3483-451f-8dd9-52bc3a065e95 admin admin] PATH_INFO: `/v3/projects/88652b4751f347cab5cd85ff6bddfd2a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:51.730272 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218c498-deed-4f64-8de1-43b7db230d6c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:51.731963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344962b-3483-451f-8dd9-52bc3a065e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88652b4751f347cab5cd85ff6bddfd2a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:51.735765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344962b-3483-451f-8dd9-52bc3a065e95 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:51.736257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317987a-7e01-4ca5-99a8-b4b0bce3810f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:51.737211 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317987a-7e01-4ca5-99a8-b4b0bce3810f service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:51.737590 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317987a-7e01-4ca5-99a8-b4b0bce3810f service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:51.737962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0317987a-7e01-4ca5-99a8-b4b0bce3810f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:51.750793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317987a-7e01-4ca5-99a8-b4b0bce3810f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:51.752452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0317987a-7e01-4ca5-99a8-b4b0bce3810f service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:51.764760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 999/2032] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:06:51.765878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317987a-7e01-4ca5-99a8-b4b0bce3810f service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:51.767542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0317987a-7e01-4ca5-99a8-b4b0bce3810f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:51.773868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:51.792458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0317987a-7e01-4ca5-99a8-b4b0bce3810f service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:51.802687 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fd58f-0446-46c8-b046-a95e686ae96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:51.804483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fd58f-0446-46c8-b046-a95e686ae96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:51.804865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fd58f-0446-46c8-b046-a95e686ae96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:51.805315 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5fd58f-0446-46c8-b046-a95e686ae96d admin admin] PATH_INFO: `/v3/projects/f2def50462ba4efcbdc05e343c5f541f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:51.807196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fd58f-0446-46c8-b046-a95e686ae96d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2def50462ba4efcbdc05e343c5f541f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:51.809841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5fd58f-0446-46c8-b046-a95e686ae96d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:51.829349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f344962b-3483-451f-8dd9-52bc3a065e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88652b4751f347cab5cd85ff6bddfd2a', 'request_id': 'req-f344962b-3483-451f-8dd9-52bc3a065e95'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:51.846371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f344962b-3483-451f-8dd9-52bc3a065e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88652b4751f347cab5cd85ff6bddfd2a', 'request_id': 'req-f344962b-3483-451f-8dd9-52bc3a065e95'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:51.859412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f344962b-3483-451f-8dd9-52bc3a065e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88652b4751f347cab5cd85ff6bddfd2a', 'request_id': 'req-f344962b-3483-451f-8dd9-52bc3a065e95'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:51.873678 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:51.880293 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f344962b-3483-451f-8dd9-52bc3a065e95 admin admin] The token cache is being invalidate because project 88652b4751f347cab5cd85ff6bddfd2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:51.880543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f344962b-3483-451f-8dd9-52bc3a065e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:51.881421 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f344962b-3483-451f-8dd9-52bc3a065e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:51.885058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1034/2033] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:51 2022] DELETE /identity/v3/projects/88652b4751f347cab5cd85ff6bddfd2a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:51.889922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344962b-3483-451f-8dd9-52bc3a065e95 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:51.893099 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f344962b-3483-451f-8dd9-52bc3a065e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:51.896652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f5fd58f-0446-46c8-b046-a95e686ae96d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2def50462ba4efcbdc05e343c5f541f', 'request_id': 'req-5f5fd58f-0446-46c8-b046-a95e686ae96d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:51.906546 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f5fd58f-0446-46c8-b046-a95e686ae96d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2def50462ba4efcbdc05e343c5f541f', 'request_id': 'req-5f5fd58f-0446-46c8-b046-a95e686ae96d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:51.916864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f5fd58f-0446-46c8-b046-a95e686ae96d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2def50462ba4efcbdc05e343c5f541f', 'request_id': 'req-5f5fd58f-0446-46c8-b046-a95e686ae96d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:51.938259 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f5fd58f-0446-46c8-b046-a95e686ae96d admin admin] The token cache is being invalidate because project f2def50462ba4efcbdc05e343c5f541f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:51.938562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f5fd58f-0446-46c8-b046-a95e686ae96d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:51.939503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5f5fd58f-0446-46c8-b046-a95e686ae96d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:51.943715 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1000/2034] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:51 2022] DELETE /identity/v3/projects/f2def50462ba4efcbdc05e343c5f541f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:51.949221 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fd58f-0446-46c8-b046-a95e686ae96d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:51.950750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f5fd58f-0446-46c8-b046-a95e686ae96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:52.023691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344962b-3483-451f-8dd9-52bc3a065e95 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:52.076506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5fd58f-0446-46c8-b046-a95e686ae96d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:52.081542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a344751-3bcb-4034-995f-0ea1f6970256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:52.082558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344751-3bcb-4034-995f-0ea1f6970256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:52.082975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344751-3bcb-4034-995f-0ea1f6970256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:52.083517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a344751-3bcb-4034-995f-0ea1f6970256 admin admin] PATH_INFO: `/v3/users/bbe8bfaa89fd4b3f801fad7dc5cb1246` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:52.085062 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a344751-3bcb-4034-995f-0ea1f6970256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbe8bfaa89fd4b3f801fad7dc5cb1246)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:52.087316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a344751-3bcb-4034-995f-0ea1f6970256 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:52.102906 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307d038-c0c8-478b-a733-f86cb17bb15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:52.103800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307d038-c0c8-478b-a733-f86cb17bb15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:52.104107 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307d038-c0c8-478b-a733-f86cb17bb15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:52.104411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307d038-c0c8-478b-a733-f86cb17bb15b admin admin] PATH_INFO: `/v3/users/c12db5b36e7d4abd9fe21ab98484de8c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:52.105820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307d038-c0c8-478b-a733-f86cb17bb15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c12db5b36e7d4abd9fe21ab98484de8c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:52.107873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307d038-c0c8-478b-a733-f86cb17bb15b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:52.150449 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5a344751-3bcb-4034-995f-0ea1f6970256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbe8bfaa89fd4b3f801fad7dc5cb1246'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.158960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5a344751-3bcb-4034-995f-0ea1f6970256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbe8bfaa89fd4b3f801fad7dc5cb1246'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.169077 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5a344751-3bcb-4034-995f-0ea1f6970256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbe8bfaa89fd4b3f801fad7dc5cb1246'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.169846 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5a344751-3bcb-4034-995f-0ea1f6970256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbe8bfaa89fd4b3f801fad7dc5cb1246'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.170883 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5a344751-3bcb-4034-995f-0ea1f6970256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbe8bfaa89fd4b3f801fad7dc5cb1246'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.191484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3307d038-c0c8-478b-a733-f86cb17bb15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c12db5b36e7d4abd9fe21ab98484de8c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.198760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1001/2035] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:51 2022] DELETE /identity/v3/users/bbe8bfaa89fd4b3f801fad7dc5cb1246 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:52.200204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:52.219291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3307d038-c0c8-478b-a733-f86cb17bb15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c12db5b36e7d4abd9fe21ab98484de8c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.230744 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3307d038-c0c8-478b-a733-f86cb17bb15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c12db5b36e7d4abd9fe21ab98484de8c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.231600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3307d038-c0c8-478b-a733-f86cb17bb15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c12db5b36e7d4abd9fe21ab98484de8c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.241196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3307d038-c0c8-478b-a733-f86cb17bb15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c12db5b36e7d4abd9fe21ab98484de8c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.249599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1035/2036] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:51 2022] DELETE /identity/v3/users/c12db5b36e7d4abd9fe21ab98484de8c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:52.291837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a344751-3bcb-4034-995f-0ea1f6970256 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:52.293641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5a344751-3bcb-4034-995f-0ea1f6970256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:52.356325 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:52.379019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a344751-3bcb-4034-995f-0ea1f6970256 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:52.465117 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853258ec-e975-4283-8139-d378ab85dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:52.466195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853258ec-e975-4283-8139-d378ab85dc6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:52.466481 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853258ec-e975-4283-8139-d378ab85dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:52.466792 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853258ec-e975-4283-8139-d378ab85dc6b admin admin] PATH_INFO: `/v3/projects/1d20d580e6fb4cbc886d7c0b69a7234b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:52.468169 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853258ec-e975-4283-8139-d378ab85dc6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d20d580e6fb4cbc886d7c0b69a7234b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:52.470487 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853258ec-e975-4283-8139-d378ab85dc6b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:52.539945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-853258ec-e975-4283-8139-d378ab85dc6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d20d580e6fb4cbc886d7c0b69a7234b', 'request_id': 'req-853258ec-e975-4283-8139-d378ab85dc6b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.548949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-853258ec-e975-4283-8139-d378ab85dc6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d20d580e6fb4cbc886d7c0b69a7234b', 'request_id': 'req-853258ec-e975-4283-8139-d378ab85dc6b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.556728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-853258ec-e975-4283-8139-d378ab85dc6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d20d580e6fb4cbc886d7c0b69a7234b', 'request_id': 'req-853258ec-e975-4283-8139-d378ab85dc6b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.577127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-853258ec-e975-4283-8139-d378ab85dc6b admin admin] The token cache is being invalidate because project 1d20d580e6fb4cbc886d7c0b69a7234b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:52.577778 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-853258ec-e975-4283-8139-d378ab85dc6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.578590 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-853258ec-e975-4283-8139-d378ab85dc6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.581959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1002/2037] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:52 2022] DELETE /identity/v3/projects/1d20d580e6fb4cbc886d7c0b69a7234b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:52.589951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdab699-f3d4-43d5-9454-e7ef441fbaa2 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:52.590842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdab699-f3d4-43d5-9454-e7ef441fbaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:52.591307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdab699-f3d4-43d5-9454-e7ef441fbaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:52.623856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-acdab699-f3d4-43d5-9454-e7ef441fbaa2 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:52.625598 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-acdab699-f3d4-43d5-9454-e7ef441fbaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:52.630383 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853258ec-e975-4283-8139-d378ab85dc6b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:52.631928 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-853258ec-e975-4283-8139-d378ab85dc6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:52.740831 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1036/2038] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:52.740831 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdab699-f3d4-43d5-9454-e7ef441fbaa2 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:52.740831 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-acdab699-f3d4-43d5-9454-e7ef441fbaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:52.754217 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdab699-f3d4-43d5-9454-e7ef441fbaa2 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:52.761105 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7958b3-19de-4955-81e1-1a40ee262805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:52.762942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7958b3-19de-4955-81e1-1a40ee262805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:52.764778 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7958b3-19de-4955-81e1-1a40ee262805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:52.765242 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7958b3-19de-4955-81e1-1a40ee262805 admin admin] PATH_INFO: `/v3/projects/bfcf308632f748579ca98bbe40fc55aa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:52.767579 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7958b3-19de-4955-81e1-1a40ee262805 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfcf308632f748579ca98bbe40fc55aa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:52.768138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853258ec-e975-4283-8139-d378ab85dc6b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:52.775608 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad476a7-517b-425a-81df-6f38a7edc40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:52.776583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad476a7-517b-425a-81df-6f38a7edc40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:52.776919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad476a7-517b-425a-81df-6f38a7edc40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:52.777340 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad476a7-517b-425a-81df-6f38a7edc40f admin admin] PATH_INFO: `/v3/projects/f4f16242b06c4ef5b6075e3e4a51fb92` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:52.777726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7958b3-19de-4955-81e1-1a40ee262805 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:52.778899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad476a7-517b-425a-81df-6f38a7edc40f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f16242b06c4ef5b6075e3e4a51fb92)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:52.780946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad476a7-517b-425a-81df-6f38a7edc40f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:52.820599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:52.835255 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fe7958b3-19de-4955-81e1-1a40ee262805 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfcf308632f748579ca98bbe40fc55aa', 'request_id': 'req-fe7958b3-19de-4955-81e1-1a40ee262805'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.844207 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fe7958b3-19de-4955-81e1-1a40ee262805 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfcf308632f748579ca98bbe40fc55aa', 'request_id': 'req-fe7958b3-19de-4955-81e1-1a40ee262805'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.850954 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fe7958b3-19de-4955-81e1-1a40ee262805 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfcf308632f748579ca98bbe40fc55aa', 'request_id': 'req-fe7958b3-19de-4955-81e1-1a40ee262805'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.857327 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bad476a7-517b-425a-81df-6f38a7edc40f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f16242b06c4ef5b6075e3e4a51fb92', 'request_id': 'req-bad476a7-517b-425a-81df-6f38a7edc40f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.861657 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fe7958b3-19de-4955-81e1-1a40ee262805 admin admin] The token cache is being invalidate because project bfcf308632f748579ca98bbe40fc55aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:52.861947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fe7958b3-19de-4955-81e1-1a40ee262805 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.862612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fe7958b3-19de-4955-81e1-1a40ee262805 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.864206 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bad476a7-517b-425a-81df-6f38a7edc40f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f16242b06c4ef5b6075e3e4a51fb92', 'request_id': 'req-bad476a7-517b-425a-81df-6f38a7edc40f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.866957 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1037/2039] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:52 2022] DELETE /identity/v3/projects/bfcf308632f748579ca98bbe40fc55aa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:52.866957 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fe9d7-455d-4399-a327-9a3dc6d14d5f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:52.866957 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fe9d7-455d-4399-a327-9a3dc6d14d5f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:52.866957 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84fe9d7-455d-4399-a327-9a3dc6d14d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:52.872840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bad476a7-517b-425a-81df-6f38a7edc40f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f16242b06c4ef5b6075e3e4a51fb92', 'request_id': 'req-bad476a7-517b-425a-81df-6f38a7edc40f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.884253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e84fe9d7-455d-4399-a327-9a3dc6d14d5f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:52.885470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e84fe9d7-455d-4399-a327-9a3dc6d14d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:52.887516 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bad476a7-517b-425a-81df-6f38a7edc40f admin admin] The token cache is being invalidate because project f4f16242b06c4ef5b6075e3e4a51fb92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:52.887809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bad476a7-517b-425a-81df-6f38a7edc40f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.888445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bad476a7-517b-425a-81df-6f38a7edc40f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:52.890229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1003/2040] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:52 2022] DELETE /identity/v3/projects/f4f16242b06c4ef5b6075e3e4a51fb92 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:52.891028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad476a7-517b-425a-81df-6f38a7edc40f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:52.892887 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bad476a7-517b-425a-81df-6f38a7edc40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:52.937188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:52.954050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1038/2041] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:52.955622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e19ec-62d8-40e2-a097-86ddecb98a8c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:52.955913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e19ec-62d8-40e2-a097-86ddecb98a8c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:52.956222 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e19ec-62d8-40e2-a097-86ddecb98a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:52.977339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad476a7-517b-425a-81df-6f38a7edc40f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:52.978847 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-731e19ec-62d8-40e2-a097-86ddecb98a8c None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:52.980090 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-731e19ec-62d8-40e2-a097-86ddecb98a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:52.981988 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5b7f1-a054-4819-9fbd-bf58285f6165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:52.982917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b7f1-a054-4819-9fbd-bf58285f6165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:52.983275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b7f1-a054-4819-9fbd-bf58285f6165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:52.983543 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5b7f1-a054-4819-9fbd-bf58285f6165 admin admin] PATH_INFO: `/v3/users/4deb4e490c934d3785cba63542095bb0` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:52.984756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5b7f1-a054-4819-9fbd-bf58285f6165 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4deb4e490c934d3785cba63542095bb0)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:52.986696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5b7f1-a054-4819-9fbd-bf58285f6165 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:52.989617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1039/2042] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:52.990947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727ce71-040f-4626-8350-2660e31aa2da None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:52.991239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727ce71-040f-4626-8350-2660e31aa2da None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:52.991519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2727ce71-040f-4626-8350-2660e31aa2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.014223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2727ce71-040f-4626-8350-2660e31aa2da None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:53.015610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2727ce71-040f-4626-8350-2660e31aa2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:53.024781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1040/2043] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:53.034646 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727ce71-040f-4626-8350-2660e31aa2da None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.035797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2727ce71-040f-4626-8350-2660e31aa2da None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.043386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eba0b4-0f68-422e-a09f-018714b4fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.044402 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eba0b4-0f68-422e-a09f-018714b4fbaa admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.044851 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eba0b4-0f68-422e-a09f-018714b4fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.045286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eba0b4-0f68-422e-a09f-018714b4fbaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.046659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eba0b4-0f68-422e-a09f-018714b4fbaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:53.046868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-16d5b7f1-a054-4819-9fbd-bf58285f6165 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4deb4e490c934d3785cba63542095bb0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:53.047196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eba0b4-0f68-422e-a09f-018714b4fbaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.050331 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eba0b4-0f68-422e-a09f-018714b4fbaa admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.057718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-16d5b7f1-a054-4819-9fbd-bf58285f6165 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4deb4e490c934d3785cba63542095bb0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:53.067782 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-16d5b7f1-a054-4819-9fbd-bf58285f6165 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4deb4e490c934d3785cba63542095bb0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:53.067936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1041/2044] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:53.069383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1244797-a727-40d5-b056-cbf6c918793e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.069779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1244797-a727-40d5-b056-cbf6c918793e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.070115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1244797-a727-40d5-b056-cbf6c918793e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.072084 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-16d5b7f1-a054-4819-9fbd-bf58285f6165 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4deb4e490c934d3785cba63542095bb0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:53.073057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-16d5b7f1-a054-4819-9fbd-bf58285f6165 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4deb4e490c934d3785cba63542095bb0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:53.096450 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f1244797-a727-40d5-b056-cbf6c918793e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:53.098233 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f1244797-a727-40d5-b056-cbf6c918793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:53.103134 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1004/2045] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:52 2022] DELETE /identity/v3/users/4deb4e490c934d3785cba63542095bb0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:53.106161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbb894-e4b7-4c31-9091-a8c84516383b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.106161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbb894-e4b7-4c31-9091-a8c84516383b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.106161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbb894-e4b7-4c31-9091-a8c84516383b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.111718 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1042/2046] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:53.113506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1244797-a727-40d5-b056-cbf6c918793e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.115192 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f1244797-a727-40d5-b056-cbf6c918793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:53.123388 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2afbb894-e4b7-4c31-9091-a8c84516383b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:53.124575 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2afbb894-e4b7-4c31-9091-a8c84516383b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:53.127823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1244797-a727-40d5-b056-cbf6c918793e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.153019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:53.186675 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2f104-de39-41e8-9a4b-a2300d174239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.187448 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2f104-de39-41e8-9a4b-a2300d174239 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.187664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2f104-de39-41e8-9a4b-a2300d174239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.187939 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2f104-de39-41e8-9a4b-a2300d174239 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.188644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2f104-de39-41e8-9a4b-a2300d174239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.190538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2f104-de39-41e8-9a4b-a2300d174239 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.201301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1005/2047] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:53.202828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a07bb7-e62a-4a32-a326-599ddfb21531 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.203138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a07bb7-e62a-4a32-a326-599ddfb21531 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.203416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a07bb7-e62a-4a32-a326-599ddfb21531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.221535 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-07a07bb7-e62a-4a32-a326-599ddfb21531 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:53.222884 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-07a07bb7-e62a-4a32-a326-599ddfb21531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:53.223376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1043/2048] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:53 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:53.224286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2f104-de39-41e8-9a4b-a2300d174239 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.284980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1006/2049] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:53.285890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2f104-de39-41e8-9a4b-a2300d174239 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.289146 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a07bb7-e62a-4a32-a326-599ddfb21531 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.291853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb271a-730d-4230-90b8-3b8dd40db323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.294217 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb271a-730d-4230-90b8-3b8dd40db323 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.294800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb271a-730d-4230-90b8-3b8dd40db323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.295416 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb271a-730d-4230-90b8-3b8dd40db323 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.296265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb271a-730d-4230-90b8-3b8dd40db323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:53.296587 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb271a-730d-4230-90b8-3b8dd40db323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.298566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fceb271a-730d-4230-90b8-3b8dd40db323 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.300239 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a07bb7-e62a-4a32-a326-599ddfb21531 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.305805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22e23f-5e80-4cb1-906a-c2a596497c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.306379 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22e23f-5e80-4cb1-906a-c2a596497c60 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.307201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22e23f-5e80-4cb1-906a-c2a596497c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.307532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22e23f-5e80-4cb1-906a-c2a596497c60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.308767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22e23f-5e80-4cb1-906a-c2a596497c60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:53.309100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22e23f-5e80-4cb1-906a-c2a596497c60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.310797 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22e23f-5e80-4cb1-906a-c2a596497c60 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.312685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1044/2050] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:53.313250 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb271a-730d-4230-90b8-3b8dd40db323 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.324152 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceb271a-730d-4230-90b8-3b8dd40db323 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.328528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1007/2051] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:53.329391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22e23f-5e80-4cb1-906a-c2a596497c60 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.329673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eda764-3076-4ae7-9519-e66cab4b798b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.330360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eda764-3076-4ae7-9519-e66cab4b798b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.330646 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eda764-3076-4ae7-9519-e66cab4b798b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.330973 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eda764-3076-4ae7-9519-e66cab4b798b admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.331424 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7a22e23f-5e80-4cb1-906a-c2a596497c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:53.331685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eda764-3076-4ae7-9519-e66cab4b798b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.333700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eda764-3076-4ae7-9519-e66cab4b798b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.359987 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1045/2052] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:53 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:53.360829 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eda764-3076-4ae7-9519-e66cab4b798b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.375691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eda764-3076-4ae7-9519-e66cab4b798b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.381393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b8d8c-9fce-4822-9d38-65da193f0ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.382088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b8d8c-9fce-4822-9d38-65da193f0ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.383255 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b8d8c-9fce-4822-9d38-65da193f0ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.383593 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b8d8c-9fce-4822-9d38-65da193f0ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.384281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b8d8c-9fce-4822-9d38-65da193f0ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.389550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b8d8c-9fce-4822-9d38-65da193f0ef5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.419181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22e23f-5e80-4cb1-906a-c2a596497c60 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.422428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf3eb8-2868-4552-b152-f7eb0caa143b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.425528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf3eb8-2868-4552-b152-f7eb0caa143b service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.425940 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf3eb8-2868-4552-b152-f7eb0caa143b service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.426510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf3eb8-2868-4552-b152-f7eb0caa143b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.433115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:53.440048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf3eb8-2868-4552-b152-f7eb0caa143b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.441717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf3eb8-2868-4552-b152-f7eb0caa143b service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.443115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1046/2053] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:53 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:53.447408 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b8d8c-9fce-4822-9d38-65da193f0ef5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.453634 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1008/2054] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:53.454510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf3eb8-2868-4552-b152-f7eb0caa143b service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.465332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf3eb8-2868-4552-b152-f7eb0caa143b service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.539490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b8d8c-9fce-4822-9d38-65da193f0ef5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.545154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a85eaa-7053-4c35-8ff8-8cb94390d2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.545366 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c2834-6cbd-4586-8b68-58ab16ba6dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.545967 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c2834-6cbd-4586-8b68-58ab16ba6dea admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.546156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a85eaa-7053-4c35-8ff8-8cb94390d2ce admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.546296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c2834-6cbd-4586-8b68-58ab16ba6dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.546475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a85eaa-7053-4c35-8ff8-8cb94390d2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.546585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c2834-6cbd-4586-8b68-58ab16ba6dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.546921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a85eaa-7053-4c35-8ff8-8cb94390d2ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.547215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c2834-6cbd-4586-8b68-58ab16ba6dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.547850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a85eaa-7053-4c35-8ff8-8cb94390d2ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.549204 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c2834-6cbd-4586-8b68-58ab16ba6dea admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.550337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a85eaa-7053-4c35-8ff8-8cb94390d2ce admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.551931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:53.566864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1009/2055] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:53.566864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c2834-6cbd-4586-8b68-58ab16ba6dea admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.577330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c2834-6cbd-4586-8b68-58ab16ba6dea admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.583420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7350f-c314-48c7-8efb-74f7fb2a2d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.584250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7350f-c314-48c7-8efb-74f7fb2a2d95 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.584639 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7350f-c314-48c7-8efb-74f7fb2a2d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.585018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7350f-c314-48c7-8efb-74f7fb2a2d95 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.585824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7350f-c314-48c7-8efb-74f7fb2a2d95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.587947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7350f-c314-48c7-8efb-74f7fb2a2d95 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.590900 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1047/2056] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:53 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:53.591832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a85eaa-7053-4c35-8ff8-8cb94390d2ce admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.616474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1010/2057] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:53 2022] POST /identity/v3/users => generated 288 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:53.616474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7350f-c314-48c7-8efb-74f7fb2a2d95 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.635100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7350f-c314-48c7-8efb-74f7fb2a2d95 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.691286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a85eaa-7053-4c35-8ff8-8cb94390d2ce admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.697355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7059379-1769-463e-825a-8416cc03f597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.698312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7059379-1769-463e-825a-8416cc03f597 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.698674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7059379-1769-463e-825a-8416cc03f597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.699421 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7059379-1769-463e-825a-8416cc03f597 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.701163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7059379-1769-463e-825a-8416cc03f597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.703566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7059379-1769-463e-825a-8416cc03f597 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.720395 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1048/2058] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:53.720395 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7059379-1769-463e-825a-8416cc03f597 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.723626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5b53a-77df-44a0-9351-98ba8086d8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.724564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5b53a-77df-44a0-9351-98ba8086d8d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.725372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5b53a-77df-44a0-9351-98ba8086d8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.725517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5b53a-77df-44a0-9351-98ba8086d8d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.726404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5b53a-77df-44a0-9351-98ba8086d8d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.728332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5b53a-77df-44a0-9351-98ba8086d8d9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.730940 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7059379-1769-463e-825a-8416cc03f597 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.736726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35702eb4-75f1-4cbf-a3c9-027dd1bdf421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.737422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35702eb4-75f1-4cbf-a3c9-027dd1bdf421 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.737704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35702eb4-75f1-4cbf-a3c9-027dd1bdf421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.738130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35702eb4-75f1-4cbf-a3c9-027dd1bdf421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.738949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35702eb4-75f1-4cbf-a3c9-027dd1bdf421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.740766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35702eb4-75f1-4cbf-a3c9-027dd1bdf421 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.752236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1011/2059] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:53 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:53.753098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5b53a-77df-44a0-9351-98ba8086d8d9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.757072 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1049/2060] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:53.757072 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35702eb4-75f1-4cbf-a3c9-027dd1bdf421 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.757693 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-18b5b53a-77df-44a0-9351-98ba8086d8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:53.769059 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5b53a-77df-44a0-9351-98ba8086d8d9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.770032 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35702eb4-75f1-4cbf-a3c9-027dd1bdf421 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.775255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ba9ec-b76b-4c6c-a888-a363c41f87a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.776035 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaaa0c-3c00-42b3-8d6b-ebc46e3a5d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.776426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ba9ec-b76b-4c6c-a888-a363c41f87a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.776785 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ba9ec-b76b-4c6c-a888-a363c41f87a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.777283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ba9ec-b76b-4c6c-a888-a363c41f87a9 admin admin] PATH_INFO: `/v3/users/292469a3b5724f7da048fb0c6472e92e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.777394 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaaa0c-3c00-42b3-8d6b-ebc46e3a5d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.777730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaaa0c-3c00-42b3-8d6b-ebc46e3a5d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.778081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eaaa0c-3c00-42b3-8d6b-ebc46e3a5d6d admin admin] PATH_INFO: `/v3/projects/13c6eb5f7c8349c4bb17494c490f4be8/users/63bb84b42ce84d509155e0514a3c4378/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.778749 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ba9ec-b76b-4c6c-a888-a363c41f87a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=292469a3b5724f7da048fb0c6472e92e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.780896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ba9ec-b76b-4c6c-a888-a363c41f87a9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.797015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eaaa0c-3c00-42b3-8d6b-ebc46e3a5d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13c6eb5f7c8349c4bb17494c490f4be8, user_id=63bb84b42ce84d509155e0514a3c4378, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.803589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eaaa0c-3c00-42b3-8d6b-ebc46e3a5d6d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.825566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1050/2061] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:53 2022] PUT /identity/v3/projects/13c6eb5f7c8349c4bb17494c490f4be8/users/63bb84b42ce84d509155e0514a3c4378/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:53.825566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaaa0c-3c00-42b3-8d6b-ebc46e3a5d6d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.841742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-494ba9ec-b76b-4c6c-a888-a363c41f87a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '292469a3b5724f7da048fb0c6472e92e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:53.850586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-494ba9ec-b76b-4c6c-a888-a363c41f87a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '292469a3b5724f7da048fb0c6472e92e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:53.860438 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-494ba9ec-b76b-4c6c-a888-a363c41f87a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '292469a3b5724f7da048fb0c6472e92e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:53.861180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-494ba9ec-b76b-4c6c-a888-a363c41f87a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '292469a3b5724f7da048fb0c6472e92e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:53.861831 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-494ba9ec-b76b-4c6c-a888-a363c41f87a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '292469a3b5724f7da048fb0c6472e92e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:53.876022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:53.892176 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1012/2062] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:53 2022] DELETE /identity/v3/users/292469a3b5724f7da048fb0c6472e92e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:53.895156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eaaa0c-3c00-42b3-8d6b-ebc46e3a5d6d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.896184 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ba9ec-b76b-4c6c-a888-a363c41f87a9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.897596 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-494ba9ec-b76b-4c6c-a888-a363c41f87a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:53.954438 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:53.976393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cea50-be72-44f5-b74c-8fcd223f1f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.977083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cea50-be72-44f5-b74c-8fcd223f1f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.977426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cea50-be72-44f5-b74c-8fcd223f1f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.977794 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6cea50-be72-44f5-b74c-8fcd223f1f98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.978609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cea50-be72-44f5-b74c-8fcd223f1f98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.980416 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6cea50-be72-44f5-b74c-8fcd223f1f98 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:53.983279 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ba9ec-b76b-4c6c-a888-a363c41f87a9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:53.994474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1051/2063] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:53.994696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d932bb8-2bfe-4763-9716-b00a941495ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:53.994846 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cea50-be72-44f5-b74c-8fcd223f1f98 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:53.994951 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d932bb8-2bfe-4763-9716-b00a941495ed admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:53.994951 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d932bb8-2bfe-4763-9716-b00a941495ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:53.994951 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d932bb8-2bfe-4763-9716-b00a941495ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:53.995210 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-da6cea50-be72-44f5-b74c-8fcd223f1f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:53.996010 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d932bb8-2bfe-4763-9716-b00a941495ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:53.999272 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d932bb8-2bfe-4763-9716-b00a941495ed admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:54.007413 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6cea50-be72-44f5-b74c-8fcd223f1f98 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:54.013234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d098bb-8572-4470-b177-e3168edcd311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:54.014614 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d098bb-8572-4470-b177-e3168edcd311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:54.014614 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d098bb-8572-4470-b177-e3168edcd311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:54.015083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d098bb-8572-4470-b177-e3168edcd311 admin admin] PATH_INFO: `/v3/projects/cd41b47a5d834defb62f7896f65d4ce4` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:54.016363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d098bb-8572-4470-b177-e3168edcd311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd41b47a5d834defb62f7896f65d4ce4)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:54.018324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d098bb-8572-4470-b177-e3168edcd311 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:54.020129 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1013/2064] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:54.022686 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdae29-951a-49e0-8c5f-e7b988cf7026 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:54.023272 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdae29-951a-49e0-8c5f-e7b988cf7026 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:54.023851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdae29-951a-49e0-8c5f-e7b988cf7026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:54.054883 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fecdae29-951a-49e0-8c5f-e7b988cf7026 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:54.056808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fecdae29-951a-49e0-8c5f-e7b988cf7026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:54.070845 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a9d098bb-8572-4470-b177-e3168edcd311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd41b47a5d834defb62f7896f65d4ce4', 'request_id': 'req-a9d098bb-8572-4470-b177-e3168edcd311'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:54.079745 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a9d098bb-8572-4470-b177-e3168edcd311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd41b47a5d834defb62f7896f65d4ce4', 'request_id': 'req-a9d098bb-8572-4470-b177-e3168edcd311'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:54.086978 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a9d098bb-8572-4470-b177-e3168edcd311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd41b47a5d834defb62f7896f65d4ce4', 'request_id': 'req-a9d098bb-8572-4470-b177-e3168edcd311'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:54.097635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a9d098bb-8572-4470-b177-e3168edcd311 admin admin] The token cache is being invalidate because project cd41b47a5d834defb62f7896f65d4ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:54.097923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a9d098bb-8572-4470-b177-e3168edcd311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:54.098981 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a9d098bb-8572-4470-b177-e3168edcd311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:54.100391 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1052/2065] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:53 2022] DELETE /identity/v3/projects/cd41b47a5d834defb62f7896f65d4ce4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:54.103889 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af2606-9d9a-49b1-876b-f9c4f8957bfc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:54.103889 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af2606-9d9a-49b1-876b-f9c4f8957bfc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:54.103889 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af2606-9d9a-49b1-876b-f9c4f8957bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:54.119887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-06af2606-9d9a-49b1-876b-f9c4f8957bfc None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:54.121147 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-06af2606-9d9a-49b1-876b-f9c4f8957bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:54.132439 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1014/2066] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:54.133301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdae29-951a-49e0-8c5f-e7b988cf7026 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:54.134613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fecdae29-951a-49e0-8c5f-e7b988cf7026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:54.146721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdae29-951a-49e0-8c5f-e7b988cf7026 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:54.151335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ad387-9055-4bb4-ad11-7b8c9e28d4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:54.152016 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ad387-9055-4bb4-ad11-7b8c9e28d4da admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:54.152290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ad387-9055-4bb4-ad11-7b8c9e28d4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:54.152562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ad387-9055-4bb4-ad11-7b8c9e28d4da admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:54.153291 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ad387-9055-4bb4-ad11-7b8c9e28d4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:54.154928 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ad387-9055-4bb4-ad11-7b8c9e28d4da admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:54.165299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1015/2067] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:54.166100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ad387-9055-4bb4-ad11-7b8c9e28d4da admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:54.167869 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-050ad387-9055-4bb4-ad11-7b8c9e28d4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:54.181946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ad387-9055-4bb4-ad11-7b8c9e28d4da admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:54.187253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6077f84-893e-441e-8b9b-de47879e9b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:54.188248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6077f84-893e-441e-8b9b-de47879e9b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:54.188532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6077f84-893e-441e-8b9b-de47879e9b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:54.188804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6077f84-893e-441e-8b9b-de47879e9b37 admin admin] PATH_INFO: `/v3/projects/9f0ff421a3b54554868b81aea4ee18cb/users/6a05dc6e31114a358543b0411e69add3/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:54.214656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1053/2068] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:54.215650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af2606-9d9a-49b1-876b-f9c4f8957bfc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:54.216968 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-06af2606-9d9a-49b1-876b-f9c4f8957bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:54.218482 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6077f84-893e-441e-8b9b-de47879e9b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f0ff421a3b54554868b81aea4ee18cb, user_id=6a05dc6e31114a358543b0411e69add3, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:54.223187 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6077f84-893e-441e-8b9b-de47879e9b37 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:54.229818 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af2606-9d9a-49b1-876b-f9c4f8957bfc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:54.236032 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0994fb-acdb-473b-b7d8-ffdfe09038cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:54.236980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0994fb-acdb-473b-b7d8-ffdfe09038cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:54.237267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0994fb-acdb-473b-b7d8-ffdfe09038cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:54.237550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0994fb-acdb-473b-b7d8-ffdfe09038cc admin admin] PATH_INFO: `/v3/users/c63892450ae246d196353136ddb85b5a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:54.238850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0994fb-acdb-473b-b7d8-ffdfe09038cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c63892450ae246d196353136ddb85b5a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:54.240862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0994fb-acdb-473b-b7d8-ffdfe09038cc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:54.244941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1016/2069] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:54 2022] PUT /identity/v3/projects/9f0ff421a3b54554868b81aea4ee18cb/users/6a05dc6e31114a358543b0411e69add3/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:54.252923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6077f84-893e-441e-8b9b-de47879e9b37 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:54.253556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:54.256060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f6077f84-893e-441e-8b9b-de47879e9b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:54.299098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2f0994fb-acdb-473b-b7d8-ffdfe09038cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c63892450ae246d196353136ddb85b5a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:54.313179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2f0994fb-acdb-473b-b7d8-ffdfe09038cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c63892450ae246d196353136ddb85b5a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:54.322528 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2f0994fb-acdb-473b-b7d8-ffdfe09038cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c63892450ae246d196353136ddb85b5a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:54.322889 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6077f84-893e-441e-8b9b-de47879e9b37 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:54.323410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2f0994fb-acdb-473b-b7d8-ffdfe09038cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c63892450ae246d196353136ddb85b5a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:54.326770 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36329f9e-afbc-4bf4-8080-265842c6de39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:54.327542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36329f9e-afbc-4bf4-8080-265842c6de39 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:54.327825 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36329f9e-afbc-4bf4-8080-265842c6de39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:54.328102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36329f9e-afbc-4bf4-8080-265842c6de39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:54.329990 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-36329f9e-afbc-4bf4-8080-265842c6de39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:54.331446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-2f0994fb-acdb-473b-b7d8-ffdfe09038cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c63892450ae246d196353136ddb85b5a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:54.338393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1054/2070] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:54 2022] DELETE /identity/v3/users/c63892450ae246d196353136ddb85b5a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:54.339362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0994fb-acdb-473b-b7d8-ffdfe09038cc admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:54.340756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2f0994fb-acdb-473b-b7d8-ffdfe09038cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:54.412477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:54.419201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36329f9e-afbc-4bf4-8080-265842c6de39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:54.420857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36329f9e-afbc-4bf4-8080-265842c6de39 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:54.429315 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0994fb-acdb-473b-b7d8-ffdfe09038cc admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:54.434334 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e0197-0f2d-43c4-855b-87dfcf4ff684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:54.435308 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e0197-0f2d-43c4-855b-87dfcf4ff684 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:54.435793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1017/2071] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:54.435923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e0197-0f2d-43c4-855b-87dfcf4ff684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:54.435923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e0197-0f2d-43c4-855b-87dfcf4ff684 admin admin] PATH_INFO: `/v3/projects/e75759ef90224b4cb399d0f8d27769a2/users/2e6a8359af2b48fea411ac5e5dd1870d/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:54.436678 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36329f9e-afbc-4bf4-8080-265842c6de39 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:54.438044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-36329f9e-afbc-4bf4-8080-265842c6de39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:54.450915 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36329f9e-afbc-4bf4-8080-265842c6de39 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:54.454661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e0197-0f2d-43c4-855b-87dfcf4ff684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75759ef90224b4cb399d0f8d27769a2, user_id=2e6a8359af2b48fea411ac5e5dd1870d, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:54.458252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e0197-0f2d-43c4-855b-87dfcf4ff684 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:54.486929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1055/2072] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:54 2022] PUT /identity/v3/projects/e75759ef90224b4cb399d0f8d27769a2/users/2e6a8359af2b48fea411ac5e5dd1870d/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:54.491078 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94822f-b288-4d85-a56a-b3ff669675a0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:54.491371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94822f-b288-4d85-a56a-b3ff669675a0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:54.491656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94822f-b288-4d85-a56a-b3ff669675a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:54.522265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ec94822f-b288-4d85-a56a-b3ff669675a0 None None] MFA Rules not processed for user `6a05dc6e31114a358543b0411e69add3`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:54.524864 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ec94822f-b288-4d85-a56a-b3ff669675a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:54.558194 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacff91-063d-4d38-9154-209fd35b21c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:54.559233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacff91-063d-4d38-9154-209fd35b21c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:54.559616 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacff91-063d-4d38-9154-209fd35b21c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:54.559991 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacff91-063d-4d38-9154-209fd35b21c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:54.562466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2bacff91-063d-4d38-9154-209fd35b21c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:54.578410 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacff91-063d-4d38-9154-209fd35b21c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:54.580679 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacff91-063d-4d38-9154-209fd35b21c2 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:54.594288 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1018/2073] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:54.596405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb403c01-ca55-42f9-b771-0e86fb10e646 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:54.596795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb403c01-ca55-42f9-b771-0e86fb10e646 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:54.597167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb403c01-ca55-42f9-b771-0e86fb10e646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:54.621514 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:54.629257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fb403c01-ca55-42f9-b771-0e86fb10e646 None None] MFA Rules not processed for user `2e6a8359af2b48fea411ac5e5dd1870d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:54.630983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fb403c01-ca55-42f9-b771-0e86fb10e646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:54.637483 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1056/2074] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:54.646606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94822f-b288-4d85-a56a-b3ff669675a0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:54.650984 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ec94822f-b288-4d85-a56a-b3ff669675a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:54.731742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94822f-b288-4d85-a56a-b3ff669675a0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:54.736545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce95bef-fbee-49e7-9ed4-ddac05ec2878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:54.737532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce95bef-fbee-49e7-9ed4-ddac05ec2878 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:54.737921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce95bef-fbee-49e7-9ed4-ddac05ec2878 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:54.738304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce95bef-fbee-49e7-9ed4-ddac05ec2878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:54.749354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce95bef-fbee-49e7-9ed4-ddac05ec2878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:54.749607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1019/2075] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:54.751187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce95bef-fbee-49e7-9ed4-ddac05ec2878 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:54.756456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb403c01-ca55-42f9-b771-0e86fb10e646 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:54.765030 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1057/2076] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:54.859184 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb403c01-ca55-42f9-b771-0e86fb10e646 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:54.866736 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf431-0fec-4160-8bf6-5b0a430e47c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:54.868259 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf431-0fec-4160-8bf6-5b0a430e47c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:54.868259 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf431-0fec-4160-8bf6-5b0a430e47c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:54.868549 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39cf431-0fec-4160-8bf6-5b0a430e47c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:54.869747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cf431-0fec-4160-8bf6-5b0a430e47c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:54.872842 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39cf431-0fec-4160-8bf6-5b0a430e47c2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:54.917595 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1020/2077] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:54 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:54.924875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce95bef-fbee-49e7-9ed4-ddac05ec2878 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:54.941072 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce95bef-fbee-49e7-9ed4-ddac05ec2878 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:55.077542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf431-0fec-4160-8bf6-5b0a430e47c2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:55.080602 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a39cf431-0fec-4160-8bf6-5b0a430e47c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:55.110412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:55.125320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5f496-236c-47d1-9cd2-f2a8bef5a57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:55.126239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5f496-236c-47d1-9cd2-f2a8bef5a57b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:55.126532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5f496-236c-47d1-9cd2-f2a8bef5a57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:55.126838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be5f496-236c-47d1-9cd2-f2a8bef5a57b admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:55.128712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5f496-236c-47d1-9cd2-f2a8bef5a57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:55.133358 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be5f496-236c-47d1-9cd2-f2a8bef5a57b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:55.181498 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1058/2078] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:54 2022] POST /identity/v3/users => generated 294 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:55.186185 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5f496-236c-47d1-9cd2-f2a8bef5a57b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:55.213031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be5f496-236c-47d1-9cd2-f2a8bef5a57b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:55.222184 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bd6f9-ccb3-472e-a8b0-92f1de38612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:55.223069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd6f9-ccb3-472e-a8b0-92f1de38612d admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:55.223470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd6f9-ccb3-472e-a8b0-92f1de38612d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:55.223878 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94bd6f9-ccb3-472e-a8b0-92f1de38612d admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:55.224972 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bd6f9-ccb3-472e-a8b0-92f1de38612d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:55.226630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94bd6f9-ccb3-472e-a8b0-92f1de38612d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:55.242537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1059/2079] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:55.247252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bd6f9-ccb3-472e-a8b0-92f1de38612d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:55.269112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94bd6f9-ccb3-472e-a8b0-92f1de38612d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:55.276710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b878c-ec9a-4821-a400-6893de209c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:55.279360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b878c-ec9a-4821-a400-6893de209c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:55.279508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b878c-ec9a-4821-a400-6893de209c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:55.279683 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b878c-ec9a-4821-a400-6893de209c28 admin admin] PATH_INFO: `/v3/projects/ef1f48d6efe940be8c7acaf5418819c2/users/248784eb45194001a489e68a1295b05d/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:55.289147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39cf431-0fec-4160-8bf6-5b0a430e47c2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:55.303143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383ab603-98fd-4cfa-8284-eae5a4b2cda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:55.304058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ab603-98fd-4cfa-8284-eae5a4b2cda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:55.304341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ab603-98fd-4cfa-8284-eae5a4b2cda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:55.304620 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383ab603-98fd-4cfa-8284-eae5a4b2cda5 admin admin] PATH_INFO: `/v3/projects/16d6ae0275264baaba2c0b089f4232c2` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:55.312117 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ab603-98fd-4cfa-8284-eae5a4b2cda5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d6ae0275264baaba2c0b089f4232c2)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:55.313679 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383ab603-98fd-4cfa-8284-eae5a4b2cda5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:55.314586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b878c-ec9a-4821-a400-6893de209c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1f48d6efe940be8c7acaf5418819c2, user_id=248784eb45194001a489e68a1295b05d, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:55.317612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b878c-ec9a-4821-a400-6893de209c28 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:55.340586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1060/2080] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:55 2022] PUT /identity/v3/projects/ef1f48d6efe940be8c7acaf5418819c2/users/248784eb45194001a489e68a1295b05d/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:55.341809 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b878c-ec9a-4821-a400-6893de209c28 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:55.421794 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-383ab603-98fd-4cfa-8284-eae5a4b2cda5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d6ae0275264baaba2c0b089f4232c2', 'request_id': 'req-383ab603-98fd-4cfa-8284-eae5a4b2cda5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:55.435257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-383ab603-98fd-4cfa-8284-eae5a4b2cda5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d6ae0275264baaba2c0b089f4232c2', 'request_id': 'req-383ab603-98fd-4cfa-8284-eae5a4b2cda5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:55.445721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-383ab603-98fd-4cfa-8284-eae5a4b2cda5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d6ae0275264baaba2c0b089f4232c2', 'request_id': 'req-383ab603-98fd-4cfa-8284-eae5a4b2cda5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:55.451454 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:55.465430 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b878c-ec9a-4821-a400-6893de209c28 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:55.470667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-383ab603-98fd-4cfa-8284-eae5a4b2cda5 admin admin] The token cache is being invalidate because project 16d6ae0275264baaba2c0b089f4232c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:55.471229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-383ab603-98fd-4cfa-8284-eae5a4b2cda5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:55.472397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-383ab603-98fd-4cfa-8284-eae5a4b2cda5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:55.475943 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1021/2081] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:55 2022] DELETE /identity/v3/projects/16d6ae0275264baaba2c0b089f4232c2 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:55.480843 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc09f6-2753-458d-9630-9fee0ce2c190 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:55.481596 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc09f6-2753-458d-9630-9fee0ce2c190 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:55.482049 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc09f6-2753-458d-9630-9fee0ce2c190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:55.510101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-29bc09f6-2753-458d-9630-9fee0ce2c190 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:55.511710 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-29bc09f6-2753-458d-9630-9fee0ce2c190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:55.580129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774676c-bdff-4396-9830-5878a111f20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:55.580957 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774676c-bdff-4396-9830-5878a111f20e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:55.581340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774676c-bdff-4396-9830-5878a111f20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:55.581711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0774676c-bdff-4396-9830-5878a111f20e admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:55.582528 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774676c-bdff-4396-9830-5878a111f20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:55.584734 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0774676c-bdff-4396-9830-5878a111f20e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:55.610905 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1061/2082] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:55 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:55.611809 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774676c-bdff-4396-9830-5878a111f20e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:55.613546 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0774676c-bdff-4396-9830-5878a111f20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:55.616350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1022/2083] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:06:55.617397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc09f6-2753-458d-9630-9fee0ce2c190 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:55.618731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-29bc09f6-2753-458d-9630-9fee0ce2c190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:55.632892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc09f6-2753-458d-9630-9fee0ce2c190 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:55.638406 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c4c78-b104-46a0-82c0-e99b3a4a5e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:55.639361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c4c78-b104-46a0-82c0-e99b3a4a5e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:55.639495 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0774676c-bdff-4396-9830-5878a111f20e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:55.639688 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c4c78-b104-46a0-82c0-e99b3a4a5e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:55.639918 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c4c78-b104-46a0-82c0-e99b3a4a5e5c admin admin] PATH_INFO: `/v3/projects/ef1f48d6efe940be8c7acaf5418819c2/users/248784eb45194001a489e68a1295b05d/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:55.642341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c4c78-b104-46a0-82c0-e99b3a4a5e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef1f48d6efe940be8c7acaf5418819c2, user_id=248784eb45194001a489e68a1295b05d, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:55.645148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:55.645598 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c4c78-b104-46a0-82c0-e99b3a4a5e5c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:55.646068 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:55.646350 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:55.646627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0 admin admin] PATH_INFO: `/v3/projects/925c835f8bdc4153ac07243e579762c0` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:55.647875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=925c835f8bdc4153ac07243e579762c0)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:55.649796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:55.667501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1023/2084] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:55 2022] PUT /identity/v3/projects/ef1f48d6efe940be8c7acaf5418819c2/users/248784eb45194001a489e68a1295b05d/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:55.667501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad761ed5-7425-4665-912a-44b92f424a15 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:55.667501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad761ed5-7425-4665-912a-44b92f424a15 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:55.667501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad761ed5-7425-4665-912a-44b92f424a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:55.681324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ad761ed5-7425-4665-912a-44b92f424a15 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:55.682555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ad761ed5-7425-4665-912a-44b92f424a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:55.715159 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:55.733384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '925c835f8bdc4153ac07243e579762c0', 'request_id': 'req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:55.756146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '925c835f8bdc4153ac07243e579762c0', 'request_id': 'req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:55.770636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '925c835f8bdc4153ac07243e579762c0', 'request_id': 'req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:55.799614 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0 admin admin] The token cache is being invalidate because project 925c835f8bdc4153ac07243e579762c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:55.799857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1024/2085] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:55.800562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:55.802257 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:55.802677 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e0873-e401-4dbe-988a-de7753dbc0f8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:55.804283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e0873-e401-4dbe-988a-de7753dbc0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:55.804678 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e0873-e401-4dbe-988a-de7753dbc0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:55.809918 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1062/2086] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:55 2022] DELETE /identity/v3/projects/925c835f8bdc4153ac07243e579762c0 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:55.812646 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:55.816027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:55.856501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c94e0873-e401-4dbe-988a-de7753dbc0f8 None None] MFA Rules not processed for user `248784eb45194001a489e68a1295b05d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:55.858747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c94e0873-e401-4dbe-988a-de7753dbc0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:55.990364 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270972d-cb3b-4e88-ae98-1f78ea4cd2a0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:56.001397 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566af277-fe34-4f8f-a9df-109de5473c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:56.002716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566af277-fe34-4f8f-a9df-109de5473c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.003033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566af277-fe34-4f8f-a9df-109de5473c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.003319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566af277-fe34-4f8f-a9df-109de5473c9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.004086 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566af277-fe34-4f8f-a9df-109de5473c9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:56.004493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566af277-fe34-4f8f-a9df-109de5473c9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:56.006079 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566af277-fe34-4f8f-a9df-109de5473c9e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:56.037227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1063/2087] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:56.038105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1025/2088] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:56.039618 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc813334-3b3e-4421-aa80-b965bd1a6aee None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.039948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc813334-3b3e-4421-aa80-b965bd1a6aee None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.040184 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc813334-3b3e-4421-aa80-b965bd1a6aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.041106 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9749ac-ffc0-4040-a1b9-7c7cb36e77e0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.042946 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9749ac-ffc0-4040-a1b9-7c7cb36e77e0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.043300 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9749ac-ffc0-4040-a1b9-7c7cb36e77e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.085218 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cc813334-3b3e-4421-aa80-b965bd1a6aee None None] MFA Rules not processed for user `63bb84b42ce84d509155e0514a3c4378`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:56.086580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cc813334-3b3e-4421-aa80-b965bd1a6aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:56.089979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-cd9749ac-ffc0-4040-a1b9-7c7cb36e77e0 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:56.091208 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cd9749ac-ffc0-4040-a1b9-7c7cb36e77e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:56.107389 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1064/2089] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:56.108312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9749ac-ffc0-4040-a1b9-7c7cb36e77e0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:56.120987 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9749ac-ffc0-4040-a1b9-7c7cb36e77e0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:56.127065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eac12b-976b-4762-8571-4d753398a2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:56.127756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eac12b-976b-4762-8571-4d753398a2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.128040 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eac12b-976b-4762-8571-4d753398a2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.128314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eac12b-976b-4762-8571-4d753398a2e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.129059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eac12b-976b-4762-8571-4d753398a2e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:56.131241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eac12b-976b-4762-8571-4d753398a2e6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:56.135208 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:56.166471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1065/2090] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:56 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:56.166471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eac12b-976b-4762-8571-4d753398a2e6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:56.166471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-86eac12b-976b-4762-8571-4d753398a2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:56.183001 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1026/2091] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:56.184405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a501a35-9a4e-4bdc-a84c-2e30fd9e7cbf None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.184702 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a501a35-9a4e-4bdc-a84c-2e30fd9e7cbf None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.184980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a501a35-9a4e-4bdc-a84c-2e30fd9e7cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.210872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5a501a35-9a4e-4bdc-a84c-2e30fd9e7cbf None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:56.212521 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5a501a35-9a4e-4bdc-a84c-2e30fd9e7cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:56.234118 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eac12b-976b-4762-8571-4d753398a2e6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:56.238543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb36251-6601-4d34-99d9-05d135606330 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:56.239659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb36251-6601-4d34-99d9-05d135606330 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.240014 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb36251-6601-4d34-99d9-05d135606330 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.240304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb36251-6601-4d34-99d9-05d135606330 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.242260 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-aeb36251-6601-4d34-99d9-05d135606330 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:56.260558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:56.281375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1027/2092] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:56.282341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a501a35-9a4e-4bdc-a84c-2e30fd9e7cbf None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:56.294308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a501a35-9a4e-4bdc-a84c-2e30fd9e7cbf None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:56.299623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86214f67-2a0d-43fa-a2ac-f9b70fea24bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:56.300234 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86214f67-2a0d-43fa-a2ac-f9b70fea24bb admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.301399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86214f67-2a0d-43fa-a2ac-f9b70fea24bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.301753 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86214f67-2a0d-43fa-a2ac-f9b70fea24bb admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.302539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86214f67-2a0d-43fa-a2ac-f9b70fea24bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:56.305219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86214f67-2a0d-43fa-a2ac-f9b70fea24bb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:56.312077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb36251-6601-4d34-99d9-05d135606330 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:56.313670 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb36251-6601-4d34-99d9-05d135606330 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:56.325317 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1066/2093] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:56.326458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb36251-6601-4d34-99d9-05d135606330 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:56.328281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-aeb36251-6601-4d34-99d9-05d135606330 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:56.333361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1028/2094] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:56 2022] POST /identity/v3/users => generated 290 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:56.334723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86214f67-2a0d-43fa-a2ac-f9b70fea24bb admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:56.342870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb36251-6601-4d34-99d9-05d135606330 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:56.347834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9e76e-d947-4789-8155-e98e286d0700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:56.348635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9e76e-d947-4789-8155-e98e286d0700 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.349029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9e76e-d947-4789-8155-e98e286d0700 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.349854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e9e76e-d947-4789-8155-e98e286d0700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.351494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86214f67-2a0d-43fa-a2ac-f9b70fea24bb admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:56.359530 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216edc2c-28c6-488f-ace9-a6c007d50171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:56.360280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216edc2c-28c6-488f-ace9-a6c007d50171 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.360573 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216edc2c-28c6-488f-ace9-a6c007d50171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.360853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216edc2c-28c6-488f-ace9-a6c007d50171 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.361673 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216edc2c-28c6-488f-ace9-a6c007d50171 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:56.361989 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216edc2c-28c6-488f-ace9-a6c007d50171 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:56.363798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216edc2c-28c6-488f-ace9-a6c007d50171 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:56.388082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1029/2095] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:56.388082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216edc2c-28c6-488f-ace9-a6c007d50171 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:56.400011 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216edc2c-28c6-488f-ace9-a6c007d50171 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:56.404805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e4f20-cafd-4f03-9428-af3bb74443f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:56.405481 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e4f20-cafd-4f03-9428-af3bb74443f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.405853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e4f20-cafd-4f03-9428-af3bb74443f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.406227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e4f20-cafd-4f03-9428-af3bb74443f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.407027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e4f20-cafd-4f03-9428-af3bb74443f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:56.408670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149e4f20-cafd-4f03-9428-af3bb74443f4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:56.440324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1030/2096] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:56.441283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e4f20-cafd-4f03-9428-af3bb74443f4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:56.441511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9e76e-d947-4789-8155-e98e286d0700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:56.443698 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e9e76e-d947-4789-8155-e98e286d0700 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:56.454570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e4f20-cafd-4f03-9428-af3bb74443f4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:56.457115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1067/2097] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:56.458053 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9e76e-d947-4789-8155-e98e286d0700 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:56.466473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702095b3-a6d4-468a-b0b5-e3fea502f576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:56.467675 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702095b3-a6d4-468a-b0b5-e3fea502f576 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.468242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702095b3-a6d4-468a-b0b5-e3fea502f576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.468242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702095b3-a6d4-468a-b0b5-e3fea502f576 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.469035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702095b3-a6d4-468a-b0b5-e3fea502f576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:56.470687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e9e76e-d947-4789-8155-e98e286d0700 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:56.474404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702095b3-a6d4-468a-b0b5-e3fea502f576 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:56.482599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36640108-a1fa-4d2b-85a3-cdbd979bdd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:56.483331 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36640108-a1fa-4d2b-85a3-cdbd979bdd58 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.483618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36640108-a1fa-4d2b-85a3-cdbd979bdd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.483897 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36640108-a1fa-4d2b-85a3-cdbd979bdd58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.484647 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36640108-a1fa-4d2b-85a3-cdbd979bdd58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:56.486277 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36640108-a1fa-4d2b-85a3-cdbd979bdd58 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:56.514786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1068/2098] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:56.515890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36640108-a1fa-4d2b-85a3-cdbd979bdd58 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:56.530060 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36640108-a1fa-4d2b-85a3-cdbd979bdd58 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:56.533454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1031/2099] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:56 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:56.534869 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702095b3-a6d4-468a-b0b5-e3fea502f576 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:56.586579 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:56.643169 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702095b3-a6d4-468a-b0b5-e3fea502f576 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:56.643859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdbe34-9ae3-4fa8-a31a-c76cf930b38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:56.646276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdbe34-9ae3-4fa8-a31a-c76cf930b38e admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.647127 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdbe34-9ae3-4fa8-a31a-c76cf930b38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.647656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdbe34-9ae3-4fa8-a31a-c76cf930b38e admin admin] PATH_INFO: `/v3/projects/a7ff8c46ff2e425a8010f01f5cae83b0/users/7b695ebc5d534be2af6d087f3b584e13/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.649899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b9dd1-5c66-44d8-9878-c45a910fc600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:56.660353 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b9dd1-5c66-44d8-9878-c45a910fc600 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.660699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b9dd1-5c66-44d8-9878-c45a910fc600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.661961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b9dd1-5c66-44d8-9878-c45a910fc600 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.664136 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b9dd1-5c66-44d8-9878-c45a910fc600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:56.669133 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b9dd1-5c66-44d8-9878-c45a910fc600 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:56.686291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdbe34-9ae3-4fa8-a31a-c76cf930b38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ff8c46ff2e425a8010f01f5cae83b0, user_id=7b695ebc5d534be2af6d087f3b584e13, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:56.689398 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdbe34-9ae3-4fa8-a31a-c76cf930b38e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:56.711183 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1069/2100] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:56 2022] PUT /identity/v3/projects/a7ff8c46ff2e425a8010f01f5cae83b0/users/7b695ebc5d534be2af6d087f3b584e13/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:56.722880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1032/2101] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:56 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:56.725301 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd0af4-3f58-4e54-8101-6b691ec8cd10 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.726922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd0af4-3f58-4e54-8101-6b691ec8cd10 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.727071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b9dd1-5c66-44d8-9878-c45a910fc600 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:56.727526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd0af4-3f58-4e54-8101-6b691ec8cd10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.741347 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b9dd1-5c66-44d8-9878-c45a910fc600 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:56.795490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-95fd0af4-3f58-4e54-8101-6b691ec8cd10 None None] MFA Rules not processed for user `7b695ebc5d534be2af6d087f3b584e13`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:56.796949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-95fd0af4-3f58-4e54-8101-6b691ec8cd10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:56.851615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb50997-b150-4366-9fd0-1f911af7ff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:56.853002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb50997-b150-4366-9fd0-1f911af7ff12 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.853407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb50997-b150-4366-9fd0-1f911af7ff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.853833 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb50997-b150-4366-9fd0-1f911af7ff12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.854617 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb50997-b150-4366-9fd0-1f911af7ff12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:56.859856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb50997-b150-4366-9fd0-1f911af7ff12 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:56.879035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1033/2102] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:06:56.883277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb50997-b150-4366-9fd0-1f911af7ff12 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:56.898019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb50997-b150-4366-9fd0-1f911af7ff12 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:56.904203 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27e87a-fbd1-42f0-84a4-4230bf7ed676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:56.904933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27e87a-fbd1-42f0-84a4-4230bf7ed676 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.905347 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27e87a-fbd1-42f0-84a4-4230bf7ed676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.905655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27e87a-fbd1-42f0-84a4-4230bf7ed676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.906362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27e87a-fbd1-42f0-84a4-4230bf7ed676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:56.911972 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27e87a-fbd1-42f0-84a4-4230bf7ed676 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:56.923290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:56.948945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1034/2103] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:06:56.951198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27e87a-fbd1-42f0-84a4-4230bf7ed676 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:56.954896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1070/2104] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:56.957729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd0af4-3f58-4e54-8101-6b691ec8cd10 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:56.971970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27e87a-fbd1-42f0-84a4-4230bf7ed676 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:56.980636 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c38887-6c6f-42e1-adb1-1aa5b10227b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:56.982708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c38887-6c6f-42e1-adb1-1aa5b10227b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:56.986504 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c38887-6c6f-42e1-adb1-1aa5b10227b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:56.986840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c38887-6c6f-42e1-adb1-1aa5b10227b6 admin admin] PATH_INFO: `/v3/projects/a31fa442df894ed3bab6576362223d4b/users/63b31a838ce842f09a05181fcf93509b/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:56.988294 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd0af4-3f58-4e54-8101-6b691ec8cd10 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:56.999999 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68dd781-e810-487d-9f70-9a97b6eb8b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:57.002074 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dd781-e810-487d-9f70-9a97b6eb8b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:57.003495 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dd781-e810-487d-9f70-9a97b6eb8b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:57.003783 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68dd781-e810-487d-9f70-9a97b6eb8b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:57.004502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dd781-e810-487d-9f70-9a97b6eb8b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:57.011307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68dd781-e810-487d-9f70-9a97b6eb8b51 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:57.023613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c38887-6c6f-42e1-adb1-1aa5b10227b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31fa442df894ed3bab6576362223d4b, user_id=63b31a838ce842f09a05181fcf93509b, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:57.028153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c38887-6c6f-42e1-adb1-1aa5b10227b6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:57.048496 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1035/2105] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:56 2022] PUT /identity/v3/projects/a31fa442df894ed3bab6576362223d4b/users/63b31a838ce842f09a05181fcf93509b/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:57.059941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1071/2106] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:56 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:06:57.065966 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c38887-6c6f-42e1-adb1-1aa5b10227b6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:57.071829 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db9d53-aa1a-49b0-997d-baa18307ba05 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:57.072945 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db9d53-aa1a-49b0-997d-baa18307ba05 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:57.073626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28db9d53-aa1a-49b0-997d-baa18307ba05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:57.141707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-28db9d53-aa1a-49b0-997d-baa18307ba05 None None] MFA Rules not processed for user `63b31a838ce842f09a05181fcf93509b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:57.143437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-28db9d53-aa1a-49b0-997d-baa18307ba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:57.214747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c38887-6c6f-42e1-adb1-1aa5b10227b6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:57.245690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1072/2107] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:57.252446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db9d53-aa1a-49b0-997d-baa18307ba05 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:57.272720 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:57.303548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c91e3-cd33-4eb4-9465-6e4eed71ab18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:57.304952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c91e3-cd33-4eb4-9465-6e4eed71ab18 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:57.305523 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c91e3-cd33-4eb4-9465-6e4eed71ab18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:57.306678 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c91e3-cd33-4eb4-9465-6e4eed71ab18 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:57.308092 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c91e3-cd33-4eb4-9465-6e4eed71ab18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:57.314369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c91e3-cd33-4eb4-9465-6e4eed71ab18 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:57.343691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1036/2108] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:57 2022] POST /identity/v3/users => generated 296 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:06:57.347349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c91e3-cd33-4eb4-9465-6e4eed71ab18 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:57.366847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c91e3-cd33-4eb4-9465-6e4eed71ab18 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:57.368017 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28db9d53-aa1a-49b0-997d-baa18307ba05 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:57.371969 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bb220-cc01-47f2-b755-6d379c8e8695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:57.372963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bb220-cc01-47f2-b755-6d379c8e8695 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:57.373326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bb220-cc01-47f2-b755-6d379c8e8695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:57.373836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bb220-cc01-47f2-b755-6d379c8e8695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:57.374941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bb220-cc01-47f2-b755-6d379c8e8695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:57.376913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bb220-cc01-47f2-b755-6d379c8e8695 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:57.385648 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08aa5f9-8df4-43a7-978a-5c13cd50735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:57.386656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08aa5f9-8df4-43a7-978a-5c13cd50735f admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:57.387071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08aa5f9-8df4-43a7-978a-5c13cd50735f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:57.387229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08aa5f9-8df4-43a7-978a-5c13cd50735f admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:57.388082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08aa5f9-8df4-43a7-978a-5c13cd50735f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:57.390394 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08aa5f9-8df4-43a7-978a-5c13cd50735f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:57.398110 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1037/2109] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:57.402365 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bb220-cc01-47f2-b755-6d379c8e8695 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:57.414468 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bb220-cc01-47f2-b755-6d379c8e8695 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:57.420747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08042f-5459-4ba5-87a3-efb59c6c2d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:57.422220 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08042f-5459-4ba5-87a3-efb59c6c2d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:57.423039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08042f-5459-4ba5-87a3-efb59c6c2d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:57.423535 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08042f-5459-4ba5-87a3-efb59c6c2d66 admin admin] PATH_INFO: `/v3/projects/17b8766c0ebd4eecb2180808dce2dcf1/users/d28f44b393434f6198c9b556e9ace5ae/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:57.429925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1073/2110] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:57 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:06:57.431317 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08aa5f9-8df4-43a7-978a-5c13cd50735f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:57.455543 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08042f-5459-4ba5-87a3-efb59c6c2d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b8766c0ebd4eecb2180808dce2dcf1, user_id=d28f44b393434f6198c9b556e9ace5ae, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:57.460274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08042f-5459-4ba5-87a3-efb59c6c2d66 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:57.489102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1038/2111] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:57 2022] PUT /identity/v3/projects/17b8766c0ebd4eecb2180808dce2dcf1/users/d28f44b393434f6198c9b556e9ace5ae/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:57.493676 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08042f-5459-4ba5-87a3-efb59c6c2d66 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:57.524519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08aa5f9-8df4-43a7-978a-5c13cd50735f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:57.544788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:57.601383 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08042f-5459-4ba5-87a3-efb59c6c2d66 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:57.608192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ae43f-04bb-4344-a0c0-6feedbc905cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:57.608883 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ae43f-04bb-4344-a0c0-6feedbc905cf admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:57.609371 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ae43f-04bb-4344-a0c0-6feedbc905cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:57.609653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ae43f-04bb-4344-a0c0-6feedbc905cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:57.610462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ae43f-04bb-4344-a0c0-6feedbc905cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:57.612061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ae43f-04bb-4344-a0c0-6feedbc905cf admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:57.614420 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ae239-054b-4bd4-81b0-aabde9dbe7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:57.615893 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ae239-054b-4bd4-81b0-aabde9dbe7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:57.616308 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ae239-054b-4bd4-81b0-aabde9dbe7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:57.616440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ae239-054b-4bd4-81b0-aabde9dbe7c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:57.617167 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ae239-054b-4bd4-81b0-aabde9dbe7c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:57.619868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00ae239-054b-4bd4-81b0-aabde9dbe7c3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:57.628165 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1039/2112] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:06:57.630385 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ae43f-04bb-4344-a0c0-6feedbc905cf admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:57.645108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ae43f-04bb-4344-a0c0-6feedbc905cf admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:57.650588 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7de739-e1b4-4eaa-85bf-434e7591c32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:57.651635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de739-e1b4-4eaa-85bf-434e7591c32d admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:57.651983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de739-e1b4-4eaa-85bf-434e7591c32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:57.652324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de739-e1b4-4eaa-85bf-434e7591c32d admin admin] PATH_INFO: `/v3/projects/17b8766c0ebd4eecb2180808dce2dcf1/users/d28f44b393434f6198c9b556e9ace5ae/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:57.653216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1074/2113] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:06:57 2022] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:57.654776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7de739-e1b4-4eaa-85bf-434e7591c32d admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b8766c0ebd4eecb2180808dce2dcf1, user_id=d28f44b393434f6198c9b556e9ace5ae, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:57.657140 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ae239-054b-4bd4-81b0-aabde9dbe7c3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:57.657623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7de739-e1b4-4eaa-85bf-434e7591c32d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:57.673977 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00ae239-054b-4bd4-81b0-aabde9dbe7c3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:57.674868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1040/2114] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:57 2022] PUT /identity/v3/projects/17b8766c0ebd4eecb2180808dce2dcf1/users/d28f44b393434f6198c9b556e9ace5ae/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:57.686404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5eadb-98e3-40d4-a89b-4f3ebbd32e88 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:57.686706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5eadb-98e3-40d4-a89b-4f3ebbd32e88 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:57.687022 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5eadb-98e3-40d4-a89b-4f3ebbd32e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:57.711130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:57.720758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0fa5eadb-98e3-40d4-a89b-4f3ebbd32e88 None None] MFA Rules not processed for user `d28f44b393434f6198c9b556e9ace5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:57.724562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0fa5eadb-98e3-40d4-a89b-4f3ebbd32e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:57.761080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20be87-ae2d-405f-9d22-ff18d64a9ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:57.762262 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20be87-ae2d-405f-9d22-ff18d64a9ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:57.762425 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20be87-ae2d-405f-9d22-ff18d64a9ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:57.762710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20be87-ae2d-405f-9d22-ff18d64a9ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:57.765112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20be87-ae2d-405f-9d22-ff18d64a9ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:57.765688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20be87-ae2d-405f-9d22-ff18d64a9ce4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:57.782873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1075/2115] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:57.785493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20be87-ae2d-405f-9d22-ff18d64a9ce4 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:57.798028 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20be87-ae2d-405f-9d22-ff18d64a9ce4 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:57.804545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c3d9c-c2a8-40fb-b334-2f6e8912d95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:57.806469 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c3d9c-c2a8-40fb-b334-2f6e8912d95c admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:57.807007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c3d9c-c2a8-40fb-b334-2f6e8912d95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:57.807724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c3d9c-c2a8-40fb-b334-2f6e8912d95c admin admin] PATH_INFO: `/v3/projects/4497b6b9fe374be2b204977744fc5bb7/users/73af91d5964f4070a07f9bc78b2b74ae/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:57.820828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1041/2116] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:06:57.835126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5eadb-98e3-40d4-a89b-4f3ebbd32e88 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:57.835564 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c3d9c-c2a8-40fb-b334-2f6e8912d95c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4497b6b9fe374be2b204977744fc5bb7, user_id=73af91d5964f4070a07f9bc78b2b74ae, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:57.838488 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c3d9c-c2a8-40fb-b334-2f6e8912d95c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:57.863511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1076/2117] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:57 2022] PUT /identity/v3/projects/4497b6b9fe374be2b204977744fc5bb7/users/73af91d5964f4070a07f9bc78b2b74ae/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:06:57.867779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c3d9c-c2a8-40fb-b334-2f6e8912d95c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:57.925516 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5eadb-98e3-40d4-a89b-4f3ebbd32e88 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:57.970877 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c3d9c-c2a8-40fb-b334-2f6e8912d95c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:57.977098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fba03-eef7-4f18-b217-eb67c5dbd295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:57.977811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fba03-eef7-4f18-b217-eb67c5dbd295 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:57.978090 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fba03-eef7-4f18-b217-eb67c5dbd295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:57.978369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fba03-eef7-4f18-b217-eb67c5dbd295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:57.979220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fba03-eef7-4f18-b217-eb67c5dbd295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:57.980815 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fba03-eef7-4f18-b217-eb67c5dbd295 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:57.992292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1077/2118] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:06:57.996373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fba03-eef7-4f18-b217-eb67c5dbd295 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:58.006340 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791c47d-ab45-4dad-a04d-78dbc2f4a3c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:58.007910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791c47d-ab45-4dad-a04d-78dbc2f4a3c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:58.008300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791c47d-ab45-4dad-a04d-78dbc2f4a3c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:58.008670 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791c47d-ab45-4dad-a04d-78dbc2f4a3c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:58.012866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fba03-eef7-4f18-b217-eb67c5dbd295 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:58.019692 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78b205-d2f6-4b75-8bc6-1cd875c65daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:58.020862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78b205-d2f6-4b75-8bc6-1cd875c65daf admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:58.021161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78b205-d2f6-4b75-8bc6-1cd875c65daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:58.021447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78b205-d2f6-4b75-8bc6-1cd875c65daf admin admin] PATH_INFO: `/v3/projects/4497b6b9fe374be2b204977744fc5bb7/users/73af91d5964f4070a07f9bc78b2b74ae/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:58.023816 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:58.025258 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78b205-d2f6-4b75-8bc6-1cd875c65daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4497b6b9fe374be2b204977744fc5bb7, user_id=73af91d5964f4070a07f9bc78b2b74ae, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:58.029155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78b205-d2f6-4b75-8bc6-1cd875c65daf admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:58.049204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1078/2119] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:06:57 2022] PUT /identity/v3/projects/4497b6b9fe374be2b204977744fc5bb7/users/73af91d5964f4070a07f9bc78b2b74ae/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:06:58.059725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc6c8-5563-4bf6-b1cb-cd4ee3b489d0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:58.060052 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc6c8-5563-4bf6-b1cb-cd4ee3b489d0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:58.060293 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafc6c8-5563-4bf6-b1cb-cd4ee3b489d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:58.087915 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791c47d-ab45-4dad-a04d-78dbc2f4a3c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:58.088777 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-afafc6c8-5563-4bf6-b1cb-cd4ee3b489d0 None None] MFA Rules not processed for user `73af91d5964f4070a07f9bc78b2b74ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:58.089750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791c47d-ab45-4dad-a04d-78dbc2f4a3c0 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:58.090005 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-afafc6c8-5563-4bf6-b1cb-cd4ee3b489d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:58.102252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1042/2120] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:58.183033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1079/2121] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:06:58.204956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fa613-d9a1-46ec-9bb7-dc377a3e3265 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:58.205248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fa613-d9a1-46ec-9bb7-dc377a3e3265 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:58.205517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fa613-d9a1-46ec-9bb7-dc377a3e3265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:58.223240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-877fa613-d9a1-46ec-9bb7-dc377a3e3265 None None] MFA Rules not processed for user `63bb84b42ce84d509155e0514a3c4378`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:58.224525 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-877fa613-d9a1-46ec-9bb7-dc377a3e3265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:58.227752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc6c8-5563-4bf6-b1cb-cd4ee3b489d0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:58.251641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:58.323835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1043/2122] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:06:58.329522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afafc6c8-5563-4bf6-b1cb-cd4ee3b489d0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:58.340330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e57556-276c-4590-9146-dd4630c8ff59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:58.341015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e57556-276c-4590-9146-dd4630c8ff59 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:58.341360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e57556-276c-4590-9146-dd4630c8ff59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:58.341569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e57556-276c-4590-9146-dd4630c8ff59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:58.413061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e57556-276c-4590-9146-dd4630c8ff59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:58.414911 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e57556-276c-4590-9146-dd4630c8ff59 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:58.426643 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1080/2123] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:06:58.596618 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fa613-d9a1-46ec-9bb7-dc377a3e3265 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:58.715765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fa613-d9a1-46ec-9bb7-dc377a3e3265 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:58.724307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29e39b-43ef-422a-a4b0-af938786f85e tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28f44b393434f6198c9b556e9ace5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b8766c0ebd4eecb2180808dce2dcf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:58.724307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29e39b-43ef-422a-a4b0-af938786f85e tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:58.724307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29e39b-43ef-422a-a4b0-af938786f85e tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:58.725446 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29e39b-43ef-422a-a4b0-af938786f85e tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:58.725446 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29e39b-43ef-422a-a4b0-af938786f85e tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:58.725446 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29e39b-43ef-422a-a4b0-af938786f85e tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:58.726659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29e39b-43ef-422a-a4b0-af938786f85e tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:58.767426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1044/2124] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:06:58.772474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e57556-276c-4590-9146-dd4630c8ff59 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:58.788619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e57556-276c-4590-9146-dd4630c8ff59 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:58.808100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee686e-dfe4-4788-8692-060b51943df2 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28f44b393434f6198c9b556e9ace5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b8766c0ebd4eecb2180808dce2dcf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:58.810450 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee686e-dfe4-4788-8692-060b51943df2 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:58.810931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee686e-dfe4-4788-8692-060b51943df2 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:58.811256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee686e-dfe4-4788-8692-060b51943df2 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:58.811979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee686e-dfe4-4788-8692-060b51943df2 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:58.813916 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee686e-dfe4-4788-8692-060b51943df2 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:58.874430 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1081/2125] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:06:58 2022] POST /identity/v3/projects => generated 354 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:06:58.874709 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29e39b-43ef-422a-a4b0-af938786f85e tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:58.893030 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29e39b-43ef-422a-a4b0-af938786f85e tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:58.944222 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:58.969693 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e7ae5-c916-4295-ad88-64bf92c5b3fb tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28f44b393434f6198c9b556e9ace5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b8766c0ebd4eecb2180808dce2dcf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:58.970622 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e7ae5-c916-4295-ad88-64bf92c5b3fb tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:58.971080 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e7ae5-c916-4295-ad88-64bf92c5b3fb tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:58.971627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915e7ae5-c916-4295-ad88-64bf92c5b3fb tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:58.972652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e7ae5-c916-4295-ad88-64bf92c5b3fb tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:06:58.973156 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e7ae5-c916-4295-ad88-64bf92c5b3fb tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:58.974860 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915e7ae5-c916-4295-ad88-64bf92c5b3fb tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:58.992443 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1045/2126] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 16:06:59.035871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee686e-dfe4-4788-8692-060b51943df2 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:59.052404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee686e-dfe4-4788-8692-060b51943df2 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:59.056643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e7ae5-c916-4295-ad88-64bf92c5b3fb tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:59.058499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-915e7ae5-c916-4295-ad88-64bf92c5b3fb tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:59.062852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd28f44b393434f6198c9b556e9ace5ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17b8766c0ebd4eecb2180808dce2dcf1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:59.066174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:59.066365 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:59.066785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] PATH_INFO: `/v3/projects/602c629456dd48f792890a03c05e4365` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:59.069739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] RBAC: Authorizing `identity:delete_project(project_id=602c629456dd48f792890a03c05e4365)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:59.072376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:59.159636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602c629456dd48f792890a03c05e4365', 'request_id': 'req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:59.169998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602c629456dd48f792890a03c05e4365', 'request_id': 'req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:59.173563 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915e7ae5-c916-4295-ad88-64bf92c5b3fb tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:59.179321 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602c629456dd48f792890a03c05e4365', 'request_id': 'req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:59.192752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] The token cache is being invalidate because project 602c629456dd48f792890a03c05e4365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:06:59.193794 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:59.194630 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:59.197496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1082/2127] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:06:59 2022] DELETE /identity/v3/projects/602c629456dd48f792890a03c05e4365 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:59.302539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab0073-1b1a-4ad9-ad5b-d0a605869f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:59.303492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab0073-1b1a-4ad9-ad5b-d0a605869f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:59.303847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab0073-1b1a-4ad9-ad5b-d0a605869f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:59.304061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab0073-1b1a-4ad9-ad5b-d0a605869f35 admin admin] PATH_INFO: `/v3/users/6a05dc6e31114a358543b0411e69add3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:59.305973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab0073-1b1a-4ad9-ad5b-d0a605869f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a05dc6e31114a358543b0411e69add3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:59.308196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab0073-1b1a-4ad9-ad5b-d0a605869f35 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:59.371524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-25ab0073-1b1a-4ad9-ad5b-d0a605869f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a05dc6e31114a358543b0411e69add3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:59.382491 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-25ab0073-1b1a-4ad9-ad5b-d0a605869f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a05dc6e31114a358543b0411e69add3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:59.399075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-25ab0073-1b1a-4ad9-ad5b-d0a605869f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a05dc6e31114a358543b0411e69add3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:59.400070 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-25ab0073-1b1a-4ad9-ad5b-d0a605869f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a05dc6e31114a358543b0411e69add3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:59.401088 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-25ab0073-1b1a-4ad9-ad5b-d0a605869f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a05dc6e31114a358543b0411e69add3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:59.416080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:59.418137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:59.452538 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1046/2128] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:59 2022] DELETE /identity/v3/users/6a05dc6e31114a358543b0411e69add3 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:59.457094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0b344-da36-4c6f-9dea-6ed676bdef16 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:59.457656 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0b344-da36-4c6f-9dea-6ed676bdef16 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:59.458040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0b344-da36-4c6f-9dea-6ed676bdef16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:59.470510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:59.480137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:59.493263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-16f0b344-da36-4c6f-9dea-6ed676bdef16 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:59.496703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-16f0b344-da36-4c6f-9dea-6ed676bdef16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:59.522977 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018df820-1a2b-4d75-ad3e-29fac5e8e7d3 tempest-VolumeQuotaClassesTest-479652800 tempest-VolumeQuotaClassesTest-479652800-project-admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:59.588097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1047/2129] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:59.588980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0b344-da36-4c6f-9dea-6ed676bdef16 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:59.590289 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-16f0b344-da36-4c6f-9dea-6ed676bdef16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:59.603876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f0b344-da36-4c6f-9dea-6ed676bdef16 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:59.611004 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57930015-0d7a-486a-8089-a5475acd70a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:59.611905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930015-0d7a-486a-8089-a5475acd70a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:59.612655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930015-0d7a-486a-8089-a5475acd70a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:59.612941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930015-0d7a-486a-8089-a5475acd70a9 admin admin] PATH_INFO: `/v3/users/7b695ebc5d534be2af6d087f3b584e13` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:59.614305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57930015-0d7a-486a-8089-a5475acd70a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b695ebc5d534be2af6d087f3b584e13)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:59.616286 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57930015-0d7a-486a-8089-a5475acd70a9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:59.620323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673181fd-625c-46e7-9645-6379ac3b717c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:59.623513 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673181fd-625c-46e7-9645-6379ac3b717c service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:59.625081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673181fd-625c-46e7-9645-6379ac3b717c service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:59.625387 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673181fd-625c-46e7-9645-6379ac3b717c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:59.628264 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-673181fd-625c-46e7-9645-6379ac3b717c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:59.685186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-57930015-0d7a-486a-8089-a5475acd70a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b695ebc5d534be2af6d087f3b584e13'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:59.695455 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-57930015-0d7a-486a-8089-a5475acd70a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b695ebc5d534be2af6d087f3b584e13'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:59.707189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-57930015-0d7a-486a-8089-a5475acd70a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b695ebc5d534be2af6d087f3b584e13'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:59.708031 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-57930015-0d7a-486a-8089-a5475acd70a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b695ebc5d534be2af6d087f3b584e13'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:59.708956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-57930015-0d7a-486a-8089-a5475acd70a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b695ebc5d534be2af6d087f3b584e13'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:06:59.714398 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673181fd-625c-46e7-9645-6379ac3b717c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:59.716342 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673181fd-625c-46e7-9645-6379ac3b717c service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:59.728197 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1083/2130] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:59.729375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673181fd-625c-46e7-9645-6379ac3b717c service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:59.731454 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-673181fd-625c-46e7-9645-6379ac3b717c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:59.752216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1048/2131] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:06:59 2022] DELETE /identity/v3/users/7b695ebc5d534be2af6d087f3b584e13 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:06:59.753949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c60a4c-ab42-45aa-8809-d048916d6c21 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:59.754466 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c60a4c-ab42-45aa-8809-d048916d6c21 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:59.754945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c60a4c-ab42-45aa-8809-d048916d6c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:59.784831 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d2c60a4c-ab42-45aa-8809-d048916d6c21 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:06:59.786489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d2c60a4c-ab42-45aa-8809-d048916d6c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:59.813198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673181fd-625c-46e7-9645-6379ac3b717c service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:59.889987 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:06:59.903483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1049/2132] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:06:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:06:59.906713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65133002-4708-43d7-9b2b-eb79d84bef1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:59.907559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65133002-4708-43d7-9b2b-eb79d84bef1d service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:59.908818 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65133002-4708-43d7-9b2b-eb79d84bef1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:59.909283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65133002-4708-43d7-9b2b-eb79d84bef1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:59.912109 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c60a4c-ab42-45aa-8809-d048916d6c21 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:06:59.913738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-65133002-4708-43d7-9b2b-eb79d84bef1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:59.914403 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d2c60a4c-ab42-45aa-8809-d048916d6c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:06:59.939378 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c60a4c-ab42-45aa-8809-d048916d6c21 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:06:59.944069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65133002-4708-43d7-9b2b-eb79d84bef1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:59.945774 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65133002-4708-43d7-9b2b-eb79d84bef1d service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:59.948495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb82eb8-7cca-405a-b785-fbf0ba4c2391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:06:59.949180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb82eb8-7cca-405a-b785-fbf0ba4c2391 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:06:59.949464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb82eb8-7cca-405a-b785-fbf0ba4c2391 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:06:59.949770 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb82eb8-7cca-405a-b785-fbf0ba4c2391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:06:59.966033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1084/2133] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:06:59.971231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb82eb8-7cca-405a-b785-fbf0ba4c2391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:06:59.973491 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb82eb8-7cca-405a-b785-fbf0ba4c2391 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:06:59.988404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1050/2134] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:06:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:01.203037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65133002-4708-43d7-9b2b-eb79d84bef1d service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:01.205288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-65133002-4708-43d7-9b2b-eb79d84bef1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:01.217832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65133002-4708-43d7-9b2b-eb79d84bef1d service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:01.225495 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5881b-694e-434b-b4ee-751cc2dbe47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:01.226668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5881b-694e-434b-b4ee-751cc2dbe47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:01.227037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5881b-694e-434b-b4ee-751cc2dbe47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:01.227275 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5881b-694e-434b-b4ee-751cc2dbe47f admin admin] PATH_INFO: `/v3/users/63b31a838ce842f09a05181fcf93509b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:01.228656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5881b-694e-434b-b4ee-751cc2dbe47f admin admin] RBAC: Authorizing `identity:delete_user(user_id=63b31a838ce842f09a05181fcf93509b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:01.230730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5881b-694e-434b-b4ee-751cc2dbe47f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:01.249748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb82eb8-7cca-405a-b785-fbf0ba4c2391 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:01.251281 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7bb82eb8-7cca-405a-b785-fbf0ba4c2391 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:01.268655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb82eb8-7cca-405a-b785-fbf0ba4c2391 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:01.275732 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdeda33-b362-489e-b020-1bd7ef3440be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:01.276935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdeda33-b362-489e-b020-1bd7ef3440be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:01.276935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdeda33-b362-489e-b020-1bd7ef3440be admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:01.277229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdeda33-b362-489e-b020-1bd7ef3440be admin admin] PATH_INFO: `/v3/projects/9f0ff421a3b54554868b81aea4ee18cb` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:01.279150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdeda33-b362-489e-b020-1bd7ef3440be admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f0ff421a3b54554868b81aea4ee18cb)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:01.281192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdeda33-b362-489e-b020-1bd7ef3440be admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:01.283340 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:01.305963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a6e5881b-694e-434b-b4ee-751cc2dbe47f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63b31a838ce842f09a05181fcf93509b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:01.329573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a6e5881b-694e-434b-b4ee-751cc2dbe47f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63b31a838ce842f09a05181fcf93509b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:01.344461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a6e5881b-694e-434b-b4ee-751cc2dbe47f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63b31a838ce842f09a05181fcf93509b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:01.345437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a6e5881b-694e-434b-b4ee-751cc2dbe47f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63b31a838ce842f09a05181fcf93509b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:01.353741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cfdeda33-b362-489e-b020-1bd7ef3440be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f0ff421a3b54554868b81aea4ee18cb', 'request_id': 'req-cfdeda33-b362-489e-b020-1bd7ef3440be'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:01.357471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a6e5881b-694e-434b-b4ee-751cc2dbe47f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63b31a838ce842f09a05181fcf93509b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:01.361131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cfdeda33-b362-489e-b020-1bd7ef3440be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f0ff421a3b54554868b81aea4ee18cb', 'request_id': 'req-cfdeda33-b362-489e-b020-1bd7ef3440be'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:01.365475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1085/2135] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:01 2022] DELETE /identity/v3/users/63b31a838ce842f09a05181fcf93509b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:01.368838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5881b-694e-434b-b4ee-751cc2dbe47f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:01.368838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a6e5881b-694e-434b-b4ee-751cc2dbe47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:01.372484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cfdeda33-b362-489e-b020-1bd7ef3440be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f0ff421a3b54554868b81aea4ee18cb', 'request_id': 'req-cfdeda33-b362-489e-b020-1bd7ef3440be'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:01.391100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cfdeda33-b362-489e-b020-1bd7ef3440be admin admin] The token cache is being invalidate because project 9f0ff421a3b54554868b81aea4ee18cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:01.391100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cfdeda33-b362-489e-b020-1bd7ef3440be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:01.391100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-cfdeda33-b362-489e-b020-1bd7ef3440be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:01.399444 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1051/2136] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:01 2022] DELETE /identity/v3/projects/9f0ff421a3b54554868b81aea4ee18cb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:01.399444 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620d70f-0e90-4cd0-a260-f6720e5f3d9e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:01.399444 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620d70f-0e90-4cd0-a260-f6720e5f3d9e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:01.399444 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620d70f-0e90-4cd0-a260-f6720e5f3d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:01.425349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e620d70f-0e90-4cd0-a260-f6720e5f3d9e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:01.426755 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e620d70f-0e90-4cd0-a260-f6720e5f3d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:01.508478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5881b-694e-434b-b4ee-751cc2dbe47f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:01.536960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:01.537868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:01.538153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:01.538506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a admin admin] PATH_INFO: `/v3/projects/a7ff8c46ff2e425a8010f01f5cae83b0` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:01.548121 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ff8c46ff2e425a8010f01f5cae83b0)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:01.550083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:01.571947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1052/2137] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:01.574004 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f807a-dee9-43ae-8176-bf56fd66d0c3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:01.574294 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f807a-dee9-43ae-8176-bf56fd66d0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:01.574580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444f807a-dee9-43ae-8176-bf56fd66d0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:01.618061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-444f807a-dee9-43ae-8176-bf56fd66d0c3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:01.619368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-444f807a-dee9-43ae-8176-bf56fd66d0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:01.632456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ff8c46ff2e425a8010f01f5cae83b0', 'request_id': 'req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:01.647457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ff8c46ff2e425a8010f01f5cae83b0', 'request_id': 'req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:01.658542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ff8c46ff2e425a8010f01f5cae83b0', 'request_id': 'req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:01.662109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:01.680423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a admin admin] The token cache is being invalidate because project a7ff8c46ff2e425a8010f01f5cae83b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:01.680817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:01.682084 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:01.683969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1086/2138] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:01 2022] DELETE /identity/v3/projects/a7ff8c46ff2e425a8010f01f5cae83b0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:01.685623 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:01.687297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:01.780436 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1994a1-572b-4025-8e5a-f8b3ab2ee66a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:01.785709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92acbf7-1451-4b7e-abba-1c8161b48d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:01.787440 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92acbf7-1451-4b7e-abba-1c8161b48d53 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:01.788342 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92acbf7-1451-4b7e-abba-1c8161b48d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:01.789002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92acbf7-1451-4b7e-abba-1c8161b48d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:01.791431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b92acbf7-1451-4b7e-abba-1c8161b48d53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:01.821859 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1053/2139] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:01.822965 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f807a-dee9-43ae-8176-bf56fd66d0c3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:01.829952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-444f807a-dee9-43ae-8176-bf56fd66d0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:01.856927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444f807a-dee9-43ae-8176-bf56fd66d0c3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:01.868716 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b8c7f-781a-4843-9491-bfcf9b593ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:01.869632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b8c7f-781a-4843-9491-bfcf9b593ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:01.869918 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b8c7f-781a-4843-9491-bfcf9b593ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:01.870197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b8c7f-781a-4843-9491-bfcf9b593ae3 admin admin] PATH_INFO: `/v3/users/d28f44b393434f6198c9b556e9ace5ae` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:01.873458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b8c7f-781a-4843-9491-bfcf9b593ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d28f44b393434f6198c9b556e9ace5ae)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:01.877245 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b8c7f-781a-4843-9491-bfcf9b593ae3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:01.887865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92acbf7-1451-4b7e-abba-1c8161b48d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:01.890519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92acbf7-1451-4b7e-abba-1c8161b48d53 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:01.908150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1087/2140] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:01.910151 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54528719-7715-4bff-802d-9b38d0fc98c6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:01.910425 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54528719-7715-4bff-802d-9b38d0fc98c6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:01.911218 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54528719-7715-4bff-802d-9b38d0fc98c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:01.945410 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:01.945627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-54528719-7715-4bff-802d-9b38d0fc98c6 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:01.947718 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-54528719-7715-4bff-802d-9b38d0fc98c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:01.972420 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1088/2141] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:01.986424 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54528719-7715-4bff-802d-9b38d0fc98c6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:01.999789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-461b8c7f-781a-4843-9491-bfcf9b593ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28f44b393434f6198c9b556e9ace5ae'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:02.001073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54528719-7715-4bff-802d-9b38d0fc98c6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:02.010865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-461b8c7f-781a-4843-9491-bfcf9b593ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28f44b393434f6198c9b556e9ace5ae'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:02.012785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357056e8-6c05-42e8-92c6-74cb505106e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:02.013793 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357056e8-6c05-42e8-92c6-74cb505106e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:02.014188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357056e8-6c05-42e8-92c6-74cb505106e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:02.014797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357056e8-6c05-42e8-92c6-74cb505106e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:02.015911 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357056e8-6c05-42e8-92c6-74cb505106e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:07:02.016798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357056e8-6c05-42e8-92c6-74cb505106e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:02.020294 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357056e8-6c05-42e8-92c6-74cb505106e0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:02.026663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-461b8c7f-781a-4843-9491-bfcf9b593ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28f44b393434f6198c9b556e9ace5ae'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:02.028395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-461b8c7f-781a-4843-9491-bfcf9b593ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28f44b393434f6198c9b556e9ace5ae'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:02.029445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-461b8c7f-781a-4843-9491-bfcf9b593ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28f44b393434f6198c9b556e9ace5ae'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:02.038870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1089/2142] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:07:02.041840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357056e8-6c05-42e8-92c6-74cb505106e0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:02.044156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-357056e8-6c05-42e8-92c6-74cb505106e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:02.063433 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357056e8-6c05-42e8-92c6-74cb505106e0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:02.068495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1054/2143] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:01 2022] DELETE /identity/v3/users/d28f44b393434f6198c9b556e9ace5ae => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:02.075319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750b569-9502-4cdf-9920-a7a50ab76543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:02.076119 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750b569-9502-4cdf-9920-a7a50ab76543 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:02.076475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750b569-9502-4cdf-9920-a7a50ab76543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:02.076767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750b569-9502-4cdf-9920-a7a50ab76543 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:02.077480 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750b569-9502-4cdf-9920-a7a50ab76543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:02.079584 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750b569-9502-4cdf-9920-a7a50ab76543 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:02.115863 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1090/2144] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:02 2022] POST /identity/v3/projects => generated 389 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:02.120775 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b8c7f-781a-4843-9491-bfcf9b593ae3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:02.244832 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b8c7f-781a-4843-9491-bfcf9b593ae3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:02.329312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d9f4a-8a8e-43ac-98ba-374574910125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:02.330029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d9f4a-8a8e-43ac-98ba-374574910125 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:02.330278 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d9f4a-8a8e-43ac-98ba-374574910125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:02.330557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d9f4a-8a8e-43ac-98ba-374574910125 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:02.332175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d9f4a-8a8e-43ac-98ba-374574910125 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:02.334596 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0d9f4a-8a8e-43ac-98ba-374574910125 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:02.374336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750b569-9502-4cdf-9920-a7a50ab76543 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:02.376216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1055/2145] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:02 2022] POST /identity/v3/users => generated 295 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:07:02.389591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750b569-9502-4cdf-9920-a7a50ab76543 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:02.394554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6ede-6b81-4492-8c41-f16709675bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:02.395324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6ede-6b81-4492-8c41-f16709675bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:02.396324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6ede-6b81-4492-8c41-f16709675bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:02.396640 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6ede-6b81-4492-8c41-f16709675bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:02.397408 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e6ede-6b81-4492-8c41-f16709675bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:02.399100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e6ede-6b81-4492-8c41-f16709675bd5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:02.411445 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1091/2146] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:07:02.416884 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d9f4a-8a8e-43ac-98ba-374574910125 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:02.429648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d9f4a-8a8e-43ac-98ba-374574910125 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:02.436929 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c44dec-2b47-420e-8cef-0fdf7322295e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:02.438098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c44dec-2b47-420e-8cef-0fdf7322295e admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:02.438568 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c44dec-2b47-420e-8cef-0fdf7322295e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:02.438963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c44dec-2b47-420e-8cef-0fdf7322295e admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:02.440645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c44dec-2b47-420e-8cef-0fdf7322295e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:02.442799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c44dec-2b47-420e-8cef-0fdf7322295e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:02.458860 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1056/2147] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:02.461711 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6ede-6b81-4492-8c41-f16709675bd5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:02.478750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6ede-6b81-4492-8c41-f16709675bd5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:02.485504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8acbf6-1126-4786-a15f-f3891f1f1433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:02.486957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c44dec-2b47-420e-8cef-0fdf7322295e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:02.488803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c4c44dec-2b47-420e-8cef-0fdf7322295e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:02.494268 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8acbf6-1126-4786-a15f-f3891f1f1433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:02.494268 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8acbf6-1126-4786-a15f-f3891f1f1433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:02.494493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8acbf6-1126-4786-a15f-f3891f1f1433 admin admin] PATH_INFO: `/v3/projects/fe6fc9d0da8f4150bdf39c770b6f1c5a/users/45549bce936543ab9fcae7036f80a40e/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:02.513374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c44dec-2b47-420e-8cef-0fdf7322295e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:02.530980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:02.531977 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:02.532336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:02.532613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f admin admin] PATH_INFO: `/v3/projects/17b8766c0ebd4eecb2180808dce2dcf1` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:02.534885 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b8766c0ebd4eecb2180808dce2dcf1)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:02.536873 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:02.543126 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8acbf6-1126-4786-a15f-f3891f1f1433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe6fc9d0da8f4150bdf39c770b6f1c5a, user_id=45549bce936543ab9fcae7036f80a40e, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:02.545816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8acbf6-1126-4786-a15f-f3891f1f1433 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:02.578383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1092/2148] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:02 2022] PUT /identity/v3/projects/fe6fc9d0da8f4150bdf39c770b6f1c5a/users/45549bce936543ab9fcae7036f80a40e/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:02.581386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1632d-3841-4449-a2fd-2c5eb4c5e419 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:02.581823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1632d-3841-4449-a2fd-2c5eb4c5e419 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:02.582134 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1632d-3841-4449-a2fd-2c5eb4c5e419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:02.586320 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:02.630781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-80c1632d-3841-4449-a2fd-2c5eb4c5e419 None None] MFA Rules not processed for user `45549bce936543ab9fcae7036f80a40e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:02.632760 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-80c1632d-3841-4449-a2fd-2c5eb4c5e419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:02.643422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b8766c0ebd4eecb2180808dce2dcf1', 'request_id': 'req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:02.652392 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b8766c0ebd4eecb2180808dce2dcf1', 'request_id': 'req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:02.652589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:02.658740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b8766c0ebd4eecb2180808dce2dcf1', 'request_id': 'req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:02.679422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f admin admin] The token cache is being invalidate because project 17b8766c0ebd4eecb2180808dce2dcf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:02.679713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:02.680419 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:02.687101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1057/2149] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:02 2022] DELETE /identity/v3/projects/17b8766c0ebd4eecb2180808dce2dcf1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:02.687746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:02.690150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:02.767414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1093/2150] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:02.769201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093d2ad-7b24-4421-b502-960f0ca76b7d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:02.769470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093d2ad-7b24-4421-b502-960f0ca76b7d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:02.769757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093d2ad-7b24-4421-b502-960f0ca76b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:02.809446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-3093d2ad-7b24-4421-b502-960f0ca76b7d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:02.810709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3093d2ad-7b24-4421-b502-960f0ca76b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:02.873868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07ce14-bc44-4a76-b3cc-09bc041c5c5f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:02.880733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabfd78-7714-4152-b431-11d9f76c0d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:02.882240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabfd78-7714-4152-b431-11d9f76c0d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:02.885644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabfd78-7714-4152-b431-11d9f76c0d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:02.885644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabfd78-7714-4152-b431-11d9f76c0d71 admin admin] PATH_INFO: `/v3/projects/a31fa442df894ed3bab6576362223d4b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:02.885644 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabfd78-7714-4152-b431-11d9f76c0d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31fa442df894ed3bab6576362223d4b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:02.889998 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabfd78-7714-4152-b431-11d9f76c0d71 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:02.948372 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1094/2151] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:02.950390 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093d2ad-7b24-4421-b502-960f0ca76b7d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:02.951992 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3093d2ad-7b24-4421-b502-960f0ca76b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:03.002866 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6cabfd78-7714-4152-b431-11d9f76c0d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31fa442df894ed3bab6576362223d4b', 'request_id': 'req-6cabfd78-7714-4152-b431-11d9f76c0d71'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:03.017768 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6cabfd78-7714-4152-b431-11d9f76c0d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31fa442df894ed3bab6576362223d4b', 'request_id': 'req-6cabfd78-7714-4152-b431-11d9f76c0d71'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:03.024804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6cabfd78-7714-4152-b431-11d9f76c0d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31fa442df894ed3bab6576362223d4b', 'request_id': 'req-6cabfd78-7714-4152-b431-11d9f76c0d71'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:03.044310 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093d2ad-7b24-4421-b502-960f0ca76b7d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:03.051509 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6cabfd78-7714-4152-b431-11d9f76c0d71 admin admin] The token cache is being invalidate because project a31fa442df894ed3bab6576362223d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:03.051791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6cabfd78-7714-4152-b431-11d9f76c0d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:03.052471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6cabfd78-7714-4152-b431-11d9f76c0d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:03.054986 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1058/2152] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:02 2022] DELETE /identity/v3/projects/a31fa442df894ed3bab6576362223d4b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:03.057099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4e6f8-e45d-45c4-ad4a-286f0a4330fc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:03.057429 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4e6f8-e45d-45c4-ad4a-286f0a4330fc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:03.058045 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4e6f8-e45d-45c4-ad4a-286f0a4330fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:03.089009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c6e4e6f8-e45d-45c4-ad4a-286f0a4330fc None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:03.090559 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c6e4e6f8-e45d-45c4-ad4a-286f0a4330fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:03.141476 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124529a-f16c-44b9-a028-f460a3831d6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:03.142341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124529a-f16c-44b9-a028-f460a3831d6e service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:03.142732 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124529a-f16c-44b9-a028-f460a3831d6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:03.143144 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124529a-f16c-44b9-a028-f460a3831d6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:03.145976 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9124529a-f16c-44b9-a028-f460a3831d6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:03.158484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:03.211674 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1059/2153] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:03.212522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4e6f8-e45d-45c4-ad4a-286f0a4330fc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:03.214040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c6e4e6f8-e45d-45c4-ad4a-286f0a4330fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:03.223841 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:03.236074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4e6f8-e45d-45c4-ad4a-286f0a4330fc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:03.248372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89590c-557c-40a3-9ae6-bf5e0de18f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:03.251141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89590c-557c-40a3-9ae6-bf5e0de18f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:03.251542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89590c-557c-40a3-9ae6-bf5e0de18f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:03.252416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89590c-557c-40a3-9ae6-bf5e0de18f71 admin admin] PATH_INFO: `/v3/users/73af91d5964f4070a07f9bc78b2b74ae` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:03.253718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89590c-557c-40a3-9ae6-bf5e0de18f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73af91d5964f4070a07f9bc78b2b74ae)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:03.256284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89590c-557c-40a3-9ae6-bf5e0de18f71 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:03.291620 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124529a-f16c-44b9-a028-f460a3831d6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:03.293457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124529a-f16c-44b9-a028-f460a3831d6e service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:03.318406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1095/2154] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:03.319555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124529a-f16c-44b9-a028-f460a3831d6e service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:03.338458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124529a-f16c-44b9-a028-f460a3831d6e service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:03.353201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819113c-2bbe-4b3d-8d5e-d1225b951278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:03.353201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819113c-2bbe-4b3d-8d5e-d1225b951278 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:03.353201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819113c-2bbe-4b3d-8d5e-d1225b951278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:03.353201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819113c-2bbe-4b3d-8d5e-d1225b951278 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:03.353677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819113c-2bbe-4b3d-8d5e-d1225b951278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:07:03.353677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819113c-2bbe-4b3d-8d5e-d1225b951278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:03.354653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6d89590c-557c-40a3-9ae6-bf5e0de18f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73af91d5964f4070a07f9bc78b2b74ae'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:03.358322 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819113c-2bbe-4b3d-8d5e-d1225b951278 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:03.371860 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6d89590c-557c-40a3-9ae6-bf5e0de18f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73af91d5964f4070a07f9bc78b2b74ae'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:03.385782 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1096/2155] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:07:03.388226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6d89590c-557c-40a3-9ae6-bf5e0de18f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73af91d5964f4070a07f9bc78b2b74ae'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:03.390302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6d89590c-557c-40a3-9ae6-bf5e0de18f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73af91d5964f4070a07f9bc78b2b74ae'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:03.390302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-6d89590c-557c-40a3-9ae6-bf5e0de18f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73af91d5964f4070a07f9bc78b2b74ae'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:03.393475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819113c-2bbe-4b3d-8d5e-d1225b951278 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:03.401207 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a819113c-2bbe-4b3d-8d5e-d1225b951278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:03.424249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819113c-2bbe-4b3d-8d5e-d1225b951278 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:03.432188 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1060/2156] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:03 2022] DELETE /identity/v3/users/73af91d5964f4070a07f9bc78b2b74ae => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:03.450695 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1c00d-58d8-4b51-ae5d-b463e3d17e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:03.451435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1c00d-58d8-4b51-ae5d-b463e3d17e82 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:03.451722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1c00d-58d8-4b51-ae5d-b463e3d17e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:03.452006 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1c00d-58d8-4b51-ae5d-b463e3d17e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:03.452717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1c00d-58d8-4b51-ae5d-b463e3d17e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:03.456840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d1c00d-58d8-4b51-ae5d-b463e3d17e82 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:03.525221 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1097/2157] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:03 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:03.526342 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89590c-557c-40a3-9ae6-bf5e0de18f71 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:03.663520 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89590c-557c-40a3-9ae6-bf5e0de18f71 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:03.786649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9123f2-ad1b-4dd1-a699-ea8dc401f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:03.787595 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9123f2-ad1b-4dd1-a699-ea8dc401f1fa admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:03.788216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9123f2-ad1b-4dd1-a699-ea8dc401f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:03.788721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9123f2-ad1b-4dd1-a699-ea8dc401f1fa admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:03.789669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9123f2-ad1b-4dd1-a699-ea8dc401f1fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:03.792311 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9123f2-ad1b-4dd1-a699-ea8dc401f1fa admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:03.819813 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:03.851305 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1c00d-58d8-4b51-ae5d-b463e3d17e82 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:03.854926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1061/2158] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:03 2022] POST /identity/v3/users => generated 294 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:03.868393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1c00d-58d8-4b51-ae5d-b463e3d17e82 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:03.881486 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04601137-c307-425e-b44b-aeb66c0178f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:03.891438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04601137-c307-425e-b44b-aeb66c0178f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:03.891768 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04601137-c307-425e-b44b-aeb66c0178f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:03.892004 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04601137-c307-425e-b44b-aeb66c0178f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:03.892777 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04601137-c307-425e-b44b-aeb66c0178f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:03.894461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04601137-c307-425e-b44b-aeb66c0178f8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:03.929388 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1098/2159] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:07:03.933803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9123f2-ad1b-4dd1-a699-ea8dc401f1fa admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:03.945567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9123f2-ad1b-4dd1-a699-ea8dc401f1fa admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:03.951732 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5bc93-d61d-4a4b-8753-015a203ccd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:03.953612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5bc93-d61d-4a4b-8753-015a203ccd82 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:03.954037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5bc93-d61d-4a4b-8753-015a203ccd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:03.954421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5bc93-d61d-4a4b-8753-015a203ccd82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:03.955382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5bc93-d61d-4a4b-8753-015a203ccd82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:03.957571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5bc93-d61d-4a4b-8753-015a203ccd82 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:03.991857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1062/2160] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:03.992658 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04601137-c307-425e-b44b-aeb66c0178f8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:04.004531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04601137-c307-425e-b44b-aeb66c0178f8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:04.009960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543916f7-d3cb-4618-9207-10ed0ad60adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:04.010923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543916f7-d3cb-4618-9207-10ed0ad60adc admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:04.011271 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543916f7-d3cb-4618-9207-10ed0ad60adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:04.011496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543916f7-d3cb-4618-9207-10ed0ad60adc admin admin] PATH_INFO: `/v3/projects/e1eb917632df4dd4bcd1cc6bc5822527/users/23584fa42b274c829292dbcd91c0ea38/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:04.033568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543916f7-d3cb-4618-9207-10ed0ad60adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1eb917632df4dd4bcd1cc6bc5822527, user_id=23584fa42b274c829292dbcd91c0ea38, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:04.034095 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543916f7-d3cb-4618-9207-10ed0ad60adc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:04.058876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1099/2161] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:03 2022] PUT /identity/v3/projects/e1eb917632df4dd4bcd1cc6bc5822527/users/23584fa42b274c829292dbcd91c0ea38/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:04.071115 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf1167-fcd6-4bdb-aee0-67852b6f146d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:04.071409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf1167-fcd6-4bdb-aee0-67852b6f146d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:04.071687 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf1167-fcd6-4bdb-aee0-67852b6f146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:04.112956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-43cf1167-fcd6-4bdb-aee0-67852b6f146d None None] MFA Rules not processed for user `23584fa42b274c829292dbcd91c0ea38`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:04.114553 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-43cf1167-fcd6-4bdb-aee0-67852b6f146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:04.222519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1063/2162] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:04.228119 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543916f7-d3cb-4618-9207-10ed0ad60adc admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:04.375665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543916f7-d3cb-4618-9207-10ed0ad60adc admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:04.383665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e997e-b28c-4def-96eb-7f47a8882d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:04.387182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e997e-b28c-4def-96eb-7f47a8882d83 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:04.387829 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e997e-b28c-4def-96eb-7f47a8882d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:04.388189 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e997e-b28c-4def-96eb-7f47a8882d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:04.389148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e997e-b28c-4def-96eb-7f47a8882d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:04.391568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997e997e-b28c-4def-96eb-7f47a8882d83 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:04.479256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1100/2163] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:04 2022] POST /identity/v3/projects => generated 389 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:04.479495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf1167-fcd6-4bdb-aee0-67852b6f146d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:04.495219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf1167-fcd6-4bdb-aee0-67852b6f146d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:04.615138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2622e6d-87d4-4c3c-8911-5eb8cd3d6862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:04.616383 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2622e6d-87d4-4c3c-8911-5eb8cd3d6862 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:04.616809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2622e6d-87d4-4c3c-8911-5eb8cd3d6862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:04.617051 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2622e6d-87d4-4c3c-8911-5eb8cd3d6862 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:04.617899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2622e6d-87d4-4c3c-8911-5eb8cd3d6862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:04.620028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2622e6d-87d4-4c3c-8911-5eb8cd3d6862 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:04.644736 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1064/2164] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:04 2022] POST /identity/v3/users => generated 301 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:04.648913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e997e-b28c-4def-96eb-7f47a8882d83 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:04.662513 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e997e-b28c-4def-96eb-7f47a8882d83 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:04.667591 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2622e6d-87d4-4c3c-8911-5eb8cd3d6862 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:04.667751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a8718-960e-4bc6-880b-475bc64ffe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:04.668523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a8718-960e-4bc6-880b-475bc64ffe89 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:04.668773 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a8718-960e-4bc6-880b-475bc64ffe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:04.669111 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a8718-960e-4bc6-880b-475bc64ffe89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:04.670312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a8718-960e-4bc6-880b-475bc64ffe89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:04.670655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f2622e6d-87d4-4c3c-8911-5eb8cd3d6862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:04.672540 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a8718-960e-4bc6-880b-475bc64ffe89 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:04.690959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1101/2165] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:07:04.698608 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2622e6d-87d4-4c3c-8911-5eb8cd3d6862 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:04.701391 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a8718-960e-4bc6-880b-475bc64ffe89 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:04.706773 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1b93a-20e6-4d8e-a8bc-e2c6cf0b300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:04.708208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1b93a-20e6-4d8e-a8bc-e2c6cf0b300f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:04.708646 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1b93a-20e6-4d8e-a8bc-e2c6cf0b300f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:04.709351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1b93a-20e6-4d8e-a8bc-e2c6cf0b300f admin admin] PATH_INFO: `/v3/projects/4497b6b9fe374be2b204977744fc5bb7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:04.711695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1b93a-20e6-4d8e-a8bc-e2c6cf0b300f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4497b6b9fe374be2b204977744fc5bb7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:04.714473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1b93a-20e6-4d8e-a8bc-e2c6cf0b300f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:04.719452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a8718-960e-4bc6-880b-475bc64ffe89 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:04.731017 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa422d-9c1e-4afb-a122-ef8c0daa56e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:04.731941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa422d-9c1e-4afb-a122-ef8c0daa56e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:04.732239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa422d-9c1e-4afb-a122-ef8c0daa56e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:04.732502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa422d-9c1e-4afb-a122-ef8c0daa56e9 admin admin] PATH_INFO: `/v3/projects/5dd59240393443f6a1098f824263d7ba/users/e3adc98b01da47adb01d2aa5584a9aa0/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:04.753504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa422d-9c1e-4afb-a122-ef8c0daa56e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd59240393443f6a1098f824263d7ba, user_id=e3adc98b01da47adb01d2aa5584a9aa0, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:04.757468 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa422d-9c1e-4afb-a122-ef8c0daa56e9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:04.780890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1102/2166] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:04 2022] PUT /identity/v3/projects/5dd59240393443f6a1098f824263d7ba/users/e3adc98b01da47adb01d2aa5584a9aa0/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:04.785616 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa422d-9c1e-4afb-a122-ef8c0daa56e9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:04.794504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:04.817191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-20f1b93a-20e6-4d8e-a8bc-e2c6cf0b300f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4497b6b9fe374be2b204977744fc5bb7', 'request_id': 'req-20f1b93a-20e6-4d8e-a8bc-e2c6cf0b300f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:04.827157 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-20f1b93a-20e6-4d8e-a8bc-e2c6cf0b300f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4497b6b9fe374be2b204977744fc5bb7', 'request_id': 'req-20f1b93a-20e6-4d8e-a8bc-e2c6cf0b300f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:04.828979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:04.839859 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-20f1b93a-20e6-4d8e-a8bc-e2c6cf0b300f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4497b6b9fe374be2b204977744fc5bb7', 'request_id': 'req-20f1b93a-20e6-4d8e-a8bc-e2c6cf0b300f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:04.867919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-20f1b93a-20e6-4d8e-a8bc-e2c6cf0b300f admin admin] The token cache is being invalidate because project 4497b6b9fe374be2b204977744fc5bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:04.868218 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-20f1b93a-20e6-4d8e-a8bc-e2c6cf0b300f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:04.869939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-20f1b93a-20e6-4d8e-a8bc-e2c6cf0b300f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:04.872613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1065/2167] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:04 2022] DELETE /identity/v3/projects/4497b6b9fe374be2b204977744fc5bb7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:07:04.877175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bc8ad-7336-4614-8056-474c5dddfd13 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:04.877460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bc8ad-7336-4614-8056-474c5dddfd13 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:04.877738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280bc8ad-7336-4614-8056-474c5dddfd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:04.878888 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa422d-9c1e-4afb-a122-ef8c0daa56e9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:04.899329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-280bc8ad-7336-4614-8056-474c5dddfd13 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:04.900553 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-280bc8ad-7336-4614-8056-474c5dddfd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:04.964639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc88176-c1c8-411c-9b09-3e657b71dbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:04.965488 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc88176-c1c8-411c-9b09-3e657b71dbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:04.965703 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc88176-c1c8-411c-9b09-3e657b71dbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:04.966031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc88176-c1c8-411c-9b09-3e657b71dbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:04.967040 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc88176-c1c8-411c-9b09-3e657b71dbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:04.969116 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc88176-c1c8-411c-9b09-3e657b71dbe7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:04.985944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1103/2168] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:04.986122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1066/2169] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:04.991735 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc88176-c1c8-411c-9b09-3e657b71dbe7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:04.993968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853f779-db4a-4923-b7d2-12f48da642a8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:04.994259 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853f779-db4a-4923-b7d2-12f48da642a8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:04.994538 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853f779-db4a-4923-b7d2-12f48da642a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:04.998329 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9bc88176-c1c8-411c-9b09-3e657b71dbe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:05.015554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5853f779-db4a-4923-b7d2-12f48da642a8 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:05.015775 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc88176-c1c8-411c-9b09-3e657b71dbe7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:05.016858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5853f779-db4a-4923-b7d2-12f48da642a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:05.022434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5e42d-57e7-4ffa-b34c-2f2d5d418f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:05.023613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5e42d-57e7-4ffa-b34c-2f2d5d418f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:05.024207 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5e42d-57e7-4ffa-b34c-2f2d5d418f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:05.024601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5e42d-57e7-4ffa-b34c-2f2d5d418f10 admin admin] PATH_INFO: `/v3/projects/5dd59240393443f6a1098f824263d7ba/users/e3adc98b01da47adb01d2aa5584a9aa0/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:05.027507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5e42d-57e7-4ffa-b34c-2f2d5d418f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dd59240393443f6a1098f824263d7ba, user_id=e3adc98b01da47adb01d2aa5584a9aa0, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:05.031277 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5e42d-57e7-4ffa-b34c-2f2d5d418f10 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:05.032071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1067/2170] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:05.036894 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853f779-db4a-4923-b7d2-12f48da642a8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:05.049474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853f779-db4a-4923-b7d2-12f48da642a8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:05.052432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1104/2171] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:04 2022] PUT /identity/v3/projects/5dd59240393443f6a1098f824263d7ba/users/e3adc98b01da47adb01d2aa5584a9aa0/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:05.065767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aae008-d527-42e5-9473-fc306b25ffc1 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:05.066054 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aae008-d527-42e5-9473-fc306b25ffc1 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:05.066330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aae008-d527-42e5-9473-fc306b25ffc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:05.118359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-90aae008-d527-42e5-9473-fc306b25ffc1 None None] MFA Rules not processed for user `e3adc98b01da47adb01d2aa5584a9aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:05.120809 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-90aae008-d527-42e5-9473-fc306b25ffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:05.198112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e4806-6099-43d6-a09f-57d890bf559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:05.198832 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e4806-6099-43d6-a09f-57d890bf559d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:05.199121 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e4806-6099-43d6-a09f-57d890bf559d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:05.199395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e4806-6099-43d6-a09f-57d890bf559d admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:05.200269 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e4806-6099-43d6-a09f-57d890bf559d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:07:05.200578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e4806-6099-43d6-a09f-57d890bf559d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:05.203334 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e4806-6099-43d6-a09f-57d890bf559d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:05.259906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1068/2172] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 16:07:05.271133 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e4806-6099-43d6-a09f-57d890bf559d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:05.282884 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e4806-6099-43d6-a09f-57d890bf559d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:05.289220 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b32884-5978-4069-b1eb-b8f563ec04b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:05.289987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b32884-5978-4069-b1eb-b8f563ec04b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:05.290423 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b32884-5978-4069-b1eb-b8f563ec04b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:05.290938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b32884-5978-4069-b1eb-b8f563ec04b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:05.292015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b32884-5978-4069-b1eb-b8f563ec04b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:05.306420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b32884-5978-4069-b1eb-b8f563ec04b6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:05.340281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1105/2173] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:07:05.351162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1069/2174] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:05 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:05.351891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aae008-d527-42e5-9473-fc306b25ffc1 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:05.353785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-90aae008-d527-42e5-9473-fc306b25ffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:05.355083 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b32884-5978-4069-b1eb-b8f563ec04b6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:05.405338 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:05.432137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:05.456052 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b32884-5978-4069-b1eb-b8f563ec04b6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:05.465160 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c008201-5e3a-4fee-a7df-e051a160e5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:05.466933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c008201-5e3a-4fee-a7df-e051a160e5ed admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:05.467402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c008201-5e3a-4fee-a7df-e051a160e5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:05.467827 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c008201-5e3a-4fee-a7df-e051a160e5ed admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:05.468707 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c008201-5e3a-4fee-a7df-e051a160e5ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:05.469064 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aae008-d527-42e5-9473-fc306b25ffc1 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:05.471556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c008201-5e3a-4fee-a7df-e051a160e5ed admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:05.503751 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1070/2175] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:05 2022] POST /identity/v3/users => generated 283 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:05.507900 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c008201-5e3a-4fee-a7df-e051a160e5ed admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:05.539498 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c008201-5e3a-4fee-a7df-e051a160e5ed admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:05.545435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324414c-7dcc-4397-98bf-3d3d5d1af2c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:05.546926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324414c-7dcc-4397-98bf-3d3d5d1af2c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:05.547704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324414c-7dcc-4397-98bf-3d3d5d1af2c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:05.547819 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2893952-da25-4ab0-97e7-479ac9990759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:05.548273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324414c-7dcc-4397-98bf-3d3d5d1af2c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:05.548386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2893952-da25-4ab0-97e7-479ac9990759 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:05.548665 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2893952-da25-4ab0-97e7-479ac9990759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:05.548936 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2893952-da25-4ab0-97e7-479ac9990759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:05.550952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2893952-da25-4ab0-97e7-479ac9990759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:05.552669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2893952-da25-4ab0-97e7-479ac9990759 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:05.565608 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1071/2176] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:05.572257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2893952-da25-4ab0-97e7-479ac9990759 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:05.584745 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2893952-da25-4ab0-97e7-479ac9990759 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:05.589811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902e925-c86a-4570-823f-0c4cb92448c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:05.590576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902e925-c86a-4570-823f-0c4cb92448c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:05.590964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902e925-c86a-4570-823f-0c4cb92448c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:05.591335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902e925-c86a-4570-823f-0c4cb92448c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:05.592147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902e925-c86a-4570-823f-0c4cb92448c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:05.594146 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902e925-c86a-4570-823f-0c4cb92448c6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:05.607943 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1072/2177] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:05.611956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902e925-c86a-4570-823f-0c4cb92448c6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:05.625126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902e925-c86a-4570-823f-0c4cb92448c6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:05.632474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23820da3-05b4-4159-8946-806feac747e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:05.633565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23820da3-05b4-4159-8946-806feac747e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:05.635395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23820da3-05b4-4159-8946-806feac747e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:05.635395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23820da3-05b4-4159-8946-806feac747e1 admin admin] PATH_INFO: `/v3/projects/0711e63b0e3c4a079d6299966c471207/users/d9c3721a79b64380aae2781650c39645/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:05.657800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23820da3-05b4-4159-8946-806feac747e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0711e63b0e3c4a079d6299966c471207, user_id=d9c3721a79b64380aae2781650c39645, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:05.661616 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23820da3-05b4-4159-8946-806feac747e1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:05.683660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324414c-7dcc-4397-98bf-3d3d5d1af2c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:05.685532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324414c-7dcc-4397-98bf-3d3d5d1af2c1 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:05.693829 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1073/2178] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:05 2022] PUT /identity/v3/projects/0711e63b0e3c4a079d6299966c471207/users/d9c3721a79b64380aae2781650c39645/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:07:05.698269 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1106/2179] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:07:05.700478 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296251be-3d1f-4e49-9bd7-8bc6978eee94 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:05.700985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296251be-3d1f-4e49-9bd7-8bc6978eee94 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:05.701453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296251be-3d1f-4e49-9bd7-8bc6978eee94 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:05.704998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c745e6-ef26-4bd6-be31-45eba0e5723f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:05.705878 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c745e6-ef26-4bd6-be31-45eba0e5723f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:05.707654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1074/2180] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 16:07:05 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:07:05.707800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c745e6-ef26-4bd6-be31-45eba0e5723f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:05.713800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321bd32-ce93-4e66-8ced-117dede27241 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:05.714097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321bd32-ce93-4e66-8ced-117dede27241 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:05.714373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c321bd32-ce93-4e66-8ced-117dede27241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:05.754577 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-19c745e6-ef26-4bd6-be31-45eba0e5723f None None] MFA Rules not processed for user `d9c3721a79b64380aae2781650c39645`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:05.756983 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-19c745e6-ef26-4bd6-be31-45eba0e5723f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:05.760719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c321bd32-ce93-4e66-8ced-117dede27241 None None] MFA Rules not processed for user `1f4a46a051c241a2a47059052735c930`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:05.762135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c321bd32-ce93-4e66-8ced-117dede27241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:05.888699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1075/2181] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 16:07:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:07:05.889599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321bd32-ce93-4e66-8ced-117dede27241 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:05.891121 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c321bd32-ce93-4e66-8ced-117dede27241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:05.943090 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1107/2182] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:07:05.944004 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c745e6-ef26-4bd6-be31-45eba0e5723f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:05.945615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-19c745e6-ef26-4bd6-be31-45eba0e5723f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:05.963360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c745e6-ef26-4bd6-be31-45eba0e5723f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:05.970609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feee670-f731-4224-8b5a-50599e35496f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:05.971520 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feee670-f731-4224-8b5a-50599e35496f service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:05.971874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feee670-f731-4224-8b5a-50599e35496f service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:05.972257 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feee670-f731-4224-8b5a-50599e35496f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:05.982379 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feee670-f731-4224-8b5a-50599e35496f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:05.984166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feee670-f731-4224-8b5a-50599e35496f service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:05.995870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1108/2183] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:05.996819 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feee670-f731-4224-8b5a-50599e35496f service placement] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:06.003020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:06.048170 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c321bd32-ce93-4e66-8ced-117dede27241 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:06.059495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98aa3c-dc4e-47ac-847d-9111be4f0dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:06.060677 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98aa3c-dc4e-47ac-847d-9111be4f0dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:06.060839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98aa3c-dc4e-47ac-847d-9111be4f0dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:06.061076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e98aa3c-dc4e-47ac-847d-9111be4f0dc7 admin admin] PATH_INFO: `/v3/users/a0717341e70e4476a3e5391533e467ce` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:06.063688 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98aa3c-dc4e-47ac-847d-9111be4f0dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0717341e70e4476a3e5391533e467ce)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:06.065744 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e98aa3c-dc4e-47ac-847d-9111be4f0dc7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:06.095634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feee670-f731-4224-8b5a-50599e35496f service placement] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:06.103008 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb751a9-253e-432d-9aea-9a36cf2a1862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:06.104344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb751a9-253e-432d-9aea-9a36cf2a1862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:06.104911 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb751a9-253e-432d-9aea-9a36cf2a1862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:06.105292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb751a9-253e-432d-9aea-9a36cf2a1862 admin admin] PATH_INFO: `/v3/users/23584fa42b274c829292dbcd91c0ea38` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:06.107206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb751a9-253e-432d-9aea-9a36cf2a1862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23584fa42b274c829292dbcd91c0ea38)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:06.110895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb751a9-253e-432d-9aea-9a36cf2a1862 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:06.117753 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:06.135506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7e98aa3c-dc4e-47ac-847d-9111be4f0dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0717341e70e4476a3e5391533e467ce'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:06.143666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7e98aa3c-dc4e-47ac-847d-9111be4f0dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0717341e70e4476a3e5391533e467ce'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:06.151907 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7e98aa3c-dc4e-47ac-847d-9111be4f0dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0717341e70e4476a3e5391533e467ce'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:06.152820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7e98aa3c-dc4e-47ac-847d-9111be4f0dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0717341e70e4476a3e5391533e467ce'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:06.153672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7e98aa3c-dc4e-47ac-847d-9111be4f0dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0717341e70e4476a3e5391533e467ce'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:06.171170 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3cb751a9-253e-432d-9aea-9a36cf2a1862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23584fa42b274c829292dbcd91c0ea38'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:06.178631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1076/2184] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:05 2022] DELETE /identity/v3/users/a0717341e70e4476a3e5391533e467ce => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:06.180320 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98aa3c-dc4e-47ac-847d-9111be4f0dc7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:06.182306 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7e98aa3c-dc4e-47ac-847d-9111be4f0dc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:06.203741 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3cb751a9-253e-432d-9aea-9a36cf2a1862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23584fa42b274c829292dbcd91c0ea38'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:06.216158 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3cb751a9-253e-432d-9aea-9a36cf2a1862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23584fa42b274c829292dbcd91c0ea38'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:06.219360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3cb751a9-253e-432d-9aea-9a36cf2a1862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23584fa42b274c829292dbcd91c0ea38'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:06.228210 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3cb751a9-253e-432d-9aea-9a36cf2a1862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23584fa42b274c829292dbcd91c0ea38'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:06.237922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1109/2185] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:05 2022] DELETE /identity/v3/users/23584fa42b274c829292dbcd91c0ea38 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:06.244194 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd31e7-313e-42f8-8d7d-c85ed82d48cb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:06.244577 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd31e7-313e-42f8-8d7d-c85ed82d48cb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:06.246041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd31e7-313e-42f8-8d7d-c85ed82d48cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:06.265714 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-83bd31e7-313e-42f8-8d7d-c85ed82d48cb None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:06.267624 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e98aa3c-dc4e-47ac-847d-9111be4f0dc7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:06.267750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-83bd31e7-313e-42f8-8d7d-c85ed82d48cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:06.339609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e4d01-00a2-4a12-afa2-6c492c3aab2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:06.340329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e4d01-00a2-4a12-afa2-6c492c3aab2f service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:06.340727 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e4d01-00a2-4a12-afa2-6c492c3aab2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:06.341008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e4d01-00a2-4a12-afa2-6c492c3aab2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:06.343065 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-494e4d01-00a2-4a12-afa2-6c492c3aab2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:06.360465 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1110/2186] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:06.368941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd31e7-313e-42f8-8d7d-c85ed82d48cb None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:06.373164 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-83bd31e7-313e-42f8-8d7d-c85ed82d48cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:06.418348 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:06.444035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e4d01-00a2-4a12-afa2-6c492c3aab2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:06.447361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e4d01-00a2-4a12-afa2-6c492c3aab2f service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:06.463735 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1077/2187] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:06.464663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e4d01-00a2-4a12-afa2-6c492c3aab2f service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:06.466223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-494e4d01-00a2-4a12-afa2-6c492c3aab2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:06.482870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd31e7-313e-42f8-8d7d-c85ed82d48cb None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:06.485797 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e4d01-00a2-4a12-afa2-6c492c3aab2f service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:06.487328 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1288cf-6f14-4b50-9033-2e99339eef1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:06.488214 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1288cf-6f14-4b50-9033-2e99339eef1c service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:06.488618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1288cf-6f14-4b50-9033-2e99339eef1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:06.489186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1288cf-6f14-4b50-9033-2e99339eef1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:06.498539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31251f59-d070-4140-8077-62916ac78071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:06.501461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31251f59-d070-4140-8077-62916ac78071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:06.501778 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31251f59-d070-4140-8077-62916ac78071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:06.502943 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31251f59-d070-4140-8077-62916ac78071 admin admin] PATH_INFO: `/v3/projects/eddd10f655004ffe887d7c078f3824d7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:06.505074 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31251f59-d070-4140-8077-62916ac78071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eddd10f655004ffe887d7c078f3824d7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:06.510634 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31251f59-d070-4140-8077-62916ac78071 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:06.519205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1288cf-6f14-4b50-9033-2e99339eef1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:06.520934 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1288cf-6f14-4b50-9033-2e99339eef1c service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:06.534199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1111/2188] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:07:06.535024 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:06.605550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31251f59-d070-4140-8077-62916ac78071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eddd10f655004ffe887d7c078f3824d7', 'request_id': 'req-31251f59-d070-4140-8077-62916ac78071'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:06.619183 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31251f59-d070-4140-8077-62916ac78071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eddd10f655004ffe887d7c078f3824d7', 'request_id': 'req-31251f59-d070-4140-8077-62916ac78071'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:06.629037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31251f59-d070-4140-8077-62916ac78071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eddd10f655004ffe887d7c078f3824d7', 'request_id': 'req-31251f59-d070-4140-8077-62916ac78071'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:06.659360 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31251f59-d070-4140-8077-62916ac78071 admin admin] The token cache is being invalidate because project eddd10f655004ffe887d7c078f3824d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:06.659927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31251f59-d070-4140-8077-62916ac78071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:06.660799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31251f59-d070-4140-8077-62916ac78071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:06.662556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1078/2189] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:06 2022] DELETE /identity/v3/projects/eddd10f655004ffe887d7c078f3824d7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:06.667849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994a88d-2bd9-475f-bd40-05cb7834abba None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:06.668178 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994a88d-2bd9-475f-bd40-05cb7834abba None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:06.668841 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994a88d-2bd9-475f-bd40-05cb7834abba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:06.691636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d994a88d-2bd9-475f-bd40-05cb7834abba None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:06.697982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d994a88d-2bd9-475f-bd40-05cb7834abba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:06.797632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1112/2190] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:06.807348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9729c7a-50d1-45df-b387-fae5480fbe72 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:06.807705 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9729c7a-50d1-45df-b387-fae5480fbe72 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:06.808080 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9729c7a-50d1-45df-b387-fae5480fbe72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:06.847445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a9729c7a-50d1-45df-b387-fae5480fbe72 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:06.847445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a9729c7a-50d1-45df-b387-fae5480fbe72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:06.856031 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1079/2191] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:06.860578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994a88d-2bd9-475f-bd40-05cb7834abba None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:06.871321 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994a88d-2bd9-475f-bd40-05cb7834abba None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:06.876411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bffe2-b4d6-49bd-9ca4-42743465f50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:06.877118 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bffe2-b4d6-49bd-9ca4-42743465f50e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:06.877400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bffe2-b4d6-49bd-9ca4-42743465f50e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:06.877675 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bffe2-b4d6-49bd-9ca4-42743465f50e admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:06.878453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bffe2-b4d6-49bd-9ca4-42743465f50e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:07:06.878772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bffe2-b4d6-49bd-9ca4-42743465f50e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:06.880664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bffe2-b4d6-49bd-9ca4-42743465f50e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:06.899858 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1113/2192] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:07:06.903569 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9729c7a-50d1-45df-b387-fae5480fbe72 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:06.926061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9729c7a-50d1-45df-b387-fae5480fbe72 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:06.937922 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb3dd4-8906-4ae5-91de-b5e2ba320c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:06.941167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb3dd4-8906-4ae5-91de-b5e2ba320c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:06.941923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb3dd4-8906-4ae5-91de-b5e2ba320c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:06.942226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb3dd4-8906-4ae5-91de-b5e2ba320c59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:06.944162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb3dd4-8906-4ae5-91de-b5e2ba320c59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:06.949354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb3dd4-8906-4ae5-91de-b5e2ba320c59 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:06.970652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bffe2-b4d6-49bd-9ca4-42743465f50e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:06.973047 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ee8bffe2-b4d6-49bd-9ca4-42743465f50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:07.000085 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bffe2-b4d6-49bd-9ca4-42743465f50e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:07.002532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1080/2193] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:06 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:07.004484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb3dd4-8906-4ae5-91de-b5e2ba320c59 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:07.086143 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e0ad2-5211-4ed1-9921-d92e1cdbec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:07.086981 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e0ad2-5211-4ed1-9921-d92e1cdbec02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:07.087336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e0ad2-5211-4ed1-9921-d92e1cdbec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:07.087554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e0ad2-5211-4ed1-9921-d92e1cdbec02 admin admin] PATH_INFO: `/v3/projects/e1eb917632df4dd4bcd1cc6bc5822527` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:07.091304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e0ad2-5211-4ed1-9921-d92e1cdbec02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1eb917632df4dd4bcd1cc6bc5822527)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:07.093301 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e0ad2-5211-4ed1-9921-d92e1cdbec02 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:07.099341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb3dd4-8906-4ae5-91de-b5e2ba320c59 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:07.105161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b9d0a-866f-4a6c-8a9e-4bc3399d3980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:07.106063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b9d0a-866f-4a6c-8a9e-4bc3399d3980 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:07.106435 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b9d0a-866f-4a6c-8a9e-4bc3399d3980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:07.106655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b9d0a-866f-4a6c-8a9e-4bc3399d3980 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:07.108575 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b9d0a-866f-4a6c-8a9e-4bc3399d3980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:07.110562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5b9d0a-866f-4a6c-8a9e-4bc3399d3980 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:07.135833 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1081/2194] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:07 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:07.140952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b9d0a-866f-4a6c-8a9e-4bc3399d3980 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:07.152494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b9d0a-866f-4a6c-8a9e-4bc3399d3980 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:07.157939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4af5c-3ec7-4555-84f3-3fee5e701bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:07.158845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4af5c-3ec7-4555-84f3-3fee5e701bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:07.159256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4af5c-3ec7-4555-84f3-3fee5e701bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:07.159657 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4af5c-3ec7-4555-84f3-3fee5e701bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:07.160649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4af5c-3ec7-4555-84f3-3fee5e701bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:07.163289 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4af5c-3ec7-4555-84f3-3fee5e701bdd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:07.171799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-143e0ad2-5211-4ed1-9921-d92e1cdbec02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1eb917632df4dd4bcd1cc6bc5822527', 'request_id': 'req-143e0ad2-5211-4ed1-9921-d92e1cdbec02'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:07.175423 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1082/2195] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:07:07.182404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4af5c-3ec7-4555-84f3-3fee5e701bdd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:07.182664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:07.191213 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-143e0ad2-5211-4ed1-9921-d92e1cdbec02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1eb917632df4dd4bcd1cc6bc5822527', 'request_id': 'req-143e0ad2-5211-4ed1-9921-d92e1cdbec02'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:07.199968 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-143e0ad2-5211-4ed1-9921-d92e1cdbec02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1eb917632df4dd4bcd1cc6bc5822527', 'request_id': 'req-143e0ad2-5211-4ed1-9921-d92e1cdbec02'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:07.201754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4af5c-3ec7-4555-84f3-3fee5e701bdd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:07.213289 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-143e0ad2-5211-4ed1-9921-d92e1cdbec02 admin admin] The token cache is being invalidate because project e1eb917632df4dd4bcd1cc6bc5822527 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:07.213735 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-143e0ad2-5211-4ed1-9921-d92e1cdbec02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:07.214461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-143e0ad2-5211-4ed1-9921-d92e1cdbec02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:07.219115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1114/2196] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:06 2022] DELETE /identity/v3/projects/e1eb917632df4dd4bcd1cc6bc5822527 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:07:07.220081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e0ad2-5211-4ed1-9921-d92e1cdbec02 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:07.221676 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-143e0ad2-5211-4ed1-9921-d92e1cdbec02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:07.259857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:07.275285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c0fc1-72d5-4aac-8600-e071745321f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:07.276168 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c0fc1-72d5-4aac-8600-e071745321f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:07.276815 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c0fc1-72d5-4aac-8600-e071745321f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:07.277442 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c0fc1-72d5-4aac-8600-e071745321f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:07.278469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c0fc1-72d5-4aac-8600-e071745321f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:07.280456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c0fc1-72d5-4aac-8600-e071745321f9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:07.293070 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1083/2197] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:07:07.297620 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c0fc1-72d5-4aac-8600-e071745321f9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:07.299458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9a6c0fc1-72d5-4aac-8600-e071745321f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:07.310386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e0ad2-5211-4ed1-9921-d92e1cdbec02 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:07.313979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c0fc1-72d5-4aac-8600-e071745321f9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:07.315457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e8a6f-c3b1-4e75-acd4-9430b00d014a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:07.316363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e8a6f-c3b1-4e75-acd4-9430b00d014a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:07.316690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e8a6f-c3b1-4e75-acd4-9430b00d014a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:07.316973 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e8a6f-c3b1-4e75-acd4-9430b00d014a admin admin] PATH_INFO: `/v3/users/e3adc98b01da47adb01d2aa5584a9aa0` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:07.318175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e8a6f-c3b1-4e75-acd4-9430b00d014a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3adc98b01da47adb01d2aa5584a9aa0)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:07.318743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e7171-bca0-43b1-bbb8-9040b2aee9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:07.319701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e7171-bca0-43b1-bbb8-9040b2aee9af admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:07.319982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e7171-bca0-43b1-bbb8-9040b2aee9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:07.320186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e8a6f-c3b1-4e75-acd4-9430b00d014a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:07.320277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e7171-bca0-43b1-bbb8-9040b2aee9af admin admin] PATH_INFO: `/v3/projects/5c14296833fe4c29beb9f2486b84b4bc/users/34ad4a9920e2459d80b18d615edcca55/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:07.339747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e7171-bca0-43b1-bbb8-9040b2aee9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c14296833fe4c29beb9f2486b84b4bc, user_id=34ad4a9920e2459d80b18d615edcca55, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:07.343284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e7171-bca0-43b1-bbb8-9040b2aee9af admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:07.358469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1084/2198] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:07 2022] PUT /identity/v3/projects/5c14296833fe4c29beb9f2486b84b4bc/users/34ad4a9920e2459d80b18d615edcca55/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:07.369635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36a64e-96a2-4849-b207-40b9389eb738 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:07.370168 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36a64e-96a2-4849-b207-40b9389eb738 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:07.370600 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36a64e-96a2-4849-b207-40b9389eb738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:07.371463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-556e8a6f-c3b1-4e75-acd4-9430b00d014a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3adc98b01da47adb01d2aa5584a9aa0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:07.387006 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-556e8a6f-c3b1-4e75-acd4-9430b00d014a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3adc98b01da47adb01d2aa5584a9aa0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:07.396544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-556e8a6f-c3b1-4e75-acd4-9430b00d014a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3adc98b01da47adb01d2aa5584a9aa0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:07.397279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-556e8a6f-c3b1-4e75-acd4-9430b00d014a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3adc98b01da47adb01d2aa5584a9aa0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:07.400678 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8a36a64e-96a2-4849-b207-40b9389eb738 None None] MFA Rules not processed for user `34ad4a9920e2459d80b18d615edcca55`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:07.401926 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8a36a64e-96a2-4849-b207-40b9389eb738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:07.405779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-556e8a6f-c3b1-4e75-acd4-9430b00d014a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3adc98b01da47adb01d2aa5584a9aa0'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:07.413100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1115/2199] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:07 2022] DELETE /identity/v3/users/e3adc98b01da47adb01d2aa5584a9aa0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:07.473679 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1085/2200] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:07:07.485628 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e8a6f-c3b1-4e75-acd4-9430b00d014a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:07.487567 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-556e8a6f-c3b1-4e75-acd4-9430b00d014a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:07.556991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:07.577205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e8a6f-c3b1-4e75-acd4-9430b00d014a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:07.586093 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371a5f0-e052-47b5-a228-d38ee560ed09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:07.586780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371a5f0-e052-47b5-a228-d38ee560ed09 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:07.587265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371a5f0-e052-47b5-a228-d38ee560ed09 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:07.587549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371a5f0-e052-47b5-a228-d38ee560ed09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:07.656993 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371a5f0-e052-47b5-a228-d38ee560ed09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:07.660054 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371a5f0-e052-47b5-a228-d38ee560ed09 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:07.672394 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1116/2201] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:07.772341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36a64e-96a2-4849-b207-40b9389eb738 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:07.774731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8a36a64e-96a2-4849-b207-40b9389eb738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:07.904918 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36a64e-96a2-4849-b207-40b9389eb738 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:08.028777 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ee0c6-99f0-4e13-ab76-df1bd7f30e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:08.029772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ee0c6-99f0-4e13-ab76-df1bd7f30e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:08.030056 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ee0c6-99f0-4e13-ab76-df1bd7f30e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:08.030332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ee0c6-99f0-4e13-ab76-df1bd7f30e5e admin admin] PATH_INFO: `/v3/projects/5dd59240393443f6a1098f824263d7ba` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:08.032585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ee0c6-99f0-4e13-ab76-df1bd7f30e5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dd59240393443f6a1098f824263d7ba)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:08.035479 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ee0c6-99f0-4e13-ab76-df1bd7f30e5e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:08.037708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:08.148645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-078ee0c6-99f0-4e13-ab76-df1bd7f30e5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd59240393443f6a1098f824263d7ba', 'request_id': 'req-078ee0c6-99f0-4e13-ab76-df1bd7f30e5e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:08.190353 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-078ee0c6-99f0-4e13-ab76-df1bd7f30e5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd59240393443f6a1098f824263d7ba', 'request_id': 'req-078ee0c6-99f0-4e13-ab76-df1bd7f30e5e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:08.206645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-078ee0c6-99f0-4e13-ab76-df1bd7f30e5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd59240393443f6a1098f824263d7ba', 'request_id': 'req-078ee0c6-99f0-4e13-ab76-df1bd7f30e5e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:08.238209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-078ee0c6-99f0-4e13-ab76-df1bd7f30e5e admin admin] The token cache is being invalidate because project 5dd59240393443f6a1098f824263d7ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:08.238565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-078ee0c6-99f0-4e13-ab76-df1bd7f30e5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:08.239409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-078ee0c6-99f0-4e13-ab76-df1bd7f30e5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:08.242321 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1086/2202] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:07 2022] DELETE /identity/v3/projects/5dd59240393443f6a1098f824263d7ba => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:07:08.248867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ccc2-2cb0-4971-b1c9-e9e63e8e73fa None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:08.249214 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ccc2-2cb0-4971-b1c9-e9e63e8e73fa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:08.249697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54ccc2-2cb0-4971-b1c9-e9e63e8e73fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:08.284321 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-cd54ccc2-2cb0-4971-b1c9-e9e63e8e73fa None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:08.284812 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cd54ccc2-2cb0-4971-b1c9-e9e63e8e73fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:08.437275 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1117/2203] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:08.445377 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeccfa-e6a5-46d0-99e4-c8bc92386650 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:08.445659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeccfa-e6a5-46d0-99e4-c8bc92386650 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:08.445938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eeccfa-e6a5-46d0-99e4-c8bc92386650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:08.490144 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-47eeccfa-e6a5-46d0-99e4-c8bc92386650 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:08.490144 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-47eeccfa-e6a5-46d0-99e4-c8bc92386650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:08.506920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1087/2204] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:08.511641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54ccc2-2cb0-4971-b1c9-e9e63e8e73fa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:08.525858 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54ccc2-2cb0-4971-b1c9-e9e63e8e73fa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:08.532201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e91cf-5625-4e1b-8a4a-07c1ff0cf245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:08.533156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e91cf-5625-4e1b-8a4a-07c1ff0cf245 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:08.533508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e91cf-5625-4e1b-8a4a-07c1ff0cf245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:08.534208 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e91cf-5625-4e1b-8a4a-07c1ff0cf245 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:08.536798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e91cf-5625-4e1b-8a4a-07c1ff0cf245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:07:08.537653 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e91cf-5625-4e1b-8a4a-07c1ff0cf245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:08.539888 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e91cf-5625-4e1b-8a4a-07c1ff0cf245 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:08.559945 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1118/2205] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:07:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:07:08.564856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eeccfa-e6a5-46d0-99e4-c8bc92386650 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:08.576189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eeccfa-e6a5-46d0-99e4-c8bc92386650 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:08.581838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e4647-674f-4789-a90c-8e811ada7c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:08.582924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e4647-674f-4789-a90c-8e811ada7c4c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:08.583496 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e4647-674f-4789-a90c-8e811ada7c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:08.584025 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e4647-674f-4789-a90c-8e811ada7c4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:08.585653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e4647-674f-4789-a90c-8e811ada7c4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:08.588145 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e4647-674f-4789-a90c-8e811ada7c4c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:08.634864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1088/2206] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:08 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:08.638612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e91cf-5625-4e1b-8a4a-07c1ff0cf245 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:08.649644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e91cf-5625-4e1b-8a4a-07c1ff0cf245 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:08.748803 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21842363-ba92-450f-944d-35db575976a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:08.749949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21842363-ba92-450f-944d-35db575976a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:08.750413 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21842363-ba92-450f-944d-35db575976a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:08.750958 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21842363-ba92-450f-944d-35db575976a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:08.751853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21842363-ba92-450f-944d-35db575976a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:08.755645 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21842363-ba92-450f-944d-35db575976a8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:08.786623 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1119/2207] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:08 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:08.791523 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e4647-674f-4789-a90c-8e811ada7c4c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:08.809817 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e4647-674f-4789-a90c-8e811ada7c4c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:08.815923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd205474-4c76-40ba-be32-1757d350586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:08.816996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd205474-4c76-40ba-be32-1757d350586d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:08.817412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd205474-4c76-40ba-be32-1757d350586d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:08.817757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd205474-4c76-40ba-be32-1757d350586d admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:08.818595 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd205474-4c76-40ba-be32-1757d350586d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:08.820480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd205474-4c76-40ba-be32-1757d350586d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:08.836437 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1089/2208] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:08.843977 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21842363-ba92-450f-944d-35db575976a8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:08.854481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21842363-ba92-450f-944d-35db575976a8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:08.861410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ade1d3-24c3-470a-969e-89038c2176ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:08.862275 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ade1d3-24c3-470a-969e-89038c2176ad admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:08.862602 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ade1d3-24c3-470a-969e-89038c2176ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:08.862936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ade1d3-24c3-470a-969e-89038c2176ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:08.863825 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ade1d3-24c3-470a-969e-89038c2176ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:08.866305 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ade1d3-24c3-470a-969e-89038c2176ad admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:08.878709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1120/2209] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:08.883100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd205474-4c76-40ba-be32-1757d350586d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:08.893864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd205474-4c76-40ba-be32-1757d350586d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:08.898510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ff5ae-c316-4171-9696-df0f3c4253f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:08.899596 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ff5ae-c316-4171-9696-df0f3c4253f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:08.899882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ff5ae-c316-4171-9696-df0f3c4253f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:08.900154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ff5ae-c316-4171-9696-df0f3c4253f7 admin admin] PATH_INFO: `/v3/projects/eb11643024c04e9893bd32349627ac27/users/71626255d6074a1f90cd7bdc2d33ae52/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:08.919469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ff5ae-c316-4171-9696-df0f3c4253f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb11643024c04e9893bd32349627ac27, user_id=71626255d6074a1f90cd7bdc2d33ae52, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:08.922719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88ff5ae-c316-4171-9696-df0f3c4253f7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:08.940976 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1090/2210] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:08 2022] PUT /identity/v3/projects/eb11643024c04e9893bd32349627ac27/users/71626255d6074a1f90cd7bdc2d33ae52/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:08.950015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b717c6-0403-49e4-9c57-ba7d3314336b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:08.950373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b717c6-0403-49e4-9c57-ba7d3314336b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:08.950744 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b717c6-0403-49e4-9c57-ba7d3314336b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:08.958790 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:08.982729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d2b717c6-0403-49e4-9c57-ba7d3314336b None None] MFA Rules not processed for user `71626255d6074a1f90cd7bdc2d33ae52`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:08.984025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d2b717c6-0403-49e4-9c57-ba7d3314336b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:09.064220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1121/2211] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:09.068942 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ff5ae-c316-4171-9696-df0f3c4253f7 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:09.147455 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ff5ae-c316-4171-9696-df0f3c4253f7 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:09.154138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45636ceb-3552-4c0b-895e-3d6c626e24a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:09.154933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45636ceb-3552-4c0b-895e-3d6c626e24a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:09.155297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45636ceb-3552-4c0b-895e-3d6c626e24a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:09.155649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45636ceb-3552-4c0b-895e-3d6c626e24a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:09.156544 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45636ceb-3552-4c0b-895e-3d6c626e24a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:09.158792 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45636ceb-3552-4c0b-895e-3d6c626e24a6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:09.201458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1091/2212] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:09 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:09.206802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b717c6-0403-49e4-9c57-ba7d3314336b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:09.234148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b717c6-0403-49e4-9c57-ba7d3314336b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:09.349818 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a8198-391b-41c1-afc2-38162f241b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:09.351746 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a8198-391b-41c1-afc2-38162f241b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:09.352306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a8198-391b-41c1-afc2-38162f241b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:09.352604 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a8198-391b-41c1-afc2-38162f241b2d admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:09.353708 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a8198-391b-41c1-afc2-38162f241b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:09.357122 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a8198-391b-41c1-afc2-38162f241b2d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:09.394283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1122/2213] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:09 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:09.398424 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45636ceb-3552-4c0b-895e-3d6c626e24a6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:09.408951 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45636ceb-3552-4c0b-895e-3d6c626e24a6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:09.413992 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600907b4-c9bd-4705-83a9-0f8daecbe012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:09.414680 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600907b4-c9bd-4705-83a9-0f8daecbe012 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:09.414996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600907b4-c9bd-4705-83a9-0f8daecbe012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:09.416344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600907b4-c9bd-4705-83a9-0f8daecbe012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:09.416344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600907b4-c9bd-4705-83a9-0f8daecbe012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:09.417641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600907b4-c9bd-4705-83a9-0f8daecbe012 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:09.429119 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:09.432440 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1092/2214] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:07:09.436811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a8198-391b-41c1-afc2-38162f241b2d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:09.449287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a8198-391b-41c1-afc2-38162f241b2d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:09.462890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ccd75-5781-49b7-a5ac-edfe4f67897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:09.462890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ccd75-5781-49b7-a5ac-edfe4f67897b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:09.462890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ccd75-5781-49b7-a5ac-edfe4f67897b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:09.462890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ccd75-5781-49b7-a5ac-edfe4f67897b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:09.463425 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ccd75-5781-49b7-a5ac-edfe4f67897b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:09.463425 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ccd75-5781-49b7-a5ac-edfe4f67897b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:09.474702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1123/2215] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:09.475856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600907b4-c9bd-4705-83a9-0f8daecbe012 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:09.487728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600907b4-c9bd-4705-83a9-0f8daecbe012 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:09.496718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1639a-e674-4f40-9b14-e3a8a67ded1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:09.497838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1639a-e674-4f40-9b14-e3a8a67ded1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:09.498305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1639a-e674-4f40-9b14-e3a8a67ded1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:09.498582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1639a-e674-4f40-9b14-e3a8a67ded1c admin admin] PATH_INFO: `/v3/projects/6a1c382e5a6a4f75bd44190416d186d6/users/f70eabb6cc8543a691919cdccf023a0a/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:09.521407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1639a-e674-4f40-9b14-e3a8a67ded1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1c382e5a6a4f75bd44190416d186d6, user_id=f70eabb6cc8543a691919cdccf023a0a, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:09.524878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1639a-e674-4f40-9b14-e3a8a67ded1c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:09.555491 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1093/2216] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:09 2022] PUT /identity/v3/projects/6a1c382e5a6a4f75bd44190416d186d6/users/f70eabb6cc8543a691919cdccf023a0a/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:07:09.567837 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c39205-3dfc-4428-bf92-940df5d9e740 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:09.568979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c39205-3dfc-4428-bf92-940df5d9e740 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:09.569802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c39205-3dfc-4428-bf92-940df5d9e740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:09.613660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-47c39205-3dfc-4428-bf92-940df5d9e740 None None] MFA Rules not processed for user `f70eabb6cc8543a691919cdccf023a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:09.616805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-47c39205-3dfc-4428-bf92-940df5d9e740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:09.718298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1124/2217] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:09.719570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1639a-e674-4f40-9b14-e3a8a67ded1c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:09.781978 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1639a-e674-4f40-9b14-e3a8a67ded1c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:09.788461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2965594-fcbd-4fc6-adac-fc281a61acff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:09.789478 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2965594-fcbd-4fc6-adac-fc281a61acff admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:09.789761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2965594-fcbd-4fc6-adac-fc281a61acff admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:09.790069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2965594-fcbd-4fc6-adac-fc281a61acff admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:09.790767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2965594-fcbd-4fc6-adac-fc281a61acff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:09.792889 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2965594-fcbd-4fc6-adac-fc281a61acff admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:09.830517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1094/2218] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:09 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:07:09.832147 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c39205-3dfc-4428-bf92-940df5d9e740 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:09.840410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:09.847384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c39205-3dfc-4428-bf92-940df5d9e740 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:09.920611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b911c35-a527-4e53-b44a-f5937b136d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:09.921414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b911c35-a527-4e53-b44a-f5937b136d84 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:09.922404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b911c35-a527-4e53-b44a-f5937b136d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:09.922808 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b911c35-a527-4e53-b44a-f5937b136d84 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:09.924279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b911c35-a527-4e53-b44a-f5937b136d84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:09.926603 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b911c35-a527-4e53-b44a-f5937b136d84 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:09.953716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1125/2219] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:09 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:09.955192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2965594-fcbd-4fc6-adac-fc281a61acff admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:09.968286 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2965594-fcbd-4fc6-adac-fc281a61acff admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:09.974890 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e00fff-4f82-4b02-bf7e-151f91562965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:09.975704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e00fff-4f82-4b02-bf7e-151f91562965 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:09.976152 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e00fff-4f82-4b02-bf7e-151f91562965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:09.976673 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e00fff-4f82-4b02-bf7e-151f91562965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:09.977539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e00fff-4f82-4b02-bf7e-151f91562965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:09.979207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e00fff-4f82-4b02-bf7e-151f91562965 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:09.999477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1095/2220] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:07:10.000573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b911c35-a527-4e53-b44a-f5937b136d84 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:10.013485 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b911c35-a527-4e53-b44a-f5937b136d84 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:10.023368 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd19374-bc3a-45dc-bd8e-f03b4dc16de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:10.024491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd19374-bc3a-45dc-bd8e-f03b4dc16de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:10.024841 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd19374-bc3a-45dc-bd8e-f03b4dc16de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:10.025147 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd19374-bc3a-45dc-bd8e-f03b4dc16de2 admin admin] PATH_INFO: `/v3/projects/3e0d3fda256d427689b405954efb9766/users/222294b084b344858f9ff6fa014e871a/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:10.043560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd19374-bc3a-45dc-bd8e-f03b4dc16de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0d3fda256d427689b405954efb9766, user_id=222294b084b344858f9ff6fa014e871a, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:10.046396 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd19374-bc3a-45dc-bd8e-f03b4dc16de2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:10.062350 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1126/2221] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:09 2022] PUT /identity/v3/projects/3e0d3fda256d427689b405954efb9766/users/222294b084b344858f9ff6fa014e871a/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:10.066726 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e00fff-4f82-4b02-bf7e-151f91562965 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:10.077427 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e00fff-4f82-4b02-bf7e-151f91562965 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:10.141172 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a415f7a-3ca2-4244-982e-503d5c673ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:10.141872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a415f7a-3ca2-4244-982e-503d5c673ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:10.142161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a415f7a-3ca2-4244-982e-503d5c673ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:10.142452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a415f7a-3ca2-4244-982e-503d5c673ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:10.143221 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a415f7a-3ca2-4244-982e-503d5c673ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:10.144951 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a415f7a-3ca2-4244-982e-503d5c673ce6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:10.156294 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1096/2222] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:10.160677 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd19374-bc3a-45dc-bd8e-f03b4dc16de2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:10.172446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd19374-bc3a-45dc-bd8e-f03b4dc16de2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:10.179522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb4d68-eafb-41f7-891b-a2518b1cbdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:10.180619 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4d68-eafb-41f7-891b-a2518b1cbdc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:10.181014 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4d68-eafb-41f7-891b-a2518b1cbdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:10.181375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb4d68-eafb-41f7-891b-a2518b1cbdc8 admin admin] PATH_INFO: `/v3/projects/3e0d3fda256d427689b405954efb9766/users/222294b084b344858f9ff6fa014e871a/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:10.185570 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb4d68-eafb-41f7-891b-a2518b1cbdc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0d3fda256d427689b405954efb9766, user_id=222294b084b344858f9ff6fa014e871a, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:10.188499 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb4d68-eafb-41f7-891b-a2518b1cbdc8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:10.201921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1127/2223] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:10 2022] PUT /identity/v3/projects/3e0d3fda256d427689b405954efb9766/users/222294b084b344858f9ff6fa014e871a/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:10.212700 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a0600-7da9-4aeb-8580-151bbbabc460 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:10.213008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a0600-7da9-4aeb-8580-151bbbabc460 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:10.213289 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a0600-7da9-4aeb-8580-151bbbabc460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:10.241802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-303a0600-7da9-4aeb-8580-151bbbabc460 None None] MFA Rules not processed for user `222294b084b344858f9ff6fa014e871a`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:10.243139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-303a0600-7da9-4aeb-8580-151bbbabc460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:10.280939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:10.322343 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1097/2224] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:07:10.334796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb4d68-eafb-41f7-891b-a2518b1cbdc8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:10.337199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1eeb4d68-eafb-41f7-891b-a2518b1cbdc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:10.405776 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb4d68-eafb-41f7-891b-a2518b1cbdc8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:10.410081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1f1e9-da1f-48ab-a2a7-3aed0bea3282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:10.411071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1f1e9-da1f-48ab-a2a7-3aed0bea3282 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:10.411416 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1f1e9-da1f-48ab-a2a7-3aed0bea3282 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:10.412128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1f1e9-da1f-48ab-a2a7-3aed0bea3282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:10.423406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1f1e9-da1f-48ab-a2a7-3aed0bea3282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:10.425280 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1f1e9-da1f-48ab-a2a7-3aed0bea3282 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:10.440542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1128/2225] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:10.495102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a0600-7da9-4aeb-8580-151bbbabc460 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:10.497342 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-303a0600-7da9-4aeb-8580-151bbbabc460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:10.513639 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a0600-7da9-4aeb-8580-151bbbabc460 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:10.518246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7bb24-13eb-4370-9855-66e47bae728d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:10.518964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7bb24-13eb-4370-9855-66e47bae728d service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:10.519250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7bb24-13eb-4370-9855-66e47bae728d service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:10.519528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7bb24-13eb-4370-9855-66e47bae728d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:10.594834 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7bb24-13eb-4370-9855-66e47bae728d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:10.596304 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7bb24-13eb-4370-9855-66e47bae728d service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:10.606037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1098/2226] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:10.739292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1f1e9-da1f-48ab-a2a7-3aed0bea3282 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:10.743593 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-70f1f1e9-da1f-48ab-a2a7-3aed0bea3282 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:10.842921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:10.849161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1f1e9-da1f-48ab-a2a7-3aed0bea3282 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:10.857700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f107e6-b5e6-433c-98c7-00032d13e414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:10.859626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f107e6-b5e6-433c-98c7-00032d13e414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:10.860044 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f107e6-b5e6-433c-98c7-00032d13e414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:10.860725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f107e6-b5e6-433c-98c7-00032d13e414 admin admin] PATH_INFO: `/v3/users/34ad4a9920e2459d80b18d615edcca55` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:10.862178 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f107e6-b5e6-433c-98c7-00032d13e414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ad4a9920e2459d80b18d615edcca55)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:10.864506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f107e6-b5e6-433c-98c7-00032d13e414 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:10.936340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e1f107e6-b5e6-433c-98c7-00032d13e414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ad4a9920e2459d80b18d615edcca55'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:10.952249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e1f107e6-b5e6-433c-98c7-00032d13e414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ad4a9920e2459d80b18d615edcca55'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:10.960150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e1f107e6-b5e6-433c-98c7-00032d13e414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ad4a9920e2459d80b18d615edcca55'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:10.960914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e1f107e6-b5e6-433c-98c7-00032d13e414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ad4a9920e2459d80b18d615edcca55'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:10.970260 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e1f107e6-b5e6-433c-98c7-00032d13e414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ad4a9920e2459d80b18d615edcca55'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:10.976587 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1129/2227] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:10 2022] DELETE /identity/v3/users/34ad4a9920e2459d80b18d615edcca55 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:10.981415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53507e7-094b-484e-bde6-e8a0c21ca5c0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:10.981947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53507e7-094b-484e-bde6-e8a0c21ca5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:10.981947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53507e7-094b-484e-bde6-e8a0c21ca5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:11.004584 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b53507e7-094b-484e-bde6-e8a0c21ca5c0 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:11.004584 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b53507e7-094b-484e-bde6-e8a0c21ca5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:11.077801 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1099/2228] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:11.088890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f107e6-b5e6-433c-98c7-00032d13e414 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:11.091932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e1f107e6-b5e6-433c-98c7-00032d13e414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:11.184967 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f107e6-b5e6-433c-98c7-00032d13e414 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:11.189095 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df87ff-2b64-458a-9c0b-d51b0cfbc7f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:11.189886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df87ff-2b64-458a-9c0b-d51b0cfbc7f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:11.195000 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df87ff-2b64-458a-9c0b-d51b0cfbc7f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:11.195000 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df87ff-2b64-458a-9c0b-d51b0cfbc7f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:11.213163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df87ff-2b64-458a-9c0b-d51b0cfbc7f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:11.213988 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df87ff-2b64-458a-9c0b-d51b0cfbc7f0 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:11.226288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1130/2229] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:07:11.506920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53507e7-094b-484e-bde6-e8a0c21ca5c0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:11.508354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b53507e7-094b-484e-bde6-e8a0c21ca5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:11.523563 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53507e7-094b-484e-bde6-e8a0c21ca5c0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:11.530062 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1697f-50f8-4ce2-858b-e2863c196a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:11.532016 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1697f-50f8-4ce2-858b-e2863c196a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:11.532325 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1697f-50f8-4ce2-858b-e2863c196a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:11.532709 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1697f-50f8-4ce2-858b-e2863c196a9c admin admin] PATH_INFO: `/v3/projects/5c14296833fe4c29beb9f2486b84b4bc` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:11.539828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1697f-50f8-4ce2-858b-e2863c196a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c14296833fe4c29beb9f2486b84b4bc)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:11.542371 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1697f-50f8-4ce2-858b-e2863c196a9c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:11.593917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-89e1697f-50f8-4ce2-858b-e2863c196a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c14296833fe4c29beb9f2486b84b4bc', 'request_id': 'req-89e1697f-50f8-4ce2-858b-e2863c196a9c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:11.600627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-89e1697f-50f8-4ce2-858b-e2863c196a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c14296833fe4c29beb9f2486b84b4bc', 'request_id': 'req-89e1697f-50f8-4ce2-858b-e2863c196a9c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:11.607264 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-89e1697f-50f8-4ce2-858b-e2863c196a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c14296833fe4c29beb9f2486b84b4bc', 'request_id': 'req-89e1697f-50f8-4ce2-858b-e2863c196a9c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:11.610080 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:11.623950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-89e1697f-50f8-4ce2-858b-e2863c196a9c admin admin] The token cache is being invalidate because project 5c14296833fe4c29beb9f2486b84b4bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:11.624248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-89e1697f-50f8-4ce2-858b-e2863c196a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:11.625155 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-89e1697f-50f8-4ce2-858b-e2863c196a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:11.626747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1100/2230] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:11 2022] DELETE /identity/v3/projects/5c14296833fe4c29beb9f2486b84b4bc => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:11.631860 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b9e79-d73c-4958-9071-65dddfa54f39 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:11.632151 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b9e79-d73c-4958-9071-65dddfa54f39 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:11.632444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b9e79-d73c-4958-9071-65dddfa54f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:11.651111 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e33b9e79-d73c-4958-9071-65dddfa54f39 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:11.652507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e33b9e79-d73c-4958-9071-65dddfa54f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:11.716132 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1131/2231] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:07:11.724105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca610c24-0c0a-4d06-8a7d-c2fe444edbc0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:11.724395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca610c24-0c0a-4d06-8a7d-c2fe444edbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:11.724621 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca610c24-0c0a-4d06-8a7d-c2fe444edbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:11.744358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ca610c24-0c0a-4d06-8a7d-c2fe444edbc0 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:11.745648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ca610c24-0c0a-4d06-8a7d-c2fe444edbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:11.754465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1101/2232] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:11.759218 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b9e79-d73c-4958-9071-65dddfa54f39 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:11.770530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b9e79-d73c-4958-9071-65dddfa54f39 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:11.775355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e32bed-a7e8-497e-9a61-0bf5624b6781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:11.776020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e32bed-a7e8-497e-9a61-0bf5624b6781 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:11.776310 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e32bed-a7e8-497e-9a61-0bf5624b6781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:11.776583 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e32bed-a7e8-497e-9a61-0bf5624b6781 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:11.777323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e32bed-a7e8-497e-9a61-0bf5624b6781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:07:11.777635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e32bed-a7e8-497e-9a61-0bf5624b6781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:11.779333 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e32bed-a7e8-497e-9a61-0bf5624b6781 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:11.794858 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1132/2233] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:07:11.797618 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca610c24-0c0a-4d06-8a7d-c2fe444edbc0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:11.807121 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca610c24-0c0a-4d06-8a7d-c2fe444edbc0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:11.811757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69804358-3e54-47d6-a311-b4fa785a5a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:11.812417 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69804358-3e54-47d6-a311-b4fa785a5a55 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:11.812696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69804358-3e54-47d6-a311-b4fa785a5a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:11.812969 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69804358-3e54-47d6-a311-b4fa785a5a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:11.813698 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69804358-3e54-47d6-a311-b4fa785a5a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:11.815651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69804358-3e54-47d6-a311-b4fa785a5a55 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:11.842336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1102/2234] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:11 2022] POST /identity/v3/projects => generated 363 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:07:11.846678 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e32bed-a7e8-497e-9a61-0bf5624b6781 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:11.858032 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e32bed-a7e8-497e-9a61-0bf5624b6781 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:11.862663 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:11.921987 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ddbc3-9a02-4979-ba89-86313809b741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:11.922682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ddbc3-9a02-4979-ba89-86313809b741 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:11.922994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ddbc3-9a02-4979-ba89-86313809b741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:11.923263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ddbc3-9a02-4979-ba89-86313809b741 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:11.923999 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ddbc3-9a02-4979-ba89-86313809b741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:11.925947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ddbc3-9a02-4979-ba89-86313809b741 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:11.954716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1133/2235] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:11 2022] POST /identity/v3/users => generated 282 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:11.954805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69804358-3e54-47d6-a311-b4fa785a5a55 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:11.967550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69804358-3e54-47d6-a311-b4fa785a5a55 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:11.974785 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae192e3-cacc-4360-8758-8682949bab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:11.975499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae192e3-cacc-4360-8758-8682949bab23 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:11.975882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae192e3-cacc-4360-8758-8682949bab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:11.976146 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae192e3-cacc-4360-8758-8682949bab23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:11.976781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae192e3-cacc-4360-8758-8682949bab23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:11.978399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae192e3-cacc-4360-8758-8682949bab23 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:11.990865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1103/2236] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:11.995033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ddbc3-9a02-4979-ba89-86313809b741 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:12.005750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ddbc3-9a02-4979-ba89-86313809b741 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:12.010969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6634544-3e36-48bb-85b4-dcff9c738ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:12.011658 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6634544-3e36-48bb-85b4-dcff9c738ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:12.011943 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6634544-3e36-48bb-85b4-dcff9c738ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:12.012223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6634544-3e36-48bb-85b4-dcff9c738ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:12.012971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6634544-3e36-48bb-85b4-dcff9c738ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:12.014599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6634544-3e36-48bb-85b4-dcff9c738ab0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:12.028700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1134/2237] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:12.030179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae192e3-cacc-4360-8758-8682949bab23 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:12.040557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae192e3-cacc-4360-8758-8682949bab23 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:12.045865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9cdb3-3289-417d-9a0f-cd9bb9d7fa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:12.047076 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9cdb3-3289-417d-9a0f-cd9bb9d7fa0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:12.047359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9cdb3-3289-417d-9a0f-cd9bb9d7fa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:12.047637 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9cdb3-3289-417d-9a0f-cd9bb9d7fa0d admin admin] PATH_INFO: `/v3/projects/3dad79f79a894251b690f38217462604/users/db3e27f1ceb84649815b113cab35688a/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:12.063522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9cdb3-3289-417d-9a0f-cd9bb9d7fa0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dad79f79a894251b690f38217462604, user_id=db3e27f1ceb84649815b113cab35688a, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:12.066681 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9cdb3-3289-417d-9a0f-cd9bb9d7fa0d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:12.086941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1104/2238] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:12 2022] PUT /identity/v3/projects/3dad79f79a894251b690f38217462604/users/db3e27f1ceb84649815b113cab35688a/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:12.099030 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b234d-cf90-44c6-9e5f-659365168197 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:12.099976 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b234d-cf90-44c6-9e5f-659365168197 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:12.100335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b234d-cf90-44c6-9e5f-659365168197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:12.130493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a10b234d-cf90-44c6-9e5f-659365168197 None None] MFA Rules not processed for user `db3e27f1ceb84649815b113cab35688a`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:12.131885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a10b234d-cf90-44c6-9e5f-659365168197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:12.206077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1135/2239] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:12 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:12.210622 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9cdb3-3289-417d-9a0f-cd9bb9d7fa0d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:12.287932 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9cdb3-3289-417d-9a0f-cd9bb9d7fa0d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:12.292641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c93811-44f3-443c-b659-78e88381a062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:12.293319 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c93811-44f3-443c-b659-78e88381a062 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:12.293602 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c93811-44f3-443c-b659-78e88381a062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:12.293954 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c93811-44f3-443c-b659-78e88381a062 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:12.294660 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c93811-44f3-443c-b659-78e88381a062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:12.296988 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c93811-44f3-443c-b659-78e88381a062 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:12.326320 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1105/2240] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:12 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:12.331114 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b234d-cf90-44c6-9e5f-659365168197 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:12.343442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b234d-cf90-44c6-9e5f-659365168197 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:12.409009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8a75e-8b18-4336-9b62-d5e128f5522d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:12.409730 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8a75e-8b18-4336-9b62-d5e128f5522d admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:12.410051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8a75e-8b18-4336-9b62-d5e128f5522d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:12.410331 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8a75e-8b18-4336-9b62-d5e128f5522d admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:12.411093 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8a75e-8b18-4336-9b62-d5e128f5522d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:12.413098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8a75e-8b18-4336-9b62-d5e128f5522d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:12.438536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1136/2241] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:12 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:07:12.442857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c93811-44f3-443c-b659-78e88381a062 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:12.454536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c93811-44f3-443c-b659-78e88381a062 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:12.460512 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9054ac5-5969-49ef-8fa3-8c71833bb5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:12.461263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9054ac5-5969-49ef-8fa3-8c71833bb5ec admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:12.461546 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9054ac5-5969-49ef-8fa3-8c71833bb5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:12.462300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9054ac5-5969-49ef-8fa3-8c71833bb5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:12.463140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9054ac5-5969-49ef-8fa3-8c71833bb5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:12.465060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9054ac5-5969-49ef-8fa3-8c71833bb5ec admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:12.484412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1106/2242] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:12.489592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8a75e-8b18-4336-9b62-d5e128f5522d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:12.496760 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:12.501705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8a75e-8b18-4336-9b62-d5e128f5522d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:12.508515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcecda8-8b75-488b-b675-92807a7b9af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:12.509734 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcecda8-8b75-488b-b675-92807a7b9af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:12.510081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcecda8-8b75-488b-b675-92807a7b9af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:12.510367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcecda8-8b75-488b-b675-92807a7b9af4 admin admin] PATH_INFO: `/v3/projects/d0c0af06493043abadf9e0041b91b2bd/users/5f0366207edf41a282636ab25fec65ab/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:12.531522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcecda8-8b75-488b-b675-92807a7b9af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c0af06493043abadf9e0041b91b2bd, user_id=5f0366207edf41a282636ab25fec65ab, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:12.534084 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcecda8-8b75-488b-b675-92807a7b9af4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:12.550928 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1137/2243] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:12 2022] PUT /identity/v3/projects/d0c0af06493043abadf9e0041b91b2bd/users/5f0366207edf41a282636ab25fec65ab/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:12.554955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9054ac5-5969-49ef-8fa3-8c71833bb5ec admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:12.568188 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9054ac5-5969-49ef-8fa3-8c71833bb5ec admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:12.630954 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6a567-0308-406f-aec2-00493a154f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:12.631647 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6a567-0308-406f-aec2-00493a154f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:12.631933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6a567-0308-406f-aec2-00493a154f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:12.632345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6a567-0308-406f-aec2-00493a154f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:12.633231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6a567-0308-406f-aec2-00493a154f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:12.635146 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6a567-0308-406f-aec2-00493a154f14 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:12.641962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:12.648759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1107/2244] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:12.653692 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcecda8-8b75-488b-b675-92807a7b9af4 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:12.665633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcecda8-8b75-488b-b675-92807a7b9af4 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:12.672705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b68ef6-0e03-4b87-aa49-7eacfcd23694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:12.673722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b68ef6-0e03-4b87-aa49-7eacfcd23694 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:12.674005 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b68ef6-0e03-4b87-aa49-7eacfcd23694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:12.674281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b68ef6-0e03-4b87-aa49-7eacfcd23694 admin admin] PATH_INFO: `/v3/projects/d0c0af06493043abadf9e0041b91b2bd/users/5f0366207edf41a282636ab25fec65ab/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:12.676620 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b68ef6-0e03-4b87-aa49-7eacfcd23694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c0af06493043abadf9e0041b91b2bd, user_id=5f0366207edf41a282636ab25fec65ab, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:12.679313 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b68ef6-0e03-4b87-aa49-7eacfcd23694 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:12.692384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1138/2245] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:12 2022] PUT /identity/v3/projects/d0c0af06493043abadf9e0041b91b2bd/users/5f0366207edf41a282636ab25fec65ab/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:12.702750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c68fb7-532e-4495-a078-c6e1c851b0f0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:12.703083 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c68fb7-532e-4495-a078-c6e1c851b0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:12.703359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c68fb7-532e-4495-a078-c6e1c851b0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:12.730651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-87c68fb7-532e-4495-a078-c6e1c851b0f0 None None] MFA Rules not processed for user `5f0366207edf41a282636ab25fec65ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:12.731807 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-87c68fb7-532e-4495-a078-c6e1c851b0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:12.831524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1108/2246] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:12 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:12.846126 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b68ef6-0e03-4b87-aa49-7eacfcd23694 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:12.848176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-44b68ef6-0e03-4b87-aa49-7eacfcd23694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:12.915146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b68ef6-0e03-4b87-aa49-7eacfcd23694 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:12.919747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9950c3-7ca1-4633-98d4-2b43639b351d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:12.923581 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9950c3-7ca1-4633-98d4-2b43639b351d service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:12.923779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9950c3-7ca1-4633-98d4-2b43639b351d service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:12.924058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9950c3-7ca1-4633-98d4-2b43639b351d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:12.937202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9950c3-7ca1-4633-98d4-2b43639b351d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:12.938650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9950c3-7ca1-4633-98d4-2b43639b351d service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:12.949028 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1139/2247] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:13.478870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c68fb7-532e-4495-a078-c6e1c851b0f0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:13.573868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c68fb7-532e-4495-a078-c6e1c851b0f0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:13.579404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa28fc-1da5-4da0-b94a-cedaa74dbe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:13.580378 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa28fc-1da5-4da0-b94a-cedaa74dbe82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:13.581360 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa28fc-1da5-4da0-b94a-cedaa74dbe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:13.581710 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa28fc-1da5-4da0-b94a-cedaa74dbe82 admin admin] PATH_INFO: `/v3/users/db3e27f1ceb84649815b113cab35688a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:13.583163 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa28fc-1da5-4da0-b94a-cedaa74dbe82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db3e27f1ceb84649815b113cab35688a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:13.585237 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa28fc-1da5-4da0-b94a-cedaa74dbe82 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:13.643470 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6fa28fc-1da5-4da0-b94a-cedaa74dbe82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db3e27f1ceb84649815b113cab35688a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:13.653126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6fa28fc-1da5-4da0-b94a-cedaa74dbe82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db3e27f1ceb84649815b113cab35688a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:13.663578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6fa28fc-1da5-4da0-b94a-cedaa74dbe82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db3e27f1ceb84649815b113cab35688a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:13.664246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6fa28fc-1da5-4da0-b94a-cedaa74dbe82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db3e27f1ceb84649815b113cab35688a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:13.665192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6fa28fc-1da5-4da0-b94a-cedaa74dbe82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db3e27f1ceb84649815b113cab35688a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:13.687303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1109/2248] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:13 2022] DELETE /identity/v3/users/db3e27f1ceb84649815b113cab35688a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:13.692601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de257bd6-905d-4f00-b762-f2a93c520e45 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:13.693343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de257bd6-905d-4f00-b762-f2a93c520e45 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:13.693627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de257bd6-905d-4f00-b762-f2a93c520e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:13.712319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-de257bd6-905d-4f00-b762-f2a93c520e45 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:13.713545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-de257bd6-905d-4f00-b762-f2a93c520e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:13.725212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa28fc-1da5-4da0-b94a-cedaa74dbe82 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:13.726406 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d6fa28fc-1da5-4da0-b94a-cedaa74dbe82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:13.735376 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:13.788214 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1140/2249] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:13.800017 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de257bd6-905d-4f00-b762-f2a93c520e45 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:13.801652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-de257bd6-905d-4f00-b762-f2a93c520e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:13.806451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa28fc-1da5-4da0-b94a-cedaa74dbe82 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:13.812317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f024659-29d3-4b71-90d9-7675719d0b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:13.813258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f024659-29d3-4b71-90d9-7675719d0b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:13.813594 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f024659-29d3-4b71-90d9-7675719d0b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:13.813871 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f024659-29d3-4b71-90d9-7675719d0b46 admin admin] PATH_INFO: `/v3/users/2e6a8359af2b48fea411ac5e5dd1870d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:13.815331 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f024659-29d3-4b71-90d9-7675719d0b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6a8359af2b48fea411ac5e5dd1870d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:13.817213 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f024659-29d3-4b71-90d9-7675719d0b46 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:13.862009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de257bd6-905d-4f00-b762-f2a93c520e45 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:13.866845 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45723a-7555-45cd-970f-f555a48bec26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:13.867708 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45723a-7555-45cd-970f-f555a48bec26 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:13.868269 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45723a-7555-45cd-970f-f555a48bec26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:13.868715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45723a-7555-45cd-970f-f555a48bec26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:13.869683 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f024659-29d3-4b71-90d9-7675719d0b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6a8359af2b48fea411ac5e5dd1870d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:13.877401 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f024659-29d3-4b71-90d9-7675719d0b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6a8359af2b48fea411ac5e5dd1870d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:13.878801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45723a-7555-45cd-970f-f555a48bec26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:13.880286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45723a-7555-45cd-970f-f555a48bec26 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:13.885812 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f024659-29d3-4b71-90d9-7675719d0b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6a8359af2b48fea411ac5e5dd1870d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:13.886491 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f024659-29d3-4b71-90d9-7675719d0b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6a8359af2b48fea411ac5e5dd1870d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:13.887251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f024659-29d3-4b71-90d9-7675719d0b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6a8359af2b48fea411ac5e5dd1870d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:13.891281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1141/2250] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:07:13.910179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1110/2251] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:13 2022] DELETE /identity/v3/users/2e6a8359af2b48fea411ac5e5dd1870d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:07:13.914994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a113297-b25f-4181-8e58-493e29ec1c51 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:13.915329 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a113297-b25f-4181-8e58-493e29ec1c51 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:13.915623 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a113297-b25f-4181-8e58-493e29ec1c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:13.934090 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2a113297-b25f-4181-8e58-493e29ec1c51 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:13.935359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2a113297-b25f-4181-8e58-493e29ec1c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:13.944160 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:14.004452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1142/2252] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:14.014557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f024659-29d3-4b71-90d9-7675719d0b46 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:14.016173 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0f024659-29d3-4b71-90d9-7675719d0b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:14.085526 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f024659-29d3-4b71-90d9-7675719d0b46 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:14.091716 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b8f2b-ce31-4dea-99d6-a6b9a40069ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:14.093460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b8f2b-ce31-4dea-99d6-a6b9a40069ad service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:14.093811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b8f2b-ce31-4dea-99d6-a6b9a40069ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:14.094514 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b8f2b-ce31-4dea-99d6-a6b9a40069ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:14.112720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b8f2b-ce31-4dea-99d6-a6b9a40069ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:14.115647 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b8f2b-ce31-4dea-99d6-a6b9a40069ad service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:14.130461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1111/2253] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:14.332317 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a113297-b25f-4181-8e58-493e29ec1c51 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:14.334046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2a113297-b25f-4181-8e58-493e29ec1c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:14.346935 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a113297-b25f-4181-8e58-493e29ec1c51 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:14.353341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f922cf0-3965-410c-b695-8557f9bcd795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:14.354476 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922cf0-3965-410c-b695-8557f9bcd795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:14.354807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922cf0-3965-410c-b695-8557f9bcd795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:14.355117 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f922cf0-3965-410c-b695-8557f9bcd795 admin admin] PATH_INFO: `/v3/projects/3dad79f79a894251b690f38217462604` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:14.356736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f922cf0-3965-410c-b695-8557f9bcd795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dad79f79a894251b690f38217462604)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:14.358916 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f922cf0-3965-410c-b695-8557f9bcd795 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:14.445326 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9f922cf0-3965-410c-b695-8557f9bcd795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dad79f79a894251b690f38217462604', 'request_id': 'req-9f922cf0-3965-410c-b695-8557f9bcd795'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.454497 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9f922cf0-3965-410c-b695-8557f9bcd795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dad79f79a894251b690f38217462604', 'request_id': 'req-9f922cf0-3965-410c-b695-8557f9bcd795'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.463789 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9f922cf0-3965-410c-b695-8557f9bcd795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dad79f79a894251b690f38217462604', 'request_id': 'req-9f922cf0-3965-410c-b695-8557f9bcd795'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.476421 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9f922cf0-3965-410c-b695-8557f9bcd795 admin admin] The token cache is being invalidate because project 3dad79f79a894251b690f38217462604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:14.476780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9f922cf0-3965-410c-b695-8557f9bcd795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.477415 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9f922cf0-3965-410c-b695-8557f9bcd795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.479360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1143/2254] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:14 2022] DELETE /identity/v3/projects/3dad79f79a894251b690f38217462604 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:07:14.484431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b8f2b-ce31-4dea-99d6-a6b9a40069ad service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:14.497017 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b8f2b-ce31-4dea-99d6-a6b9a40069ad service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:14.536919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:14.584645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378be1a2-de9b-4b21-b120-b2a335feb82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:14.585808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378be1a2-de9b-4b21-b120-b2a335feb82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:14.586150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378be1a2-de9b-4b21-b120-b2a335feb82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:14.586228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378be1a2-de9b-4b21-b120-b2a335feb82a admin admin] PATH_INFO: `/v3/users/5f0366207edf41a282636ab25fec65ab` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:14.587828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378be1a2-de9b-4b21-b120-b2a335feb82a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0366207edf41a282636ab25fec65ab)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:14.590410 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378be1a2-de9b-4b21-b120-b2a335feb82a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:14.598550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f922cf0-3965-410c-b695-8557f9bcd795 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:14.611257 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9f922cf0-3965-410c-b695-8557f9bcd795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:14.637996 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f922cf0-3965-410c-b695-8557f9bcd795 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:14.648431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:14.649810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:14.650136 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:14.650518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc admin admin] PATH_INFO: `/v3/projects/e75759ef90224b4cb399d0f8d27769a2` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:14.651965 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e75759ef90224b4cb399d0f8d27769a2)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:14.654289 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:14.675576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-378be1a2-de9b-4b21-b120-b2a335feb82a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0366207edf41a282636ab25fec65ab'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.683688 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-378be1a2-de9b-4b21-b120-b2a335feb82a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0366207edf41a282636ab25fec65ab'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.693186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-378be1a2-de9b-4b21-b120-b2a335feb82a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0366207edf41a282636ab25fec65ab'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.694395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-378be1a2-de9b-4b21-b120-b2a335feb82a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0366207edf41a282636ab25fec65ab'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.695710 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-378be1a2-de9b-4b21-b120-b2a335feb82a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0366207edf41a282636ab25fec65ab'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.715416 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75759ef90224b4cb399d0f8d27769a2', 'request_id': 'req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.721468 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1112/2255] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:14 2022] DELETE /identity/v3/users/5f0366207edf41a282636ab25fec65ab => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:14.728397 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75759ef90224b4cb399d0f8d27769a2', 'request_id': 'req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.741261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75759ef90224b4cb399d0f8d27769a2', 'request_id': 'req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.756761 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc admin admin] The token cache is being invalidate because project e75759ef90224b4cb399d0f8d27769a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:14.757361 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.759110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.761385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1144/2256] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:14 2022] DELETE /identity/v3/projects/e75759ef90224b4cb399d0f8d27769a2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:14.766157 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378be1a2-de9b-4b21-b120-b2a335feb82a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:14.768054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-378be1a2-de9b-4b21-b120-b2a335feb82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:14.857308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378be1a2-de9b-4b21-b120-b2a335feb82a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:14.863034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd26fb3-2370-4b28-970c-66f2ed846258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:14.864251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd26fb3-2370-4b28-970c-66f2ed846258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:14.864606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd26fb3-2370-4b28-970c-66f2ed846258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:14.865018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd26fb3-2370-4b28-970c-66f2ed846258 admin admin] PATH_INFO: `/v3/users/248784eb45194001a489e68a1295b05d` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:14.866355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd26fb3-2370-4b28-970c-66f2ed846258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=248784eb45194001a489e68a1295b05d)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:14.868722 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd26fb3-2370-4b28-970c-66f2ed846258 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:14.960255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9dd26fb3-2370-4b28-970c-66f2ed846258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248784eb45194001a489e68a1295b05d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.963844 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:14.975009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9dd26fb3-2370-4b28-970c-66f2ed846258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248784eb45194001a489e68a1295b05d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.992403 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9dd26fb3-2370-4b28-970c-66f2ed846258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248784eb45194001a489e68a1295b05d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.994077 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9dd26fb3-2370-4b28-970c-66f2ed846258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248784eb45194001a489e68a1295b05d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:14.994077 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9dd26fb3-2370-4b28-970c-66f2ed846258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248784eb45194001a489e68a1295b05d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.027943 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:15.029223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1113/2257] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:14 2022] DELETE /identity/v3/users/248784eb45194001a489e68a1295b05d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:15.040480 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:15.132554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:15.138912 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd26fb3-2370-4b28-970c-66f2ed846258 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:15.141892 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9dd26fb3-2370-4b28-970c-66f2ed846258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:15.237936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93490e-630b-4fd8-843b-e96c2e5dd2fc admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:15.278669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd26fb3-2370-4b28-970c-66f2ed846258 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:15.284753 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:15.285925 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:15.286299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:15.286636 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23 admin admin] PATH_INFO: `/v3/projects/d0c0af06493043abadf9e0041b91b2bd` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:15.288057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c0af06493043abadf9e0041b91b2bd)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:15.290375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:15.322103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09755d90-dcbc-4137-9fe0-8100e3622058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:15.323716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09755d90-dcbc-4137-9fe0-8100e3622058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:15.324169 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09755d90-dcbc-4137-9fe0-8100e3622058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:15.324452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09755d90-dcbc-4137-9fe0-8100e3622058 admin admin] PATH_INFO: `/v3/users/71626255d6074a1f90cd7bdc2d33ae52` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:15.326565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09755d90-dcbc-4137-9fe0-8100e3622058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71626255d6074a1f90cd7bdc2d33ae52)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:15.328684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09755d90-dcbc-4137-9fe0-8100e3622058 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:15.352276 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c0af06493043abadf9e0041b91b2bd', 'request_id': 'req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.362307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c0af06493043abadf9e0041b91b2bd', 'request_id': 'req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.371791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c0af06493043abadf9e0041b91b2bd', 'request_id': 'req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.391874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23 admin admin] The token cache is being invalidate because project d0c0af06493043abadf9e0041b91b2bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:15.392275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.393075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.395386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1114/2258] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:15 2022] DELETE /identity/v3/projects/d0c0af06493043abadf9e0041b91b2bd => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:15.399346 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:15.404895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:15.406221 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-09755d90-dcbc-4137-9fe0-8100e3622058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71626255d6074a1f90cd7bdc2d33ae52'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.422607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-09755d90-dcbc-4137-9fe0-8100e3622058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71626255d6074a1f90cd7bdc2d33ae52'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.434051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-09755d90-dcbc-4137-9fe0-8100e3622058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71626255d6074a1f90cd7bdc2d33ae52'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.435414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-09755d90-dcbc-4137-9fe0-8100e3622058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71626255d6074a1f90cd7bdc2d33ae52'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.445107 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-09755d90-dcbc-4137-9fe0-8100e3622058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71626255d6074a1f90cd7bdc2d33ae52'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.452083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1145/2259] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:15 2022] DELETE /identity/v3/users/71626255d6074a1f90cd7bdc2d33ae52 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:07:15.453696 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661d283-366a-48a0-837a-70199ca171ca None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:15.453985 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661d283-366a-48a0-837a-70199ca171ca None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:15.454261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661d283-366a-48a0-837a-70199ca171ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:15.475045 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5661d283-366a-48a0-837a-70199ca171ca None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:15.476289 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5661d283-366a-48a0-837a-70199ca171ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:15.488107 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:15.493626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba76ac8-fb8b-4b77-b6e5-da7b8f108b23 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:15.537064 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:15.568368 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1146/2260] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:15.568368 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba95ef-defc-414d-8df5-b258e318010e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:15.568368 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba95ef-defc-414d-8df5-b258e318010e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:15.568368 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba95ef-defc-414d-8df5-b258e318010e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:15.574161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7f412-bf80-4016-9daa-e7599a18789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:15.575194 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7f412-bf80-4016-9daa-e7599a18789b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:15.575536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7f412-bf80-4016-9daa-e7599a18789b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:15.575865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7f412-bf80-4016-9daa-e7599a18789b admin admin] PATH_INFO: `/v3/users/45549bce936543ab9fcae7036f80a40e` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:15.577181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7f412-bf80-4016-9daa-e7599a18789b admin admin] RBAC: Authorizing `identity:delete_user(user_id=45549bce936543ab9fcae7036f80a40e)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:15.580393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7f412-bf80-4016-9daa-e7599a18789b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:15.592251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-87ba95ef-defc-414d-8df5-b258e318010e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:15.593478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-87ba95ef-defc-414d-8df5-b258e318010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:15.601239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1147/2261] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:15.602151 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba95ef-defc-414d-8df5-b258e318010e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:15.603442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-87ba95ef-defc-414d-8df5-b258e318010e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:15.617473 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba95ef-defc-414d-8df5-b258e318010e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:15.623247 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64391b22-ecd1-4554-9be9-a4d28775f7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:15.624291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64391b22-ecd1-4554-9be9-a4d28775f7c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:15.624577 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64391b22-ecd1-4554-9be9-a4d28775f7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:15.624845 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64391b22-ecd1-4554-9be9-a4d28775f7c7 admin admin] PATH_INFO: `/v3/projects/ef1f48d6efe940be8c7acaf5418819c2` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:15.626072 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64391b22-ecd1-4554-9be9-a4d28775f7c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef1f48d6efe940be8c7acaf5418819c2)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:15.627997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64391b22-ecd1-4554-9be9-a4d28775f7c7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:15.640825 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-37a7f412-bf80-4016-9daa-e7599a18789b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45549bce936543ab9fcae7036f80a40e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.648629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-37a7f412-bf80-4016-9daa-e7599a18789b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45549bce936543ab9fcae7036f80a40e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.657577 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-37a7f412-bf80-4016-9daa-e7599a18789b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45549bce936543ab9fcae7036f80a40e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.658714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-37a7f412-bf80-4016-9daa-e7599a18789b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45549bce936543ab9fcae7036f80a40e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.659712 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-37a7f412-bf80-4016-9daa-e7599a18789b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45549bce936543ab9fcae7036f80a40e'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.681493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1115/2262] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:15 2022] DELETE /identity/v3/users/45549bce936543ab9fcae7036f80a40e => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:15.683229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723877d0-ebb6-433c-8a56-8f19c77708a3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:15.683729 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723877d0-ebb6-433c-8a56-8f19c77708a3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:15.684185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723877d0-ebb6-433c-8a56-8f19c77708a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:15.685984 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-64391b22-ecd1-4554-9be9-a4d28775f7c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef1f48d6efe940be8c7acaf5418819c2', 'request_id': 'req-64391b22-ecd1-4554-9be9-a4d28775f7c7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.694935 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-64391b22-ecd1-4554-9be9-a4d28775f7c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef1f48d6efe940be8c7acaf5418819c2', 'request_id': 'req-64391b22-ecd1-4554-9be9-a4d28775f7c7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.702018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-64391b22-ecd1-4554-9be9-a4d28775f7c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef1f48d6efe940be8c7acaf5418819c2', 'request_id': 'req-64391b22-ecd1-4554-9be9-a4d28775f7c7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.707145 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-723877d0-ebb6-433c-8a56-8f19c77708a3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:15.708396 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-723877d0-ebb6-433c-8a56-8f19c77708a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:15.714181 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-64391b22-ecd1-4554-9be9-a4d28775f7c7 admin admin] The token cache is being invalidate because project ef1f48d6efe940be8c7acaf5418819c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:15.714481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-64391b22-ecd1-4554-9be9-a4d28775f7c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.715197 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-64391b22-ecd1-4554-9be9-a4d28775f7c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:15.716807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1148/2263] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:15 2022] DELETE /identity/v3/projects/ef1f48d6efe940be8c7acaf5418819c2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:15.717796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64391b22-ecd1-4554-9be9-a4d28775f7c7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:15.719173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-64391b22-ecd1-4554-9be9-a4d28775f7c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:15.783068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1116/2264] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:15.783068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147289ea-2314-42a2-82c7-7afad4f31452 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:15.783068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147289ea-2314-42a2-82c7-7afad4f31452 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:15.783068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147289ea-2314-42a2-82c7-7afad4f31452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:15.801870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-147289ea-2314-42a2-82c7-7afad4f31452 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:15.803114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-147289ea-2314-42a2-82c7-7afad4f31452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:15.803246 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64391b22-ecd1-4554-9be9-a4d28775f7c7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:15.812014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1117/2265] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:15.813372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5df7a7-0d6a-4d3f-b0c6-f2cf8b4eae72 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:15.813666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5df7a7-0d6a-4d3f-b0c6-f2cf8b4eae72 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:15.813942 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5df7a7-0d6a-4d3f-b0c6-f2cf8b4eae72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:15.832605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8c5df7a7-0d6a-4d3f-b0c6-f2cf8b4eae72 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:15.833797 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8c5df7a7-0d6a-4d3f-b0c6-f2cf8b4eae72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:15.843575 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1118/2266] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:15.844653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5df7a7-0d6a-4d3f-b0c6-f2cf8b4eae72 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:15.855081 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5df7a7-0d6a-4d3f-b0c6-f2cf8b4eae72 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:15.860004 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c011d53-27ce-4f69-ba8e-123394ebe9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:15.860679 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c011d53-27ce-4f69-ba8e-123394ebe9ac admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:15.860961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c011d53-27ce-4f69-ba8e-123394ebe9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:15.861236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c011d53-27ce-4f69-ba8e-123394ebe9ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:15.861977 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c011d53-27ce-4f69-ba8e-123394ebe9ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:07:15.862476 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c011d53-27ce-4f69-ba8e-123394ebe9ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:15.864269 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c011d53-27ce-4f69-ba8e-123394ebe9ac admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:15.867109 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:15.873752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07e765-f322-47b0-a92c-eb7179bac7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:15.874113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e765-f322-47b0-a92c-eb7179bac7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:15.874310 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e765-f322-47b0-a92c-eb7179bac7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:15.874584 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e765-f322-47b0-a92c-eb7179bac7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:15.877401 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4b07e765-f322-47b0-a92c-eb7179bac7c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:15.882060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1119/2267] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:07:15.882060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c011d53-27ce-4f69-ba8e-123394ebe9ac admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:15.896565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c011d53-27ce-4f69-ba8e-123394ebe9ac admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:15.900345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637fdb9-eca8-46a4-b793-de6730f215a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:15.901023 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637fdb9-eca8-46a4-b793-de6730f215a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:15.901309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637fdb9-eca8-46a4-b793-de6730f215a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:15.901576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f637fdb9-eca8-46a4-b793-de6730f215a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:15.904220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07e765-f322-47b0-a92c-eb7179bac7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:15.905938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07e765-f322-47b0-a92c-eb7179bac7c8 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:15.911984 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637fdb9-eca8-46a4-b793-de6730f215a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:15.913481 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f637fdb9-eca8-46a4-b793-de6730f215a1 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:15.918548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1149/2268] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:15.920329 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79983217-34db-4105-b201-92aebcd7c9ff None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:15.920623 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79983217-34db-4105-b201-92aebcd7c9ff None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:15.920902 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79983217-34db-4105-b201-92aebcd7c9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:15.925129 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1120/2269] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:15.925997 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637fdb9-eca8-46a4-b793-de6730f215a1 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:15.936180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f637fdb9-eca8-46a4-b793-de6730f215a1 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:15.941626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17e32d-bdcb-4c23-be48-aead965c5a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:15.942309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17e32d-bdcb-4c23-be48-aead965c5a3b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:15.942496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-79983217-34db-4105-b201-92aebcd7c9ff None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:15.943296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17e32d-bdcb-4c23-be48-aead965c5a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:15.943570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a17e32d-bdcb-4c23-be48-aead965c5a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:15.943777 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-79983217-34db-4105-b201-92aebcd7c9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:15.944464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17e32d-bdcb-4c23-be48-aead965c5a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:15.946483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a17e32d-bdcb-4c23-be48-aead965c5a3b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:15.953327 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1150/2270] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:15.957875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79983217-34db-4105-b201-92aebcd7c9ff None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:15.970639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79983217-34db-4105-b201-92aebcd7c9ff None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:15.976877 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54549594-dc74-462f-988e-ae96ed052dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:15.977569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54549594-dc74-462f-988e-ae96ed052dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:15.978017 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54549594-dc74-462f-988e-ae96ed052dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:15.978121 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54549594-dc74-462f-988e-ae96ed052dd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:15.978989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54549594-dc74-462f-988e-ae96ed052dd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:07:15.979333 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54549594-dc74-462f-988e-ae96ed052dd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:15.981182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54549594-dc74-462f-988e-ae96ed052dd3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:15.983040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1121/2271] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:15 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:15.987040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17e32d-bdcb-4c23-be48-aead965c5a3b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:15.994865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1151/2272] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 16:07:15.999743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54549594-dc74-462f-988e-ae96ed052dd3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:16.006743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:16.014909 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54549594-dc74-462f-988e-ae96ed052dd3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:16.062949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a17e32d-bdcb-4c23-be48-aead965c5a3b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:16.068362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdddfd2-f37f-4a4c-a9ca-0716d577774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:16.069257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdddfd2-f37f-4a4c-a9ca-0716d577774b admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:16.069427 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdddfd2-f37f-4a4c-a9ca-0716d577774b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:16.069778 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdddfd2-f37f-4a4c-a9ca-0716d577774b admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:16.070510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdddfd2-f37f-4a4c-a9ca-0716d577774b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:16.072609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdddfd2-f37f-4a4c-a9ca-0716d577774b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:16.086101 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d61d26-b514-41bd-b294-fa574333cc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:16.086673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61d26-b514-41bd-b294-fa574333cc34 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:16.086988 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61d26-b514-41bd-b294-fa574333cc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:16.087278 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d61d26-b514-41bd-b294-fa574333cc34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:16.087974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d61d26-b514-41bd-b294-fa574333cc34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:16.089957 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d61d26-b514-41bd-b294-fa574333cc34 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:16.096124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1122/2273] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:15 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:07:16.100044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdddfd2-f37f-4a4c-a9ca-0716d577774b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:16.114145 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdddfd2-f37f-4a4c-a9ca-0716d577774b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:16.121287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b876da9-5d68-4a1c-b82f-a4d72acf98f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:16.122267 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b876da9-5d68-4a1c-b82f-a4d72acf98f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:16.122620 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b876da9-5d68-4a1c-b82f-a4d72acf98f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:16.123551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b876da9-5d68-4a1c-b82f-a4d72acf98f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:16.124296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b876da9-5d68-4a1c-b82f-a4d72acf98f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:16.126421 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1152/2274] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:15 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:16.126551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b876da9-5d68-4a1c-b82f-a4d72acf98f4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:16.131563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d61d26-b514-41bd-b294-fa574333cc34 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:16.145060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1123/2275] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:07:16.146936 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b876da9-5d68-4a1c-b82f-a4d72acf98f4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:16.159692 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b876da9-5d68-4a1c-b82f-a4d72acf98f4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:16.213253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d61d26-b514-41bd-b294-fa574333cc34 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:16.236970 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8611925-7298-4ddd-a8d2-0e47b9d1c4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:16.237754 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8611925-7298-4ddd-a8d2-0e47b9d1c4ed admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:16.238036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8611925-7298-4ddd-a8d2-0e47b9d1c4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:16.238316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8611925-7298-4ddd-a8d2-0e47b9d1c4ed admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:16.239072 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8611925-7298-4ddd-a8d2-0e47b9d1c4ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:16.241031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8611925-7298-4ddd-a8d2-0e47b9d1c4ed admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:16.267823 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884798c1-da6b-472a-8d1b-b55ab2c3a5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:16.269153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884798c1-da6b-472a-8d1b-b55ab2c3a5ae admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:16.269582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884798c1-da6b-472a-8d1b-b55ab2c3a5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:16.270018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884798c1-da6b-472a-8d1b-b55ab2c3a5ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:16.270808 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884798c1-da6b-472a-8d1b-b55ab2c3a5ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:16.272969 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884798c1-da6b-472a-8d1b-b55ab2c3a5ae admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:16.291369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1124/2276] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:07:16.295089 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884798c1-da6b-472a-8d1b-b55ab2c3a5ae admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:16.301612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1153/2277] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:16 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:16.303178 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8611925-7298-4ddd-a8d2-0e47b9d1c4ed admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:16.319443 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884798c1-da6b-472a-8d1b-b55ab2c3a5ae admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:16.322077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8611925-7298-4ddd-a8d2-0e47b9d1c4ed admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:16.328224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bf2fc-92be-4979-a2f9-884eaa881219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:16.328928 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bf2fc-92be-4979-a2f9-884eaa881219 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:16.329236 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bf2fc-92be-4979-a2f9-884eaa881219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:16.329497 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0bf2fc-92be-4979-a2f9-884eaa881219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:16.330257 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bf2fc-92be-4979-a2f9-884eaa881219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:16.332078 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0bf2fc-92be-4979-a2f9-884eaa881219 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:16.338639 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1639b57e-af52-4214-9826-4f8b971e92d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:16.339602 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639b57e-af52-4214-9826-4f8b971e92d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:16.339885 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639b57e-af52-4214-9826-4f8b971e92d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:16.340166 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1639b57e-af52-4214-9826-4f8b971e92d5 admin admin] PATH_INFO: `/v3/projects/1cc8804dd938449fbdad3c2aa82119b5/users/fba545846e59469c8f80fa345dd36f78/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:16.364165 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639b57e-af52-4214-9826-4f8b971e92d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc8804dd938449fbdad3c2aa82119b5, user_id=fba545846e59469c8f80fa345dd36f78, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:16.367091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1639b57e-af52-4214-9826-4f8b971e92d5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:16.379358 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1154/2278] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:16.383398 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bf2fc-92be-4979-a2f9-884eaa881219 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:16.396774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1125/2279] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:16 2022] PUT /identity/v3/projects/1cc8804dd938449fbdad3c2aa82119b5/users/fba545846e59469c8f80fa345dd36f78/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:16.399992 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b47a22-1550-4103-90e0-5fb44ad09135 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:16.400381 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b47a22-1550-4103-90e0-5fb44ad09135 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:16.402457 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b47a22-1550-4103-90e0-5fb44ad09135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:16.403428 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0bf2fc-92be-4979-a2f9-884eaa881219 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:16.466591 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:16.472187 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d0b47a22-1550-4103-90e0-5fb44ad09135 None None] MFA Rules not processed for user `fba545846e59469c8f80fa345dd36f78`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:16.475022 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d0b47a22-1550-4103-90e0-5fb44ad09135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:16.529794 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd919bf-18f7-4fc8-94fa-1003281fab48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:16.530685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd919bf-18f7-4fc8-94fa-1003281fab48 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:16.530999 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd919bf-18f7-4fc8-94fa-1003281fab48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:16.531276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd919bf-18f7-4fc8-94fa-1003281fab48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:16.532021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd919bf-18f7-4fc8-94fa-1003281fab48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:16.534235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd919bf-18f7-4fc8-94fa-1003281fab48 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:16.551369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1155/2280] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:07:16.555386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd919bf-18f7-4fc8-94fa-1003281fab48 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:16.557316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fcd919bf-18f7-4fc8-94fa-1003281fab48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:16.575823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:16.583386 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd919bf-18f7-4fc8-94fa-1003281fab48 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:16.591949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faf463-4f79-4f87-83f0-d0a1be10fba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:16.593573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faf463-4f79-4f87-83f0-d0a1be10fba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:16.594083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faf463-4f79-4f87-83f0-d0a1be10fba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:16.595132 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03faf463-4f79-4f87-83f0-d0a1be10fba2 admin admin] PATH_INFO: `/v3/projects/fe6fc9d0da8f4150bdf39c770b6f1c5a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:16.597885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03faf463-4f79-4f87-83f0-d0a1be10fba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe6fc9d0da8f4150bdf39c770b6f1c5a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:16.600593 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03faf463-4f79-4f87-83f0-d0a1be10fba2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:16.630950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1126/2281] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:16.630950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b47a22-1550-4103-90e0-5fb44ad09135 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:16.630950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d0b47a22-1550-4103-90e0-5fb44ad09135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:16.654272 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b47a22-1550-4103-90e0-5fb44ad09135 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:16.679973 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-03faf463-4f79-4f87-83f0-d0a1be10fba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe6fc9d0da8f4150bdf39c770b6f1c5a', 'request_id': 'req-03faf463-4f79-4f87-83f0-d0a1be10fba2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:16.691998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-03faf463-4f79-4f87-83f0-d0a1be10fba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe6fc9d0da8f4150bdf39c770b6f1c5a', 'request_id': 'req-03faf463-4f79-4f87-83f0-d0a1be10fba2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:16.703132 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-03faf463-4f79-4f87-83f0-d0a1be10fba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe6fc9d0da8f4150bdf39c770b6f1c5a', 'request_id': 'req-03faf463-4f79-4f87-83f0-d0a1be10fba2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:16.716119 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-03faf463-4f79-4f87-83f0-d0a1be10fba2 admin admin] The token cache is being invalidate because project fe6fc9d0da8f4150bdf39c770b6f1c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:16.716375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-03faf463-4f79-4f87-83f0-d0a1be10fba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:16.717111 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-03faf463-4f79-4f87-83f0-d0a1be10fba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:16.718855 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1156/2282] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:16 2022] DELETE /identity/v3/projects/fe6fc9d0da8f4150bdf39c770b6f1c5a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:16.719681 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faf463-4f79-4f87-83f0-d0a1be10fba2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:16.721169 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-03faf463-4f79-4f87-83f0-d0a1be10fba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:16.759636 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eabe26-444a-4c36-89d7-cdd070eb2a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:16.760900 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eabe26-444a-4c36-89d7-cdd070eb2a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:16.761338 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eabe26-444a-4c36-89d7-cdd070eb2a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:16.761762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eabe26-444a-4c36-89d7-cdd070eb2a3b admin admin] PATH_INFO: `/v3/projects/eb11643024c04e9893bd32349627ac27` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:16.763289 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eabe26-444a-4c36-89d7-cdd070eb2a3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb11643024c04e9893bd32349627ac27)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:16.766058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eabe26-444a-4c36-89d7-cdd070eb2a3b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:16.801066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03faf463-4f79-4f87-83f0-d0a1be10fba2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:16.807505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5dd8e-c4f8-4ba9-87fe-875562fb8e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:16.808803 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5dd8e-c4f8-4ba9-87fe-875562fb8e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:16.809298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5dd8e-c4f8-4ba9-87fe-875562fb8e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:16.809609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5dd8e-c4f8-4ba9-87fe-875562fb8e04 admin admin] PATH_INFO: `/v3/projects/d83db8a3b28a4763a6b57e2e7665cbd5/users/eed5cc638a544edcbbf0c3c3c4f1ecda/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:16.833694 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5dd8e-c4f8-4ba9-87fe-875562fb8e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83db8a3b28a4763a6b57e2e7665cbd5, user_id=eed5cc638a544edcbbf0c3c3c4f1ecda, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:16.834024 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43eabe26-444a-4c36-89d7-cdd070eb2a3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb11643024c04e9893bd32349627ac27', 'request_id': 'req-43eabe26-444a-4c36-89d7-cdd070eb2a3b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:16.838847 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5dd8e-c4f8-4ba9-87fe-875562fb8e04 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:16.844027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43eabe26-444a-4c36-89d7-cdd070eb2a3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb11643024c04e9893bd32349627ac27', 'request_id': 'req-43eabe26-444a-4c36-89d7-cdd070eb2a3b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:16.854291 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43eabe26-444a-4c36-89d7-cdd070eb2a3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb11643024c04e9893bd32349627ac27', 'request_id': 'req-43eabe26-444a-4c36-89d7-cdd070eb2a3b'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:16.859382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1157/2283] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:16 2022] PUT /identity/v3/projects/d83db8a3b28a4763a6b57e2e7665cbd5/users/eed5cc638a544edcbbf0c3c3c4f1ecda/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:16.860295 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5dd8e-c4f8-4ba9-87fe-875562fb8e04 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:16.862071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-96c5dd8e-c4f8-4ba9-87fe-875562fb8e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:16.884687 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43eabe26-444a-4c36-89d7-cdd070eb2a3b admin admin] The token cache is being invalidate because project eb11643024c04e9893bd32349627ac27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:16.885009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43eabe26-444a-4c36-89d7-cdd070eb2a3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:16.887481 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-43eabe26-444a-4c36-89d7-cdd070eb2a3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:16.890563 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1127/2284] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:16 2022] DELETE /identity/v3/projects/eb11643024c04e9893bd32349627ac27 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:16.891669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef96457-e51d-4d25-98e8-08157d6e78e6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:16.891956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef96457-e51d-4d25-98e8-08157d6e78e6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:16.892229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef96457-e51d-4d25-98e8-08157d6e78e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:16.918378 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2ef96457-e51d-4d25-98e8-08157d6e78e6 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:16.919868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2ef96457-e51d-4d25-98e8-08157d6e78e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:16.952439 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:17.002920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5dd8e-c4f8-4ba9-87fe-875562fb8e04 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:17.008820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1128/2285] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:17.010556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4aa1b-98b1-45d3-9455-7a8fe85cfdf5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:17.010875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4aa1b-98b1-45d3-9455-7a8fe85cfdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:17.011159 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4aa1b-98b1-45d3-9455-7a8fe85cfdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:17.017568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ee23c-8bc3-49e3-a6a4-9493614747da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:17.018188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ee23c-8bc3-49e3-a6a4-9493614747da admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:17.018544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ee23c-8bc3-49e3-a6a4-9493614747da admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:17.019012 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ee23c-8bc3-49e3-a6a4-9493614747da admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:17.019806 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ee23c-8bc3-49e3-a6a4-9493614747da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:17.021815 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ee23c-8bc3-49e3-a6a4-9493614747da admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:17.040105 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:17.050700 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-65e4aa1b-98b1-45d3-9455-7a8fe85cfdf5 None None] MFA Rules not processed for user `eed5cc638a544edcbbf0c3c3c4f1ecda`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:17.059705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1158/2286] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:16 2022] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:17.059923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-65e4aa1b-98b1-45d3-9455-7a8fe85cfdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:17.060019 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ee23c-8bc3-49e3-a6a4-9493614747da admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:17.060782 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-870ee23c-8bc3-49e3-a6a4-9493614747da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:17.137455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ee23c-8bc3-49e3-a6a4-9493614747da admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:17.138313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1129/2287] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:17.139749 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a0a95-b95e-4477-bf5f-098397672b29 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:17.140045 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a0a95-b95e-4477-bf5f-098397672b29 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:17.140321 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a0a95-b95e-4477-bf5f-098397672b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:17.146462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cba222-09c5-45cd-90de-e79ea856403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:17.147403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cba222-09c5-45cd-90de-e79ea856403f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:17.147695 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cba222-09c5-45cd-90de-e79ea856403f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:17.147969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cba222-09c5-45cd-90de-e79ea856403f admin admin] PATH_INFO: `/v3/users/f70eabb6cc8543a691919cdccf023a0a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:17.149235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cba222-09c5-45cd-90de-e79ea856403f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70eabb6cc8543a691919cdccf023a0a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:17.151408 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cba222-09c5-45cd-90de-e79ea856403f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:17.163564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-945a0a95-b95e-4477-bf5f-098397672b29 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:17.164798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-945a0a95-b95e-4477-bf5f-098397672b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:17.180057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1130/2288] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:17.181102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a0a95-b95e-4477-bf5f-098397672b29 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:17.184610 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-945a0a95-b95e-4477-bf5f-098397672b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:17.206124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a0a95-b95e-4477-bf5f-098397672b29 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:17.211071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b165e-17b6-4272-931b-1b6ef06eef51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:17.211665 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b165e-17b6-4272-931b-1b6ef06eef51 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:17.212034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b165e-17b6-4272-931b-1b6ef06eef51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:17.212246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b165e-17b6-4272-931b-1b6ef06eef51 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:17.213040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b165e-17b6-4272-931b-1b6ef06eef51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:17.215066 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b165e-17b6-4272-931b-1b6ef06eef51 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:17.217519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f3cba222-09c5-45cd-90de-e79ea856403f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70eabb6cc8543a691919cdccf023a0a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:17.234535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f3cba222-09c5-45cd-90de-e79ea856403f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70eabb6cc8543a691919cdccf023a0a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:17.242849 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1131/2289] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:17 2022] POST /identity/v3/users => generated 300 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:17.242849 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b165e-17b6-4272-931b-1b6ef06eef51 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:17.243656 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6c9b165e-17b6-4272-931b-1b6ef06eef51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:17.245243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f3cba222-09c5-45cd-90de-e79ea856403f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70eabb6cc8543a691919cdccf023a0a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:17.246265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f3cba222-09c5-45cd-90de-e79ea856403f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70eabb6cc8543a691919cdccf023a0a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:17.254108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f3cba222-09c5-45cd-90de-e79ea856403f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70eabb6cc8543a691919cdccf023a0a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:17.260462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1159/2290] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:17 2022] DELETE /identity/v3/users/f70eabb6cc8543a691919cdccf023a0a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:17.261478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cba222-09c5-45cd-90de-e79ea856403f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:17.262939 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f3cba222-09c5-45cd-90de-e79ea856403f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:17.349893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b165e-17b6-4272-931b-1b6ef06eef51 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:17.370780 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cba222-09c5-45cd-90de-e79ea856403f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:17.377514 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde4c7a-b9cb-4a0a-af5d-13689a601f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:17.378461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde4c7a-b9cb-4a0a-af5d-13689a601f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:17.378768 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde4c7a-b9cb-4a0a-af5d-13689a601f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:17.379064 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde4c7a-b9cb-4a0a-af5d-13689a601f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:17.379812 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde4c7a-b9cb-4a0a-af5d-13689a601f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:07:17.380179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde4c7a-b9cb-4a0a-af5d-13689a601f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:17.381886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde4c7a-b9cb-4a0a-af5d-13689a601f07 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:17.392297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:17.403009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1160/2291] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:07:17.404002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde4c7a-b9cb-4a0a-af5d-13689a601f07 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:17.407625 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0cde4c7a-b9cb-4a0a-af5d-13689a601f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:17.419920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba453b-f06a-40ca-b7b0-b97c5cf0bf6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3418c0b46c404c8ca445cce9db632d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:17.420876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba453b-f06a-40ca-b7b0-b97c5cf0bf6f service glance] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:17.421061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba453b-f06a-40ca-b7b0-b97c5cf0bf6f service glance] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:17.421767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba453b-f06a-40ca-b7b0-b97c5cf0bf6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:17.424301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-15ba453b-f06a-40ca-b7b0-b97c5cf0bf6f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:17.426119 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde4c7a-b9cb-4a0a-af5d-13689a601f07 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:17.434238 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0368cb2-1cd8-4a94-ab65-c4a9b4a7bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:17.435470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0368cb2-1cd8-4a94-ab65-c4a9b4a7bc89 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:17.436020 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0368cb2-1cd8-4a94-ab65-c4a9b4a7bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:17.436460 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0368cb2-1cd8-4a94-ab65-c4a9b4a7bc89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:17.437399 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0368cb2-1cd8-4a94-ab65-c4a9b4a7bc89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:17.439600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0368cb2-1cd8-4a94-ab65-c4a9b4a7bc89 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:17.441252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:17.469465 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1161/2292] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:17.470524 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0368cb2-1cd8-4a94-ab65-c4a9b4a7bc89 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:17.482865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0368cb2-1cd8-4a94-ab65-c4a9b4a7bc89 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:17.487737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fefb7-c646-40d7-958b-29e0f316b048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:17.488414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fefb7-c646-40d7-958b-29e0f316b048 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:17.488702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fefb7-c646-40d7-958b-29e0f316b048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:17.488980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200fefb7-c646-40d7-958b-29e0f316b048 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:17.489823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fefb7-c646-40d7-958b-29e0f316b048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:17.491791 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200fefb7-c646-40d7-958b-29e0f316b048 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:17.503436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba453b-f06a-40ca-b7b0-b97c5cf0bf6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:17.505235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba453b-f06a-40ca-b7b0-b97c5cf0bf6f service glance] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:17.515638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1132/2293] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:17.516643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba453b-f06a-40ca-b7b0-b97c5cf0bf6f service glance] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:17.528723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba453b-f06a-40ca-b7b0-b97c5cf0bf6f service glance] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:17.529600 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1162/2294] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:17 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:17.533455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fefb7-c646-40d7-958b-29e0f316b048 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:17.598840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c508223-c3c2-44da-8a8c-cd25036febe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:17.599867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c508223-c3c2-44da-8a8c-cd25036febe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:17.600489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c508223-c3c2-44da-8a8c-cd25036febe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:17.600489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c508223-c3c2-44da-8a8c-cd25036febe1 admin admin] PATH_INFO: `/v3/projects/26f07f00770146d49bd50e1c98496393/users/a5e68e38d6ec421194d74fdc88c36e13/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:17.617380 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c508223-c3c2-44da-8a8c-cd25036febe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f07f00770146d49bd50e1c98496393, user_id=a5e68e38d6ec421194d74fdc88c36e13, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:17.620399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c508223-c3c2-44da-8a8c-cd25036febe1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:17.644150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1133/2295] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:17 2022] PUT /identity/v3/projects/26f07f00770146d49bd50e1c98496393/users/a5e68e38d6ec421194d74fdc88c36e13/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:17.648681 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c508223-c3c2-44da-8a8c-cd25036febe1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:17.652639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200fefb7-c646-40d7-958b-29e0f316b048 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:17.723592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c508223-c3c2-44da-8a8c-cd25036febe1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:17.729675 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87846-2a30-46af-bd8d-08aeefdde105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:17.730954 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87846-2a30-46af-bd8d-08aeefdde105 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:17.731293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87846-2a30-46af-bd8d-08aeefdde105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:17.731708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87846-2a30-46af-bd8d-08aeefdde105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:17.732762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb87846-2a30-46af-bd8d-08aeefdde105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:17.734656 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb87846-2a30-46af-bd8d-08aeefdde105 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:17.762543 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1134/2296] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:17.763645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87846-2a30-46af-bd8d-08aeefdde105 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:17.781748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87846-2a30-46af-bd8d-08aeefdde105 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:17.787672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899cfd8-e79e-48f0-af00-8f74019feaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:17.788756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899cfd8-e79e-48f0-af00-8f74019feaec admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:17.789232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899cfd8-e79e-48f0-af00-8f74019feaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:17.789597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899cfd8-e79e-48f0-af00-8f74019feaec admin admin] PATH_INFO: `/v3/projects/26f07f00770146d49bd50e1c98496393/users/a5e68e38d6ec421194d74fdc88c36e13/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:17.792307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899cfd8-e79e-48f0-af00-8f74019feaec admin admin] RBAC: Authorizing `identity:create_grant(project_id=26f07f00770146d49bd50e1c98496393, user_id=a5e68e38d6ec421194d74fdc88c36e13, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:17.797368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899cfd8-e79e-48f0-af00-8f74019feaec admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:17.800795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:17.815257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1135/2297] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:17 2022] PUT /identity/v3/projects/26f07f00770146d49bd50e1c98496393/users/a5e68e38d6ec421194d74fdc88c36e13/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:17.826462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ea3ac-950e-479b-b7cb-0c8701357fc8 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:17.826869 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ea3ac-950e-479b-b7cb-0c8701357fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:17.828641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ea3ac-950e-479b-b7cb-0c8701357fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:17.835005 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae98d9-70b7-4c5a-b1fe-b4af7644d832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:17.837031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae98d9-70b7-4c5a-b1fe-b4af7644d832 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:17.837382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae98d9-70b7-4c5a-b1fe-b4af7644d832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:17.837663 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae98d9-70b7-4c5a-b1fe-b4af7644d832 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:17.840255 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae98d9-70b7-4c5a-b1fe-b4af7644d832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:17.844431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae98d9-70b7-4c5a-b1fe-b4af7644d832 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:17.865351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-d99ea3ac-950e-479b-b7cb-0c8701357fc8 None None] MFA Rules not processed for user `a5e68e38d6ec421194d74fdc88c36e13`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:17.867086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d99ea3ac-950e-479b-b7cb-0c8701357fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:17.876288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1163/2298] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:17 2022] POST /identity/v3/users => generated 292 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:17.883085 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae98d9-70b7-4c5a-b1fe-b4af7644d832 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:17.897944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae98d9-70b7-4c5a-b1fe-b4af7644d832 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:17.988458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1136/2299] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:17.989863 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ea3ac-950e-479b-b7cb-0c8701357fc8 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:17.991846 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d99ea3ac-950e-479b-b7cb-0c8701357fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:18.002428 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c14b7-6191-4dcd-981f-8d72914205c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:18.003201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c14b7-6191-4dcd-981f-8d72914205c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:18.003517 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c14b7-6191-4dcd-981f-8d72914205c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:18.003794 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c14b7-6191-4dcd-981f-8d72914205c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:18.004543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c14b7-6191-4dcd-981f-8d72914205c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:18.006170 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c14b7-6191-4dcd-981f-8d72914205c1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:18.021404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1164/2300] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:18.021404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c14b7-6191-4dcd-981f-8d72914205c1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:18.021404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fb2c14b7-6191-4dcd-981f-8d72914205c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:18.031666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:18.079380 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ea3ac-950e-479b-b7cb-0c8701357fc8 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:18.091514 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18975515-dcc6-42dd-99ed-a1132bb3c436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:18.092421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18975515-dcc6-42dd-99ed-a1132bb3c436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:18.092691 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18975515-dcc6-42dd-99ed-a1132bb3c436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:18.092965 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18975515-dcc6-42dd-99ed-a1132bb3c436 admin admin] PATH_INFO: `/v3/projects/6a1c382e5a6a4f75bd44190416d186d6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:18.095232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18975515-dcc6-42dd-99ed-a1132bb3c436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1c382e5a6a4f75bd44190416d186d6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:18.097758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18975515-dcc6-42dd-99ed-a1132bb3c436 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:18.103959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c14b7-6191-4dcd-981f-8d72914205c1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:18.111823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba12d0-f43c-4339-b8e2-be9c564f5be1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:18.112492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba12d0-f43c-4339-b8e2-be9c564f5be1 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:18.112824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba12d0-f43c-4339-b8e2-be9c564f5be1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:18.113101 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba12d0-f43c-4339-b8e2-be9c564f5be1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:18.125372 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba12d0-f43c-4339-b8e2-be9c564f5be1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:18.127203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ba12d0-f43c-4339-b8e2-be9c564f5be1 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:18.140077 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1165/2301] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:07:18.141420 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba12d0-f43c-4339-b8e2-be9c564f5be1 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:18.155665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba12d0-f43c-4339-b8e2-be9c564f5be1 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:18.162009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18975515-dcc6-42dd-99ed-a1132bb3c436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1c382e5a6a4f75bd44190416d186d6', 'request_id': 'req-18975515-dcc6-42dd-99ed-a1132bb3c436'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:18.179138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18975515-dcc6-42dd-99ed-a1132bb3c436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1c382e5a6a4f75bd44190416d186d6', 'request_id': 'req-18975515-dcc6-42dd-99ed-a1132bb3c436'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:18.184203 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18975515-dcc6-42dd-99ed-a1132bb3c436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1c382e5a6a4f75bd44190416d186d6', 'request_id': 'req-18975515-dcc6-42dd-99ed-a1132bb3c436'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:18.229779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18975515-dcc6-42dd-99ed-a1132bb3c436 admin admin] The token cache is being invalidate because project 6a1c382e5a6a4f75bd44190416d186d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:18.230075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18975515-dcc6-42dd-99ed-a1132bb3c436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:18.231552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-18975515-dcc6-42dd-99ed-a1132bb3c436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:18.236832 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1137/2302] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:17 2022] DELETE /identity/v3/projects/6a1c382e5a6a4f75bd44190416d186d6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:18.236832 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18975515-dcc6-42dd-99ed-a1132bb3c436 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:18.238432 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-18975515-dcc6-42dd-99ed-a1132bb3c436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:18.252361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:18.316641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2932f-33e6-409c-a51e-81b13b929419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:18.318071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2932f-33e6-409c-a51e-81b13b929419 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:18.318625 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2932f-33e6-409c-a51e-81b13b929419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:18.319183 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2932f-33e6-409c-a51e-81b13b929419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:18.320453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2932f-33e6-409c-a51e-81b13b929419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:18.323270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b2932f-33e6-409c-a51e-81b13b929419 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:18.338502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1166/2303] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:18 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:18.339637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2932f-33e6-409c-a51e-81b13b929419 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:18.341467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-19b2932f-33e6-409c-a51e-81b13b929419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:18.345223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18975515-dcc6-42dd-99ed-a1132bb3c436 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:18.359794 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b2932f-33e6-409c-a51e-81b13b929419 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:18.366287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86d48d-5226-48ba-afb3-7bf6c6fc52bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:18.367117 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9dea9-5180-4f86-b8ed-5657f6c0d30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:18.376336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86d48d-5226-48ba-afb3-7bf6c6fc52bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:18.376459 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9dea9-5180-4f86-b8ed-5657f6c0d30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:18.376538 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86d48d-5226-48ba-afb3-7bf6c6fc52bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:18.376607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9dea9-5180-4f86-b8ed-5657f6c0d30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:18.376676 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86d48d-5226-48ba-afb3-7bf6c6fc52bc admin admin] PATH_INFO: `/v3/users/fba545846e59469c8f80fa345dd36f78` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:18.376833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9dea9-5180-4f86-b8ed-5657f6c0d30a admin admin] PATH_INFO: `/v3/users/222294b084b344858f9ff6fa014e871a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:18.376833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9dea9-5180-4f86-b8ed-5657f6c0d30a admin admin] RBAC: Authorizing `identity:delete_user(user_id=222294b084b344858f9ff6fa014e871a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:18.376833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9dea9-5180-4f86-b8ed-5657f6c0d30a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:18.378705 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86d48d-5226-48ba-afb3-7bf6c6fc52bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba545846e59469c8f80fa345dd36f78)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:18.380788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86d48d-5226-48ba-afb3-7bf6c6fc52bc admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:18.465796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-81c9dea9-5180-4f86-b8ed-5657f6c0d30a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222294b084b344858f9ff6fa014e871a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:18.471623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0e86d48d-5226-48ba-afb3-7bf6c6fc52bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba545846e59469c8f80fa345dd36f78'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:18.479252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-81c9dea9-5180-4f86-b8ed-5657f6c0d30a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222294b084b344858f9ff6fa014e871a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:18.480635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0e86d48d-5226-48ba-afb3-7bf6c6fc52bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba545846e59469c8f80fa345dd36f78'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:18.488441 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-81c9dea9-5180-4f86-b8ed-5657f6c0d30a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222294b084b344858f9ff6fa014e871a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:18.489066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-81c9dea9-5180-4f86-b8ed-5657f6c0d30a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222294b084b344858f9ff6fa014e871a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:18.491360 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0e86d48d-5226-48ba-afb3-7bf6c6fc52bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba545846e59469c8f80fa345dd36f78'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:18.491992 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0e86d48d-5226-48ba-afb3-7bf6c6fc52bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba545846e59469c8f80fa345dd36f78'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:18.492607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0e86d48d-5226-48ba-afb3-7bf6c6fc52bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba545846e59469c8f80fa345dd36f78'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:18.498297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-81c9dea9-5180-4f86-b8ed-5657f6c0d30a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222294b084b344858f9ff6fa014e871a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:18.505142 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1167/2304] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:18 2022] DELETE /identity/v3/users/222294b084b344858f9ff6fa014e871a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:18.505946 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9dea9-5180-4f86-b8ed-5657f6c0d30a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:18.507345 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-81c9dea9-5180-4f86-b8ed-5657f6c0d30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:18.513469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1138/2305] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:18 2022] DELETE /identity/v3/users/fba545846e59469c8f80fa345dd36f78 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:18.517672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bb3c4-d6a8-4d43-a6c9-f1048b6a7ebe None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:18.517962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bb3c4-d6a8-4d43-a6c9-f1048b6a7ebe None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:18.518240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6bb3c4-d6a8-4d43-a6c9-f1048b6a7ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:18.533237 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:18.536765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9c6bb3c4-d6a8-4d43-a6c9-f1048b6a7ebe None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:18.538305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9c6bb3c4-d6a8-4d43-a6c9-f1048b6a7ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:18.593016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9dea9-5180-4f86-b8ed-5657f6c0d30a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:18.612448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1139/2306] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:07:18.624265 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bb3c4-d6a8-4d43-a6c9-f1048b6a7ebe None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:18.626029 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9c6bb3c4-d6a8-4d43-a6c9-f1048b6a7ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:18.665071 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:18.669574 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87402177-eaf9-49bd-a20c-d12f1c471105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:18.670708 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87402177-eaf9-49bd-a20c-d12f1c471105 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:18.671793 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87402177-eaf9-49bd-a20c-d12f1c471105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:18.672281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87402177-eaf9-49bd-a20c-d12f1c471105 admin admin] PATH_INFO: `/v3/projects/74b182011cbe4f8498ccd5d8d454b6ae/users/288442cf94b84c56ad28957275fa7d7b/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:18.704189 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87402177-eaf9-49bd-a20c-d12f1c471105 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b182011cbe4f8498ccd5d8d454b6ae, user_id=288442cf94b84c56ad28957275fa7d7b, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:18.708449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87402177-eaf9-49bd-a20c-d12f1c471105 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:18.714533 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6bb3c4-d6a8-4d43-a6c9-f1048b6a7ebe None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:18.719900 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38af71-4adf-4616-800d-af522c08d997 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:18.720721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38af71-4adf-4616-800d-af522c08d997 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:18.721127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38af71-4adf-4616-800d-af522c08d997 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:18.721490 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38af71-4adf-4616-800d-af522c08d997 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:18.733477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1168/2307] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:18 2022] PUT /identity/v3/projects/74b182011cbe4f8498ccd5d8d454b6ae/users/288442cf94b84c56ad28957275fa7d7b/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:18.735912 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef2095-d7ac-48b1-8ba1-236ab0ca9dcc None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:18.736226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef2095-d7ac-48b1-8ba1-236ab0ca9dcc None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:18.736532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef2095-d7ac-48b1-8ba1-236ab0ca9dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:18.742118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38af71-4adf-4616-800d-af522c08d997 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:18.744525 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38af71-4adf-4616-800d-af522c08d997 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:18.760061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1140/2308] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:18.761453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-38ef2095-d7ac-48b1-8ba1-236ab0ca9dcc None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:18.762847 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-38ef2095-d7ac-48b1-8ba1-236ab0ca9dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:18.827768 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1169/2309] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:18.838964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38af71-4adf-4616-800d-af522c08d997 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:18.840460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7b38af71-4adf-4616-800d-af522c08d997 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:18.855961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38af71-4adf-4616-800d-af522c08d997 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:18.904707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef2095-d7ac-48b1-8ba1-236ab0ca9dcc None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:18.906343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-38ef2095-d7ac-48b1-8ba1-236ab0ca9dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:18.936443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef2095-d7ac-48b1-8ba1-236ab0ca9dcc None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:18.951208 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2432a-735e-46de-96a7-a7fc810b3c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:18.952464 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2432a-735e-46de-96a7-a7fc810b3c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:18.952875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2432a-735e-46de-96a7-a7fc810b3c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:18.953069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2432a-735e-46de-96a7-a7fc810b3c7a admin admin] PATH_INFO: `/v3/projects/3e0d3fda256d427689b405954efb9766` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:18.954775 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2432a-735e-46de-96a7-a7fc810b3c7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0d3fda256d427689b405954efb9766)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:18.957005 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2432a-735e-46de-96a7-a7fc810b3c7a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:19.013512 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540ff7d7-73ac-49de-ac75-7ce7b6acbe4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:19.013512 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ff7d7-73ac-49de-ac75-7ce7b6acbe4a service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:19.013512 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ff7d7-73ac-49de-ac75-7ce7b6acbe4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:19.013512 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540ff7d7-73ac-49de-ac75-7ce7b6acbe4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:19.039362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ff7d7-73ac-49de-ac75-7ce7b6acbe4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:19.040978 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540ff7d7-73ac-49de-ac75-7ce7b6acbe4a service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:19.059110 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1141/2310] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:19.061229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:19.062490 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a01f-314c-4384-82f3-17b4b9dae97f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:19.063301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a01f-314c-4384-82f3-17b4b9dae97f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:19.064006 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621a01f-314c-4384-82f3-17b4b9dae97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:19.065838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1ae2432a-735e-46de-96a7-a7fc810b3c7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0d3fda256d427689b405954efb9766', 'request_id': 'req-1ae2432a-735e-46de-96a7-a7fc810b3c7a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:19.077111 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1ae2432a-735e-46de-96a7-a7fc810b3c7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0d3fda256d427689b405954efb9766', 'request_id': 'req-1ae2432a-735e-46de-96a7-a7fc810b3c7a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:19.085279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1ae2432a-735e-46de-96a7-a7fc810b3c7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0d3fda256d427689b405954efb9766', 'request_id': 'req-1ae2432a-735e-46de-96a7-a7fc810b3c7a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:19.094267 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b621a01f-314c-4384-82f3-17b4b9dae97f None None] MFA Rules not processed for user `63bb84b42ce84d509155e0514a3c4378`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:19.096524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b621a01f-314c-4384-82f3-17b4b9dae97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:19.105721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1ae2432a-735e-46de-96a7-a7fc810b3c7a admin admin] The token cache is being invalidate because project 3e0d3fda256d427689b405954efb9766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:19.106410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1ae2432a-735e-46de-96a7-a7fc810b3c7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:19.112235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1ae2432a-735e-46de-96a7-a7fc810b3c7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:19.114141 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1170/2311] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:18 2022] DELETE /identity/v3/projects/3e0d3fda256d427689b405954efb9766 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:19.214626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1142/2312] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:19.308133 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2432a-735e-46de-96a7-a7fc810b3c7a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:19.312059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1ae2432a-735e-46de-96a7-a7fc810b3c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:19.435170 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2432a-735e-46de-96a7-a7fc810b3c7a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:19.448269 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:19.449425 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:19.449592 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:19.449879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b admin admin] PATH_INFO: `/v3/projects/1cc8804dd938449fbdad3c2aa82119b5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:19.451410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc8804dd938449fbdad3c2aa82119b5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:19.454755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:19.552955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc8804dd938449fbdad3c2aa82119b5', 'request_id': 'req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:19.571156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc8804dd938449fbdad3c2aa82119b5', 'request_id': 'req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:19.580318 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc8804dd938449fbdad3c2aa82119b5', 'request_id': 'req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:19.593284 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b admin admin] The token cache is being invalidate because project 1cc8804dd938449fbdad3c2aa82119b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:19.593609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:19.594617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:19.596941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1171/2313] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:19 2022] DELETE /identity/v3/projects/1cc8804dd938449fbdad3c2aa82119b5 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:19.601116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621a01f-314c-4384-82f3-17b4b9dae97f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:19.613780 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621a01f-314c-4384-82f3-17b4b9dae97f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:19.712373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31964d40-ece0-438e-93d9-46e72f5bb2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:19.713409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31964d40-ece0-438e-93d9-46e72f5bb2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:19.713701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31964d40-ece0-438e-93d9-46e72f5bb2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:19.713981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31964d40-ece0-438e-93d9-46e72f5bb2ac admin admin] PATH_INFO: `/v3/users/a5e68e38d6ec421194d74fdc88c36e13` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:19.718426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31964d40-ece0-438e-93d9-46e72f5bb2ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e68e38d6ec421194d74fdc88c36e13)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:19.722404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31964d40-ece0-438e-93d9-46e72f5bb2ac admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:19.757368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:19.799263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31964d40-ece0-438e-93d9-46e72f5bb2ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e68e38d6ec421194d74fdc88c36e13'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:19.809239 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31964d40-ece0-438e-93d9-46e72f5bb2ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e68e38d6ec421194d74fdc88c36e13'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:19.818641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31964d40-ece0-438e-93d9-46e72f5bb2ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e68e38d6ec421194d74fdc88c36e13'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:19.819598 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31964d40-ece0-438e-93d9-46e72f5bb2ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e68e38d6ec421194d74fdc88c36e13'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:19.820721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-31964d40-ece0-438e-93d9-46e72f5bb2ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e68e38d6ec421194d74fdc88c36e13'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:19.854894 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1143/2314] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:19 2022] DELETE /identity/v3/users/a5e68e38d6ec421194d74fdc88c36e13 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:07:20.636221 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:20.640973 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:20.664361 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76ccbd-ccfc-42c9-98d3-9c466f3a969b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:20.817534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb0878-7c58-4480-9427-6c941e0610fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:20.819323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb0878-7c58-4480-9427-6c941e0610fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:20.819919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb0878-7c58-4480-9427-6c941e0610fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:20.820345 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb0878-7c58-4480-9427-6c941e0610fc admin admin] PATH_INFO: `/v3/projects/26f07f00770146d49bd50e1c98496393` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:20.822244 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb0878-7c58-4480-9427-6c941e0610fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=26f07f00770146d49bd50e1c98496393)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:20.825790 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb0878-7c58-4480-9427-6c941e0610fc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:20.831093 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:20.932052 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-99bb0878-7c58-4480-9427-6c941e0610fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26f07f00770146d49bd50e1c98496393', 'request_id': 'req-99bb0878-7c58-4480-9427-6c941e0610fc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:20.952277 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-99bb0878-7c58-4480-9427-6c941e0610fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26f07f00770146d49bd50e1c98496393', 'request_id': 'req-99bb0878-7c58-4480-9427-6c941e0610fc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:20.962448 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-99bb0878-7c58-4480-9427-6c941e0610fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26f07f00770146d49bd50e1c98496393', 'request_id': 'req-99bb0878-7c58-4480-9427-6c941e0610fc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:20.977851 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-99bb0878-7c58-4480-9427-6c941e0610fc admin admin] The token cache is being invalidate because project 26f07f00770146d49bd50e1c98496393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:20.978710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-99bb0878-7c58-4480-9427-6c941e0610fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:20.981286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-99bb0878-7c58-4480-9427-6c941e0610fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:20.984032 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1172/2315] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:20 2022] DELETE /identity/v3/projects/26f07f00770146d49bd50e1c98496393 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:21.003408 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784cafe-058c-42f2-b913-5729628043f1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:21.004601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784cafe-058c-42f2-b913-5729628043f1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:21.005122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784cafe-058c-42f2-b913-5729628043f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:21.055390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9784cafe-058c-42f2-b913-5729628043f1 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:21.057040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9784cafe-058c-42f2-b913-5729628043f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:21.141865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1144/2316] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:21.151801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979bce-60aa-4029-b8f6-fe0ee046a187 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:21.152485 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979bce-60aa-4029-b8f6-fe0ee046a187 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:21.153028 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b979bce-60aa-4029-b8f6-fe0ee046a187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:21.210867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4b979bce-60aa-4029-b8f6-fe0ee046a187 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:21.212526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4b979bce-60aa-4029-b8f6-fe0ee046a187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:21.225821 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1173/2317] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:21.230909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784cafe-058c-42f2-b913-5729628043f1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:21.246424 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784cafe-058c-42f2-b913-5729628043f1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:21.252804 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd137f3-bc01-4885-9422-6c4cd0915ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:21.253676 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd137f3-bc01-4885-9422-6c4cd0915ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:21.253993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd137f3-bc01-4885-9422-6c4cd0915ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:21.254468 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd137f3-bc01-4885-9422-6c4cd0915ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:21.255322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd137f3-bc01-4885-9422-6c4cd0915ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:07:21.255730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd137f3-bc01-4885-9422-6c4cd0915ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:21.257500 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd137f3-bc01-4885-9422-6c4cd0915ed6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:21.283016 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1145/2318] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:07:21.289588 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979bce-60aa-4029-b8f6-fe0ee046a187 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:21.303866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b979bce-60aa-4029-b8f6-fe0ee046a187 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:21.312400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debddcc-fce8-451a-9c4c-b9558115ec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:21.313109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debddcc-fce8-451a-9c4c-b9558115ec29 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:21.313400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debddcc-fce8-451a-9c4c-b9558115ec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:21.313680 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debddcc-fce8-451a-9c4c-b9558115ec29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:21.314400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debddcc-fce8-451a-9c4c-b9558115ec29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:21.316955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4debddcc-fce8-451a-9c4c-b9558115ec29 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:21.374231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1174/2319] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:21 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:07:21.376486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd137f3-bc01-4885-9422-6c4cd0915ed6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:21.407737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd137f3-bc01-4885-9422-6c4cd0915ed6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:21.636455 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1502dd-9509-44fe-9ad0-7d8f3dbfc210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:21.637158 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1502dd-9509-44fe-9ad0-7d8f3dbfc210 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:21.637439 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1502dd-9509-44fe-9ad0-7d8f3dbfc210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:21.637714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1502dd-9509-44fe-9ad0-7d8f3dbfc210 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:21.638602 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1502dd-9509-44fe-9ad0-7d8f3dbfc210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:21.641186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1502dd-9509-44fe-9ad0-7d8f3dbfc210 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:21.688607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1146/2320] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:21 2022] POST /identity/v3/users => generated 293 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:07:21.689967 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debddcc-fce8-451a-9c4c-b9558115ec29 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:21.711048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4debddcc-fce8-451a-9c4c-b9558115ec29 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:21.735412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970416c-bcc3-419a-a94e-f225f5651a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:21.738291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970416c-bcc3-419a-a94e-f225f5651a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:21.739271 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970416c-bcc3-419a-a94e-f225f5651a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:21.741545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970416c-bcc3-419a-a94e-f225f5651a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:21.745709 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970416c-bcc3-419a-a94e-f225f5651a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:21.747917 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970416c-bcc3-419a-a94e-f225f5651a49 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:21.777536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1175/2321] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:07:21.781990 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1502dd-9509-44fe-9ad0-7d8f3dbfc210 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:21.794578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1502dd-9509-44fe-9ad0-7d8f3dbfc210 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:21.800068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3f11a-108a-4ec9-a223-806ba5fb06d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:21.800933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f11a-108a-4ec9-a223-806ba5fb06d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:21.801828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f11a-108a-4ec9-a223-806ba5fb06d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:21.801828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3f11a-108a-4ec9-a223-806ba5fb06d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:21.802256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3f11a-108a-4ec9-a223-806ba5fb06d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:21.804048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3f11a-108a-4ec9-a223-806ba5fb06d7 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:21.816206 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1147/2322] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:21.820569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970416c-bcc3-419a-a94e-f225f5651a49 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:21.831356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970416c-bcc3-419a-a94e-f225f5651a49 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:21.836590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810a495-63c5-4d26-8fba-f60ebdab7092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:21.838121 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810a495-63c5-4d26-8fba-f60ebdab7092 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:21.839304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810a495-63c5-4d26-8fba-f60ebdab7092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:21.839816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a810a495-63c5-4d26-8fba-f60ebdab7092 admin admin] PATH_INFO: `/v3/projects/a7019fae847d4a03a952059401923475/users/f0d0bcde55134d65ad133b86dab8c489/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:21.858772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810a495-63c5-4d26-8fba-f60ebdab7092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7019fae847d4a03a952059401923475, user_id=f0d0bcde55134d65ad133b86dab8c489, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:21.862748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a810a495-63c5-4d26-8fba-f60ebdab7092 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:21.911475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1176/2323] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:21 2022] PUT /identity/v3/projects/a7019fae847d4a03a952059401923475/users/f0d0bcde55134d65ad133b86dab8c489/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:21.924291 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11feb-0b0c-4d24-bada-cba76f4d27d4 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:21.924614 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11feb-0b0c-4d24-bada-cba76f4d27d4 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:21.925634 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb11feb-0b0c-4d24-bada-cba76f4d27d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:21.933899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:21.971945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bcb11feb-0b0c-4d24-bada-cba76f4d27d4 None None] MFA Rules not processed for user `f0d0bcde55134d65ad133b86dab8c489`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:21.973550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bcb11feb-0b0c-4d24-bada-cba76f4d27d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:22.061412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1148/2324] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:22.064197 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810a495-63c5-4d26-8fba-f60ebdab7092 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:22.250878 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a810a495-63c5-4d26-8fba-f60ebdab7092 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:22.254363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac095356-232d-4617-ace7-fbdb20aeea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:22.255298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac095356-232d-4617-ace7-fbdb20aeea3e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:22.255516 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac095356-232d-4617-ace7-fbdb20aeea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:22.257008 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac095356-232d-4617-ace7-fbdb20aeea3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:22.257366 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac095356-232d-4617-ace7-fbdb20aeea3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:22.262102 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac095356-232d-4617-ace7-fbdb20aeea3e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:22.313563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1177/2325] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:22 2022] POST /identity/v3/projects => generated 387 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:22.318061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb11feb-0b0c-4d24-bada-cba76f4d27d4 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:22.330485 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb11feb-0b0c-4d24-bada-cba76f4d27d4 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:22.407169 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51973cdc-d2f6-4c69-965a-4c51d359476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:22.407869 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51973cdc-d2f6-4c69-965a-4c51d359476f admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:22.408411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51973cdc-d2f6-4c69-965a-4c51d359476f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:22.408700 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51973cdc-d2f6-4c69-965a-4c51d359476f admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:22.409499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51973cdc-d2f6-4c69-965a-4c51d359476f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:22.411544 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51973cdc-d2f6-4c69-965a-4c51d359476f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:22.447834 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1149/2326] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:22 2022] POST /identity/v3/users => generated 300 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:22.451073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac095356-232d-4617-ace7-fbdb20aeea3e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:22.470514 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac095356-232d-4617-ace7-fbdb20aeea3e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:22.476912 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97dc96-0a56-4881-9b7e-db6cc7047fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:22.477818 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97dc96-0a56-4881-9b7e-db6cc7047fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:22.477922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97dc96-0a56-4881-9b7e-db6cc7047fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:22.478276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97dc96-0a56-4881-9b7e-db6cc7047fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:22.479119 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97dc96-0a56-4881-9b7e-db6cc7047fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:22.480782 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97dc96-0a56-4881-9b7e-db6cc7047fe8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:22.493611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1178/2327] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:07:22.497735 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51973cdc-d2f6-4c69-965a-4c51d359476f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:22.508319 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51973cdc-d2f6-4c69-965a-4c51d359476f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:22.513946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e59e6-3e4c-484f-a5e2-4ecca1c5a916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:22.514300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e59e6-3e4c-484f-a5e2-4ecca1c5a916 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:22.514580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e59e6-3e4c-484f-a5e2-4ecca1c5a916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:22.514938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1e59e6-3e4c-484f-a5e2-4ecca1c5a916 admin admin] PATH_INFO: `/v3/projects/6fd8eec5c1e94569b022fb5065681446/users/688a0760b1b54952b1b582a676dcb233/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:22.540786 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e59e6-3e4c-484f-a5e2-4ecca1c5a916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd8eec5c1e94569b022fb5065681446, user_id=688a0760b1b54952b1b582a676dcb233, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:22.543540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1e59e6-3e4c-484f-a5e2-4ecca1c5a916 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:22.559705 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1150/2328] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:22 2022] PUT /identity/v3/projects/6fd8eec5c1e94569b022fb5065681446/users/688a0760b1b54952b1b582a676dcb233/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:22.566706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97dc96-0a56-4881-9b7e-db6cc7047fe8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:22.573287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:22.579470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97dc96-0a56-4881-9b7e-db6cc7047fe8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:22.656426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbec31-604d-4099-96ed-4910c9b78009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:22.657214 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbec31-604d-4099-96ed-4910c9b78009 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:22.657590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbec31-604d-4099-96ed-4910c9b78009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:22.657908 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbec31-604d-4099-96ed-4910c9b78009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:22.658731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbec31-604d-4099-96ed-4910c9b78009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:22.660901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbec31-604d-4099-96ed-4910c9b78009 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:22.688898 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1179/2329] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:22 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:22.699956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e59e6-3e4c-484f-a5e2-4ecca1c5a916 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:22.713285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1e59e6-3e4c-484f-a5e2-4ecca1c5a916 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:22.719917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211edce9-3bdb-4b4f-8913-9451c9fcdd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:22.721097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211edce9-3bdb-4b4f-8913-9451c9fcdd3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:22.721765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211edce9-3bdb-4b4f-8913-9451c9fcdd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:22.722094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211edce9-3bdb-4b4f-8913-9451c9fcdd3a admin admin] PATH_INFO: `/v3/projects/6fd8eec5c1e94569b022fb5065681446/users/688a0760b1b54952b1b582a676dcb233/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:22.725482 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211edce9-3bdb-4b4f-8913-9451c9fcdd3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd8eec5c1e94569b022fb5065681446, user_id=688a0760b1b54952b1b582a676dcb233, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:22.728517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211edce9-3bdb-4b4f-8913-9451c9fcdd3a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:22.767147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1151/2330] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:22 2022] PUT /identity/v3/projects/6fd8eec5c1e94569b022fb5065681446/users/688a0760b1b54952b1b582a676dcb233/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:22.778468 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612d41f-53c9-412f-97ac-47de54171c24 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:22.779059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612d41f-53c9-412f-97ac-47de54171c24 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:22.779059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0612d41f-53c9-412f-97ac-47de54171c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:22.812755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0612d41f-53c9-412f-97ac-47de54171c24 None None] MFA Rules not processed for user `688a0760b1b54952b1b582a676dcb233`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:22.813994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0612d41f-53c9-412f-97ac-47de54171c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:22.904509 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1180/2331] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:22.916765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211edce9-3bdb-4b4f-8913-9451c9fcdd3a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:22.918548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-211edce9-3bdb-4b4f-8913-9451c9fcdd3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:22.994066 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:23.001327 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211edce9-3bdb-4b4f-8913-9451c9fcdd3a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:23.014658 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b28e9-6f09-4d09-b016-5cd1b54b4bb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:23.015324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b28e9-6f09-4d09-b016-5cd1b54b4bb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:23.015610 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b28e9-6f09-4d09-b016-5cd1b54b4bb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:23.015890 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b28e9-6f09-4d09-b016-5cd1b54b4bb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:23.029616 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b28e9-6f09-4d09-b016-5cd1b54b4bb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:23.030191 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b28e9-6f09-4d09-b016-5cd1b54b4bb5 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:23.047704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1152/2332] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:23.125828 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612d41f-53c9-412f-97ac-47de54171c24 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:23.237062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0612d41f-53c9-412f-97ac-47de54171c24 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:23.250842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1ae36-3132-4dc7-9148-15c9c5e42966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:23.251786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1ae36-3132-4dc7-9148-15c9c5e42966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:23.252068 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1ae36-3132-4dc7-9148-15c9c5e42966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:23.252351 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1ae36-3132-4dc7-9148-15c9c5e42966 admin admin] PATH_INFO: `/v3/users/f0d0bcde55134d65ad133b86dab8c489` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:23.261364 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1ae36-3132-4dc7-9148-15c9c5e42966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d0bcde55134d65ad133b86dab8c489)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:23.267425 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1ae36-3132-4dc7-9148-15c9c5e42966 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:23.313503 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:23.349478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cdd1ae36-3132-4dc7-9148-15c9c5e42966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d0bcde55134d65ad133b86dab8c489'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:23.367532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cdd1ae36-3132-4dc7-9148-15c9c5e42966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d0bcde55134d65ad133b86dab8c489'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:23.379712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cdd1ae36-3132-4dc7-9148-15c9c5e42966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d0bcde55134d65ad133b86dab8c489'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:23.380523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cdd1ae36-3132-4dc7-9148-15c9c5e42966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d0bcde55134d65ad133b86dab8c489'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:23.389363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cdd1ae36-3132-4dc7-9148-15c9c5e42966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d0bcde55134d65ad133b86dab8c489'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:23.399925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1181/2333] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:23 2022] DELETE /identity/v3/users/f0d0bcde55134d65ad133b86dab8c489 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:23.401752 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725080a-135f-474e-aa95-1a2250d8d068 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:23.402256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725080a-135f-474e-aa95-1a2250d8d068 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:23.402379 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725080a-135f-474e-aa95-1a2250d8d068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:23.422981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c725080a-135f-474e-aa95-1a2250d8d068 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:23.424258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c725080a-135f-474e-aa95-1a2250d8d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:23.515356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1153/2334] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:23.523771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1ae36-3132-4dc7-9148-15c9c5e42966 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:23.525337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cdd1ae36-3132-4dc7-9148-15c9c5e42966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:23.617159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1ae36-3132-4dc7-9148-15c9c5e42966 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:23.622215 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425fded-625e-4283-a3fc-255cb8d4a306 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:23.623648 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425fded-625e-4283-a3fc-255cb8d4a306 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:23.624194 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425fded-625e-4283-a3fc-255cb8d4a306 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:23.624665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425fded-625e-4283-a3fc-255cb8d4a306 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:23.660640 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425fded-625e-4283-a3fc-255cb8d4a306 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:23.662339 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425fded-625e-4283-a3fc-255cb8d4a306 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:23.689273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1182/2335] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:24.542123 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725080a-135f-474e-aa95-1a2250d8d068 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:24.543243 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c725080a-135f-474e-aa95-1a2250d8d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:24.559872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725080a-135f-474e-aa95-1a2250d8d068 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:24.565033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f66ae-29e9-4751-be6f-7a24089ac829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:24.565968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f66ae-29e9-4751-be6f-7a24089ac829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:24.566252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f66ae-29e9-4751-be6f-7a24089ac829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:24.566512 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f66ae-29e9-4751-be6f-7a24089ac829 admin admin] PATH_INFO: `/v3/projects/a7019fae847d4a03a952059401923475` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:24.567782 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f66ae-29e9-4751-be6f-7a24089ac829 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7019fae847d4a03a952059401923475)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:24.569766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f66ae-29e9-4751-be6f-7a24089ac829 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:24.651463 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-451f66ae-29e9-4751-be6f-7a24089ac829 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7019fae847d4a03a952059401923475', 'request_id': 'req-451f66ae-29e9-4751-be6f-7a24089ac829'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:24.661320 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-451f66ae-29e9-4751-be6f-7a24089ac829 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7019fae847d4a03a952059401923475', 'request_id': 'req-451f66ae-29e9-4751-be6f-7a24089ac829'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:24.669515 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-451f66ae-29e9-4751-be6f-7a24089ac829 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7019fae847d4a03a952059401923475', 'request_id': 'req-451f66ae-29e9-4751-be6f-7a24089ac829'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:24.689478 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-451f66ae-29e9-4751-be6f-7a24089ac829 admin admin] The token cache is being invalidate because project a7019fae847d4a03a952059401923475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:24.689746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-451f66ae-29e9-4751-be6f-7a24089ac829 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:24.690550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-451f66ae-29e9-4751-be6f-7a24089ac829 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:24.697337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1154/2336] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:24 2022] DELETE /identity/v3/projects/a7019fae847d4a03a952059401923475 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:24.698936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425fded-625e-4283-a3fc-255cb8d4a306 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:24.718857 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425fded-625e-4283-a3fc-255cb8d4a306 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:24.862636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32501516-9e44-406c-bf8f-49223aa30119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:24.864029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32501516-9e44-406c-bf8f-49223aa30119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:24.864512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32501516-9e44-406c-bf8f-49223aa30119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:24.864982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32501516-9e44-406c-bf8f-49223aa30119 admin admin] PATH_INFO: `/v3/users/688a0760b1b54952b1b582a676dcb233` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:24.867061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32501516-9e44-406c-bf8f-49223aa30119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=688a0760b1b54952b1b582a676dcb233)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:24.869463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32501516-9e44-406c-bf8f-49223aa30119 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:24.995318 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-32501516-9e44-406c-bf8f-49223aa30119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688a0760b1b54952b1b582a676dcb233'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:24.997490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:25.015125 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-32501516-9e44-406c-bf8f-49223aa30119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688a0760b1b54952b1b582a676dcb233'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:25.030119 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-32501516-9e44-406c-bf8f-49223aa30119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688a0760b1b54952b1b582a676dcb233'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:25.031491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-32501516-9e44-406c-bf8f-49223aa30119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688a0760b1b54952b1b582a676dcb233'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:25.040991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-32501516-9e44-406c-bf8f-49223aa30119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688a0760b1b54952b1b582a676dcb233'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:25.049113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1183/2337] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:24 2022] DELETE /identity/v3/users/688a0760b1b54952b1b582a676dcb233 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:25.547248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f66ae-29e9-4751-be6f-7a24089ac829 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:25.549485 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-451f66ae-29e9-4751-be6f-7a24089ac829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:25.573280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f66ae-29e9-4751-be6f-7a24089ac829 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:25.693241 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38df7ef-c21c-4a3f-a673-f751db540328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:25.694335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38df7ef-c21c-4a3f-a673-f751db540328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:25.694839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38df7ef-c21c-4a3f-a673-f751db540328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:25.695815 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38df7ef-c21c-4a3f-a673-f751db540328 admin admin] PATH_INFO: `/v3/projects/6fd8eec5c1e94569b022fb5065681446` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:25.697102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38df7ef-c21c-4a3f-a673-f751db540328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd8eec5c1e94569b022fb5065681446)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:25.699299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38df7ef-c21c-4a3f-a673-f751db540328 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:25.730280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:25.791834 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e38df7ef-c21c-4a3f-a673-f751db540328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd8eec5c1e94569b022fb5065681446', 'request_id': 'req-e38df7ef-c21c-4a3f-a673-f751db540328'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:25.802494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e38df7ef-c21c-4a3f-a673-f751db540328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd8eec5c1e94569b022fb5065681446', 'request_id': 'req-e38df7ef-c21c-4a3f-a673-f751db540328'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:25.816244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e38df7ef-c21c-4a3f-a673-f751db540328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd8eec5c1e94569b022fb5065681446', 'request_id': 'req-e38df7ef-c21c-4a3f-a673-f751db540328'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:25.846853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e38df7ef-c21c-4a3f-a673-f751db540328 admin admin] The token cache is being invalidate because project 6fd8eec5c1e94569b022fb5065681446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:25.847464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e38df7ef-c21c-4a3f-a673-f751db540328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:25.849193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-e38df7ef-c21c-4a3f-a673-f751db540328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:25.851316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1155/2338] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:25 2022] DELETE /identity/v3/projects/6fd8eec5c1e94569b022fb5065681446 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:07:25.856406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e974987-453c-4ae8-b23b-11da7e5b78a4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:25.857272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e974987-453c-4ae8-b23b-11da7e5b78a4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:25.857707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e974987-453c-4ae8-b23b-11da7e5b78a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:25.902040 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7e974987-453c-4ae8-b23b-11da7e5b78a4 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:25.903472 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7e974987-453c-4ae8-b23b-11da7e5b78a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:25.935005 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccfc5e-e638-4d01-b2a4-9e1cf06ff0de None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:25.935592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccfc5e-e638-4d01-b2a4-9e1cf06ff0de None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:25.936285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccfc5e-e638-4d01-b2a4-9e1cf06ff0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:26.020741 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1184/2339] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:26.028681 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd0cf0-abb9-45a6-a1c3-c79eea81f77b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:26.029177 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd0cf0-abb9-45a6-a1c3-c79eea81f77b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:26.029834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd0cf0-abb9-45a6-a1c3-c79eea81f77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:26.030574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-57ccfc5e-e638-4d01-b2a4-9e1cf06ff0de None None] MFA Rules not processed for user `288442cf94b84c56ad28957275fa7d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:26.032020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-57ccfc5e-e638-4d01-b2a4-9e1cf06ff0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:26.056800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-00cd0cf0-abb9-45a6-a1c3-c79eea81f77b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:26.058616 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-00cd0cf0-abb9-45a6-a1c3-c79eea81f77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:26.070755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1185/2340] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:26.075590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd0cf0-abb9-45a6-a1c3-c79eea81f77b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:26.098610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd0cf0-abb9-45a6-a1c3-c79eea81f77b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:26.108343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f9d8d-1340-4b1d-9689-9e491ad19548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:26.109043 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9d8d-1340-4b1d-9689-9e491ad19548 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:26.109330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9d8d-1340-4b1d-9689-9e491ad19548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:26.109605 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9d8d-1340-4b1d-9689-9e491ad19548 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:26.110719 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f9d8d-1340-4b1d-9689-9e491ad19548 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:07:26.111115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f9d8d-1340-4b1d-9689-9e491ad19548 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:26.112731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f9d8d-1340-4b1d-9689-9e491ad19548 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:26.131806 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1186/2341] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:07:26.138544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f9d8d-1340-4b1d-9689-9e491ad19548 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:26.153868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f9d8d-1340-4b1d-9689-9e491ad19548 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:26.162605 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42522c0d-40ee-48a0-9e5e-45923190e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:26.163736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42522c0d-40ee-48a0-9e5e-45923190e580 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:26.164826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42522c0d-40ee-48a0-9e5e-45923190e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:26.165262 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42522c0d-40ee-48a0-9e5e-45923190e580 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:26.166266 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42522c0d-40ee-48a0-9e5e-45923190e580 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:26.169722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42522c0d-40ee-48a0-9e5e-45923190e580 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:26.187346 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1156/2342] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:26.195701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccfc5e-e638-4d01-b2a4-9e1cf06ff0de None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:26.197441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-57ccfc5e-e638-4d01-b2a4-9e1cf06ff0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:26.212732 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1187/2343] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:26 2022] POST /identity/v3/projects => generated 397 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:26.217984 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42522c0d-40ee-48a0-9e5e-45923190e580 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:26.219380 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccfc5e-e638-4d01-b2a4-9e1cf06ff0de None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:26.302350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9051e1-2574-49b8-936a-0edf6272be60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:26.303463 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9051e1-2574-49b8-936a-0edf6272be60 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:26.303852 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9051e1-2574-49b8-936a-0edf6272be60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:26.308516 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9051e1-2574-49b8-936a-0edf6272be60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:26.309288 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9051e1-2574-49b8-936a-0edf6272be60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:26.313530 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9051e1-2574-49b8-936a-0edf6272be60 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:26.333881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42522c0d-40ee-48a0-9e5e-45923190e580 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:26.340088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb810e-5e04-487a-9ae2-0e76801bed86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:26.341442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb810e-5e04-487a-9ae2-0e76801bed86 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:26.341933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb810e-5e04-487a-9ae2-0e76801bed86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:26.342437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb810e-5e04-487a-9ae2-0e76801bed86 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:26.343393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb810e-5e04-487a-9ae2-0e76801bed86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:26.354675 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb810e-5e04-487a-9ae2-0e76801bed86 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:26.394892 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1188/2344] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:26 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:26.395227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1157/2345] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:26 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:26.396852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb810e-5e04-487a-9ae2-0e76801bed86 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:26.399127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9051e1-2574-49b8-936a-0edf6272be60 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:26.433965 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb810e-5e04-487a-9ae2-0e76801bed86 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:26.459108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:26.496045 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:26.554956 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9051e1-2574-49b8-936a-0edf6272be60 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:26.560979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a10a68-5133-4b8d-b51f-fb381d975b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:26.568500 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a10a68-5133-4b8d-b51f-fb381d975b26 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:26.568823 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a10a68-5133-4b8d-b51f-fb381d975b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:26.569310 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a10a68-5133-4b8d-b51f-fb381d975b26 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:26.570487 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a10a68-5133-4b8d-b51f-fb381d975b26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:26.575537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a10a68-5133-4b8d-b51f-fb381d975b26 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:26.611724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1158/2346] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:26 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:26.615037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a10a68-5133-4b8d-b51f-fb381d975b26 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:26.631026 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a10a68-5133-4b8d-b51f-fb381d975b26 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:26.638109 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae45ad9-cb11-4477-b052-5864dcfa4b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:26.639251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45ad9-cb11-4477-b052-5864dcfa4b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:26.639683 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45ad9-cb11-4477-b052-5864dcfa4b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:26.640238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae45ad9-cb11-4477-b052-5864dcfa4b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:26.641486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae45ad9-cb11-4477-b052-5864dcfa4b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:26.643479 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae45ad9-cb11-4477-b052-5864dcfa4b72 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:26.643631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7a2d3-b462-4565-90c9-c4e02ea25cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:26.644351 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7a2d3-b462-4565-90c9-c4e02ea25cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:26.644640 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7a2d3-b462-4565-90c9-c4e02ea25cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:26.644924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7a2d3-b462-4565-90c9-c4e02ea25cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:26.658529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7a2d3-b462-4565-90c9-c4e02ea25cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:26.659280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1159/2347] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:26.660737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7a2d3-b462-4565-90c9-c4e02ea25cc4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:26.663261 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae45ad9-cb11-4477-b052-5864dcfa4b72 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:26.682238 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1189/2348] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:07:26.683107 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae45ad9-cb11-4477-b052-5864dcfa4b72 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:26.686086 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7a2d3-b462-4565-90c9-c4e02ea25cc4 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:26.698650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a5654-e058-42a0-b9cc-d5e084080a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:26.699740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a5654-e058-42a0-b9cc-d5e084080a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:26.700011 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a5654-e058-42a0-b9cc-d5e084080a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:26.700461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a5654-e058-42a0-b9cc-d5e084080a47 admin admin] PATH_INFO: `/v3/projects/949cc83380004b6c880606c522b6ce8c/users/65476251f2fe40ccb80331e7a6cc14ec/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:26.712007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7a2d3-b462-4565-90c9-c4e02ea25cc4 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:26.718418 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c474f39-f9f0-4fe7-8f06-f24a2f63d8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:26.719135 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c474f39-f9f0-4fe7-8f06-f24a2f63d8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:26.719413 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c474f39-f9f0-4fe7-8f06-f24a2f63d8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:26.719688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c474f39-f9f0-4fe7-8f06-f24a2f63d8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:26.720502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c474f39-f9f0-4fe7-8f06-f24a2f63d8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:26.722162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c474f39-f9f0-4fe7-8f06-f24a2f63d8b4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:26.738081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1190/2349] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:07:26.739674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c474f39-f9f0-4fe7-8f06-f24a2f63d8b4 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:26.751659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a5654-e058-42a0-b9cc-d5e084080a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949cc83380004b6c880606c522b6ce8c, user_id=65476251f2fe40ccb80331e7a6cc14ec, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:26.754833 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a5654-e058-42a0-b9cc-d5e084080a47 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:26.769954 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c474f39-f9f0-4fe7-8f06-f24a2f63d8b4 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:26.777014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1160/2350] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:26 2022] PUT /identity/v3/projects/949cc83380004b6c880606c522b6ce8c/users/65476251f2fe40ccb80331e7a6cc14ec/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:07:26.781550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a5654-e058-42a0-b9cc-d5e084080a47 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:26.847816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33185c-7076-4d61-9916-938123fa137d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:26.848747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33185c-7076-4d61-9916-938123fa137d admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:26.849029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33185c-7076-4d61-9916-938123fa137d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:26.849306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33185c-7076-4d61-9916-938123fa137d admin admin] PATH_INFO: `/v3/projects/3da98f847ebc4949855869a9dbed9780/users/c66fdefc796c45cab8eb64caf1459af2/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:26.868158 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33185c-7076-4d61-9916-938123fa137d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da98f847ebc4949855869a9dbed9780, user_id=c66fdefc796c45cab8eb64caf1459af2, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:26.871635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33185c-7076-4d61-9916-938123fa137d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:26.880989 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a5654-e058-42a0-b9cc-d5e084080a47 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:26.891055 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e21289-5003-4a2b-a678-35a54d52831a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:26.891964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e21289-5003-4a2b-a678-35a54d52831a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:26.892344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e21289-5003-4a2b-a678-35a54d52831a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:26.892719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e21289-5003-4a2b-a678-35a54d52831a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:26.893659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e21289-5003-4a2b-a678-35a54d52831a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:26.895474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e21289-5003-4a2b-a678-35a54d52831a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:26.899622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1191/2351] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:26 2022] PUT /identity/v3/projects/3da98f847ebc4949855869a9dbed9780/users/c66fdefc796c45cab8eb64caf1459af2/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:07:26.907073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1161/2352] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:26.912036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33185c-7076-4d61-9916-938123fa137d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:26.912621 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898473b-1878-473d-9b13-022545b6adbc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:26.912977 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898473b-1878-473d-9b13-022545b6adbc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:26.913326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898473b-1878-473d-9b13-022545b6adbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:26.946607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c898473b-1878-473d-9b13-022545b6adbc None None] MFA Rules not processed for user `c66fdefc796c45cab8eb64caf1459af2`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:26.948790 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c898473b-1878-473d-9b13-022545b6adbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:26.989404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33185c-7076-4d61-9916-938123fa137d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:26.995895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eff57-d1ac-4f3f-8065-4ee0b88c0c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:26.996821 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eff57-d1ac-4f3f-8065-4ee0b88c0c11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:26.997106 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eff57-d1ac-4f3f-8065-4ee0b88c0c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:26.997404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eff57-d1ac-4f3f-8065-4ee0b88c0c11 admin admin] PATH_INFO: `/v3/projects/949cc83380004b6c880606c522b6ce8c/users/65476251f2fe40ccb80331e7a6cc14ec/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:26.999745 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651eff57-d1ac-4f3f-8065-4ee0b88c0c11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949cc83380004b6c880606c522b6ce8c, user_id=65476251f2fe40ccb80331e7a6cc14ec, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:27.005516 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651eff57-d1ac-4f3f-8065-4ee0b88c0c11 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:27.033211 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1192/2353] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:26 2022] PUT /identity/v3/projects/949cc83380004b6c880606c522b6ce8c/users/65476251f2fe40ccb80331e7a6cc14ec/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:27.050765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:27.065616 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1162/2354] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:26 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:27.072361 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eff57-d1ac-4f3f-8065-4ee0b88c0c11 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:27.113143 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:27.220508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eff57-d1ac-4f3f-8065-4ee0b88c0c11 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:27.248539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1a653-1c92-428a-84d0-d81d4a35c150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:27.249179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1a653-1c92-428a-84d0-d81d4a35c150 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:27.249466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1a653-1c92-428a-84d0-d81d4a35c150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:27.249742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1a653-1c92-428a-84d0-d81d4a35c150 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:27.250864 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1a653-1c92-428a-84d0-d81d4a35c150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:27.253073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1a653-1c92-428a-84d0-d81d4a35c150 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:27.300404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1193/2355] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:27 2022] POST /identity/v3/projects => generated 399 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:07:27.301130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898473b-1878-473d-9b13-022545b6adbc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:27.316805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898473b-1878-473d-9b13-022545b6adbc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:27.471246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9e603-5125-4ed1-af95-8419540465d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:27.472266 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9e603-5125-4ed1-af95-8419540465d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:27.472719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9e603-5125-4ed1-af95-8419540465d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:27.473147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9e603-5125-4ed1-af95-8419540465d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:27.474190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9e603-5125-4ed1-af95-8419540465d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:27.476461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b9e603-5125-4ed1-af95-8419540465d3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:27.511231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1163/2356] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:27 2022] POST /identity/v3/users => generated 306 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:07:27.512495 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1a653-1c92-428a-84d0-d81d4a35c150 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:27.528351 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1a653-1c92-428a-84d0-d81d4a35c150 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:27.537232 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c727a2-0b37-494e-affc-2acbc5161f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:27.538437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c727a2-0b37-494e-affc-2acbc5161f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:27.538999 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c727a2-0b37-494e-affc-2acbc5161f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:27.539475 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c727a2-0b37-494e-affc-2acbc5161f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:27.540427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c727a2-0b37-494e-affc-2acbc5161f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:27.551284 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c727a2-0b37-494e-affc-2acbc5161f6f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:27.572295 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1194/2357] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:27.572850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9e603-5125-4ed1-af95-8419540465d3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:27.584239 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9e603-5125-4ed1-af95-8419540465d3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:27.591316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080c12c-dea8-41b4-b5ec-e6c041cdfe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:27.594729 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080c12c-dea8-41b4-b5ec-e6c041cdfe23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:27.594729 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080c12c-dea8-41b4-b5ec-e6c041cdfe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:27.594729 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080c12c-dea8-41b4-b5ec-e6c041cdfe23 admin admin] PATH_INFO: `/v3/projects/18b879003c854cf4b95885be010f5964/users/f16281d285b44246a6dfbe1f68a22db5/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:27.614842 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080c12c-dea8-41b4-b5ec-e6c041cdfe23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b879003c854cf4b95885be010f5964, user_id=f16281d285b44246a6dfbe1f68a22db5, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:27.619112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080c12c-dea8-41b4-b5ec-e6c041cdfe23 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:27.647540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1164/2358] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:27 2022] PUT /identity/v3/projects/18b879003c854cf4b95885be010f5964/users/f16281d285b44246a6dfbe1f68a22db5/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:07:27.649227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c727a2-0b37-494e-affc-2acbc5161f6f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:27.662924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c727a2-0b37-494e-affc-2acbc5161f6f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:27.759228 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7eab7-73c5-4842-9be2-b6cdccc9ffda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:27.775668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7eab7-73c5-4842-9be2-b6cdccc9ffda admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:27.775962 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7eab7-73c5-4842-9be2-b6cdccc9ffda admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:27.776245 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7eab7-73c5-4842-9be2-b6cdccc9ffda admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:27.777080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7eab7-73c5-4842-9be2-b6cdccc9ffda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:27.788415 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7eab7-73c5-4842-9be2-b6cdccc9ffda admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:27.815633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1195/2359] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:27.820781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080c12c-dea8-41b4-b5ec-e6c041cdfe23 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:27.855355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080c12c-dea8-41b4-b5ec-e6c041cdfe23 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:27.870587 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf89fa6-6c76-48ea-aaf2-5452063c6f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:27.871879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf89fa6-6c76-48ea-aaf2-5452063c6f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:27.872258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf89fa6-6c76-48ea-aaf2-5452063c6f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:27.872633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf89fa6-6c76-48ea-aaf2-5452063c6f76 admin admin] PATH_INFO: `/v3/projects/18b879003c854cf4b95885be010f5964/users/f16281d285b44246a6dfbe1f68a22db5/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:27.876423 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf89fa6-6c76-48ea-aaf2-5452063c6f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18b879003c854cf4b95885be010f5964, user_id=f16281d285b44246a6dfbe1f68a22db5, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:27.880310 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf89fa6-6c76-48ea-aaf2-5452063c6f76 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:27.894446 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1165/2360] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:27 2022] PUT /identity/v3/projects/18b879003c854cf4b95885be010f5964/users/f16281d285b44246a6dfbe1f68a22db5/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:27.906236 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e50f08-7d42-400a-bb4f-afb213e73156 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:27.907051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e50f08-7d42-400a-bb4f-afb213e73156 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:27.907375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e50f08-7d42-400a-bb4f-afb213e73156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:27.956865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f9e50f08-7d42-400a-bb4f-afb213e73156 None None] MFA Rules not processed for user `f16281d285b44246a6dfbe1f68a22db5`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:27.958498 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f9e50f08-7d42-400a-bb4f-afb213e73156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:28.061776 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1196/2361] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:07:28.073989 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf89fa6-6c76-48ea-aaf2-5452063c6f76 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:28.075824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-adf89fa6-6c76-48ea-aaf2-5452063c6f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:28.216087 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf89fa6-6c76-48ea-aaf2-5452063c6f76 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:28.220754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4bd22-509f-428d-b5ed-2a1fa2ff6340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:28.221759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4bd22-509f-428d-b5ed-2a1fa2ff6340 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:28.222418 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4bd22-509f-428d-b5ed-2a1fa2ff6340 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:28.222554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4bd22-509f-428d-b5ed-2a1fa2ff6340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:28.241554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4bd22-509f-428d-b5ed-2a1fa2ff6340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:28.244655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4bd22-509f-428d-b5ed-2a1fa2ff6340 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:28.262226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1166/2362] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:28 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:28.409388 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e50f08-7d42-400a-bb4f-afb213e73156 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:28.424079 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e50f08-7d42-400a-bb4f-afb213e73156 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:28.429750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7d5e6-d143-40b0-b9a7-a87f7f6e04d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:28.430512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7d5e6-d143-40b0-b9a7-a87f7f6e04d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:28.438114 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7d5e6-d143-40b0-b9a7-a87f7f6e04d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:28.438576 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f7d5e6-d143-40b0-b9a7-a87f7f6e04d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:28.468374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:28.570562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7d5e6-d143-40b0-b9a7-a87f7f6e04d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:28.572118 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f7d5e6-d143-40b0-b9a7-a87f7f6e04d7 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:28.594755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1197/2363] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:34.474229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492582f9-ac0a-43eb-b635-5cd1f7f5763b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:34.474739 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492582f9-ac0a-43eb-b635-5cd1f7f5763b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:34.475045 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492582f9-ac0a-43eb-b635-5cd1f7f5763b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:34.505244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-492582f9-ac0a-43eb-b635-5cd1f7f5763b None None] MFA Rules not processed for user `65476251f2fe40ccb80331e7a6cc14ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:34.506556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-492582f9-ac0a-43eb-b635-5cd1f7f5763b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:34.551698 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:34.590270 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1167/2364] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:34.600201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7d5e6-d143-40b0-b9a7-a87f7f6e04d7 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:34.601925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-84f7d5e6-d143-40b0-b9a7-a87f7f6e04d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:34.686568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f7d5e6-d143-40b0-b9a7-a87f7f6e04d7 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:34.693696 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357b731-9cfa-45a6-b249-d145d7f0e63d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3418c0b46c404c8ca445cce9db632d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:34.694594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357b731-9cfa-45a6-b249-d145d7f0e63d service glance] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:34.695222 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357b731-9cfa-45a6-b249-d145d7f0e63d service glance] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:34.695693 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357b731-9cfa-45a6-b249-d145d7f0e63d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:34.785576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492582f9-ac0a-43eb-b635-5cd1f7f5763b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:34.811531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357b731-9cfa-45a6-b249-d145d7f0e63d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:34.813040 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357b731-9cfa-45a6-b249-d145d7f0e63d service glance] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:34.831554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1198/2365] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:34.937346 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492582f9-ac0a-43eb-b635-5cd1f7f5763b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:34.950079 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b8b26-0f1b-41f1-9765-9f3d94504919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:34.951120 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b8b26-0f1b-41f1-9765-9f3d94504919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:34.951427 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b8b26-0f1b-41f1-9765-9f3d94504919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:34.951803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b8b26-0f1b-41f1-9765-9f3d94504919 admin admin] PATH_INFO: `/v3/users/c66fdefc796c45cab8eb64caf1459af2` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:34.953270 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b8b26-0f1b-41f1-9765-9f3d94504919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c66fdefc796c45cab8eb64caf1459af2)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:34.956063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b8b26-0f1b-41f1-9765-9f3d94504919 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:35.028435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e3c42-6659-4bae-b2aa-c60f91932b6d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:35.028820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e3c42-6659-4bae-b2aa-c60f91932b6d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:35.029110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e3c42-6659-4bae-b2aa-c60f91932b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:35.029931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d17b8b26-0f1b-41f1-9765-9f3d94504919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c66fdefc796c45cab8eb64caf1459af2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:35.038634 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d17b8b26-0f1b-41f1-9765-9f3d94504919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c66fdefc796c45cab8eb64caf1459af2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:35.051699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d17b8b26-0f1b-41f1-9765-9f3d94504919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c66fdefc796c45cab8eb64caf1459af2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:35.052274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d17b8b26-0f1b-41f1-9765-9f3d94504919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c66fdefc796c45cab8eb64caf1459af2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:35.052950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d17b8b26-0f1b-41f1-9765-9f3d94504919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c66fdefc796c45cab8eb64caf1459af2'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:35.056894 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-139e3c42-6659-4bae-b2aa-c60f91932b6d None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:35.058660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-139e3c42-6659-4bae-b2aa-c60f91932b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:35.080941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1168/2366] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:34 2022] DELETE /identity/v3/users/c66fdefc796c45cab8eb64caf1459af2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:35.085871 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f7eb7-f44f-40fe-944e-b869c4eabc26 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:35.086222 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f7eb7-f44f-40fe-944e-b869c4eabc26 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:35.086507 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f7eb7-f44f-40fe-944e-b869c4eabc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:35.111395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b33f7eb7-f44f-40fe-944e-b869c4eabc26 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:35.112683 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b33f7eb7-f44f-40fe-944e-b869c4eabc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:35.137249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1199/2367] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 16:07:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:35.195672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e3c42-6659-4bae-b2aa-c60f91932b6d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:35.197263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-139e3c42-6659-4bae-b2aa-c60f91932b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:35.200695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:35.214634 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1169/2368] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:07:35.215569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:35.228269 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f7eb7-f44f-40fe-944e-b869c4eabc26 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:35.232336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b33f7eb7-f44f-40fe-944e-b869c4eabc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:35.307846 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f7eb7-f44f-40fe-944e-b869c4eabc26 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:35.312284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3da646-c02d-4ced-b58c-0958a10c1e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:35.312886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3da646-c02d-4ced-b58c-0958a10c1e11 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:35.313161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3da646-c02d-4ced-b58c-0958a10c1e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:35.313438 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3da646-c02d-4ced-b58c-0958a10c1e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:35.316216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e3c42-6659-4bae-b2aa-c60f91932b6d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:35.324405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3da646-c02d-4ced-b58c-0958a10c1e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:35.325872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3da646-c02d-4ced-b58c-0958a10c1e11 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:35.344501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1170/2369] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:35.399213 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bdcb7-1f3b-4842-9155-0b33355bd7c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:35.399913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bdcb7-1f3b-4842-9155-0b33355bd7c3 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:35.400306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bdcb7-1f3b-4842-9155-0b33355bd7c3 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:35.400603 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47bdcb7-1f3b-4842-9155-0b33355bd7c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:35.487165 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bdcb7-1f3b-4842-9155-0b33355bd7c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:35.496235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47bdcb7-1f3b-4842-9155-0b33355bd7c3 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:35.509537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1200/2370] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:07:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 16:07:35.732970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3da646-c02d-4ced-b58c-0958a10c1e11 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:35.734402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9c3da646-c02d-4ced-b58c-0958a10c1e11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:35.751370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3da646-c02d-4ced-b58c-0958a10c1e11 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:35.757195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7b93f-8a50-43ec-a488-9b79815de78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:35.758103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7b93f-8a50-43ec-a488-9b79815de78c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:35.758390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7b93f-8a50-43ec-a488-9b79815de78c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:35.767366 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7b93f-8a50-43ec-a488-9b79815de78c admin admin] PATH_INFO: `/v3/projects/3da98f847ebc4949855869a9dbed9780` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:35.770023 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7b93f-8a50-43ec-a488-9b79815de78c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da98f847ebc4949855869a9dbed9780)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:35.772280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7b93f-8a50-43ec-a488-9b79815de78c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:35.870775 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-39e7b93f-8a50-43ec-a488-9b79815de78c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da98f847ebc4949855869a9dbed9780', 'request_id': 'req-39e7b93f-8a50-43ec-a488-9b79815de78c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:35.870775 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-39e7b93f-8a50-43ec-a488-9b79815de78c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da98f847ebc4949855869a9dbed9780', 'request_id': 'req-39e7b93f-8a50-43ec-a488-9b79815de78c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:35.879867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-39e7b93f-8a50-43ec-a488-9b79815de78c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da98f847ebc4949855869a9dbed9780', 'request_id': 'req-39e7b93f-8a50-43ec-a488-9b79815de78c'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:35.902254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-39e7b93f-8a50-43ec-a488-9b79815de78c admin admin] The token cache is being invalidate because project 3da98f847ebc4949855869a9dbed9780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:35.902703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-39e7b93f-8a50-43ec-a488-9b79815de78c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:35.904154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-39e7b93f-8a50-43ec-a488-9b79815de78c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:35.906884 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1171/2371] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:35 2022] DELETE /identity/v3/projects/3da98f847ebc4949855869a9dbed9780 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:35.911517 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bdcb7-1f3b-4842-9155-0b33355bd7c3 service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:35.926059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47bdcb7-1f3b-4842-9155-0b33355bd7c3 service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:35.998278 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:36.013117 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16927b57-8e60-49ca-b3ba-53ea13469b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:36.014726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16927b57-8e60-49ca-b3ba-53ea13469b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:36.014726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16927b57-8e60-49ca-b3ba-53ea13469b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:36.014726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16927b57-8e60-49ca-b3ba-53ea13469b34 admin admin] PATH_INFO: `/v3/users/f16281d285b44246a6dfbe1f68a22db5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:36.017180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16927b57-8e60-49ca-b3ba-53ea13469b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f16281d285b44246a6dfbe1f68a22db5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:36.020226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16927b57-8e60-49ca-b3ba-53ea13469b34 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:36.092086 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-16927b57-8e60-49ca-b3ba-53ea13469b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f16281d285b44246a6dfbe1f68a22db5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:36.139993 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-16927b57-8e60-49ca-b3ba-53ea13469b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f16281d285b44246a6dfbe1f68a22db5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:36.157673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-16927b57-8e60-49ca-b3ba-53ea13469b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f16281d285b44246a6dfbe1f68a22db5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:36.158831 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-16927b57-8e60-49ca-b3ba-53ea13469b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f16281d285b44246a6dfbe1f68a22db5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:36.174480 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-16927b57-8e60-49ca-b3ba-53ea13469b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f16281d285b44246a6dfbe1f68a22db5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:36.195782 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1201/2372] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:35 2022] DELETE /identity/v3/users/f16281d285b44246a6dfbe1f68a22db5 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:36.706363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7b93f-8a50-43ec-a488-9b79815de78c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:36.721427 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-39e7b93f-8a50-43ec-a488-9b79815de78c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:36.759464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7b93f-8a50-43ec-a488-9b79815de78c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:36.900772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ff187-7e0e-48a7-bbcf-eec5ffad29c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:36.901651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ff187-7e0e-48a7-bbcf-eec5ffad29c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:36.901934 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ff187-7e0e-48a7-bbcf-eec5ffad29c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:36.902208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ff187-7e0e-48a7-bbcf-eec5ffad29c0 admin admin] PATH_INFO: `/v3/projects/18b879003c854cf4b95885be010f5964` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:36.910621 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ff187-7e0e-48a7-bbcf-eec5ffad29c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18b879003c854cf4b95885be010f5964)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:36.912932 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991ff187-7e0e-48a7-bbcf-eec5ffad29c0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:36.986237 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:37.015085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-991ff187-7e0e-48a7-bbcf-eec5ffad29c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18b879003c854cf4b95885be010f5964', 'request_id': 'req-991ff187-7e0e-48a7-bbcf-eec5ffad29c0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:37.025836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-991ff187-7e0e-48a7-bbcf-eec5ffad29c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18b879003c854cf4b95885be010f5964', 'request_id': 'req-991ff187-7e0e-48a7-bbcf-eec5ffad29c0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:37.035297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-991ff187-7e0e-48a7-bbcf-eec5ffad29c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18b879003c854cf4b95885be010f5964', 'request_id': 'req-991ff187-7e0e-48a7-bbcf-eec5ffad29c0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:37.056696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-991ff187-7e0e-48a7-bbcf-eec5ffad29c0 admin admin] The token cache is being invalidate because project 18b879003c854cf4b95885be010f5964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:37.057282 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-991ff187-7e0e-48a7-bbcf-eec5ffad29c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:37.058223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-991ff187-7e0e-48a7-bbcf-eec5ffad29c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:37.060425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1172/2373] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:36 2022] DELETE /identity/v3/projects/18b879003c854cf4b95885be010f5964 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:37.065417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985b2a7-693c-4546-a74e-d18bd1839d94 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:37.066025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985b2a7-693c-4546-a74e-d18bd1839d94 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:37.066025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985b2a7-693c-4546-a74e-d18bd1839d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:37.104771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f985b2a7-693c-4546-a74e-d18bd1839d94 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:37.106082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f985b2a7-693c-4546-a74e-d18bd1839d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:37.302891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1202/2374] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:37.306656 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773159d5-e24c-463d-9e53-57577425ecf0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:37.306656 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773159d5-e24c-463d-9e53-57577425ecf0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:37.306656 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773159d5-e24c-463d-9e53-57577425ecf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:37.337597 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-773159d5-e24c-463d-9e53-57577425ecf0 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:37.339833 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-773159d5-e24c-463d-9e53-57577425ecf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:37.352738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1173/2375] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:37.353695 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985b2a7-693c-4546-a74e-d18bd1839d94 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:37.368203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985b2a7-693c-4546-a74e-d18bd1839d94 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:37.376517 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ebb34-0df1-40da-afb4-63a95373adeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:37.377546 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ebb34-0df1-40da-afb4-63a95373adeb admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:37.377989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ebb34-0df1-40da-afb4-63a95373adeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:37.378415 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ebb34-0df1-40da-afb4-63a95373adeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:37.379520 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ebb34-0df1-40da-afb4-63a95373adeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:07:37.379990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ebb34-0df1-40da-afb4-63a95373adeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:37.381960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ebb34-0df1-40da-afb4-63a95373adeb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:37.397908 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1203/2376] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 16:07:37.402612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773159d5-e24c-463d-9e53-57577425ecf0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:37.419642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773159d5-e24c-463d-9e53-57577425ecf0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:37.435978 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa76f0-d00a-41b5-9d72-a05bceea5939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:37.436695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa76f0-d00a-41b5-9d72-a05bceea5939 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:37.436962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa76f0-d00a-41b5-9d72-a05bceea5939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:37.437236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa76f0-d00a-41b5-9d72-a05bceea5939 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:37.437945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa76f0-d00a-41b5-9d72-a05bceea5939 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:37.443853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa76f0-d00a-41b5-9d72-a05bceea5939 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:37.500648 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1174/2377] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:37 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:37.505335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ebb34-0df1-40da-afb4-63a95373adeb admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:37.535315 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ebb34-0df1-40da-afb4-63a95373adeb admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:37.717316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691d9a4-d86a-4d59-ad59-c7f5d13778ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:37.718414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691d9a4-d86a-4d59-ad59-c7f5d13778ff admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:37.718606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691d9a4-d86a-4d59-ad59-c7f5d13778ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:37.718919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691d9a4-d86a-4d59-ad59-c7f5d13778ff admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:37.719824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691d9a4-d86a-4d59-ad59-c7f5d13778ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:37.727740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691d9a4-d86a-4d59-ad59-c7f5d13778ff admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:37.737009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:37.784364 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1204/2378] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:37 2022] POST /identity/v3/users => generated 286 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:07:37.788743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa76f0-d00a-41b5-9d72-a05bceea5939 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:37.806917 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa76f0-d00a-41b5-9d72-a05bceea5939 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:37.819493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c11c6f-7abc-4e01-82e8-8c65db1cec37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:37.820197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c11c6f-7abc-4e01-82e8-8c65db1cec37 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:37.820481 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c11c6f-7abc-4e01-82e8-8c65db1cec37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:37.821317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c11c6f-7abc-4e01-82e8-8c65db1cec37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:37.821509 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c11c6f-7abc-4e01-82e8-8c65db1cec37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:37.823222 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c11c6f-7abc-4e01-82e8-8c65db1cec37 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:37.857181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1175/2379] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:37.861124 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691d9a4-d86a-4d59-ad59-c7f5d13778ff admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:37.872634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691d9a4-d86a-4d59-ad59-c7f5d13778ff admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:37.879972 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75a128-2117-43a4-b2ec-0528da8fb7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:37.880868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75a128-2117-43a4-b2ec-0528da8fb7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:37.881224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75a128-2117-43a4-b2ec-0528da8fb7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:37.881671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75a128-2117-43a4-b2ec-0528da8fb7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:37.882528 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75a128-2117-43a4-b2ec-0528da8fb7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:37.884397 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75a128-2117-43a4-b2ec-0528da8fb7d1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:37.900759 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1205/2380] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:37.904703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c11c6f-7abc-4e01-82e8-8c65db1cec37 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:37.921246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c11c6f-7abc-4e01-82e8-8c65db1cec37 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:37.933940 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec41a0-f8da-418b-a496-48f835f466d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:37.935302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec41a0-f8da-418b-a496-48f835f466d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:37.935722 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec41a0-f8da-418b-a496-48f835f466d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:37.936493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec41a0-f8da-418b-a496-48f835f466d4 admin admin] PATH_INFO: `/v3/projects/6c1e8ba5c17642059b89490a176c1e77/users/cd4d7e6e844d444ba75a32e8c76e74c7/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:37.960290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec41a0-f8da-418b-a496-48f835f466d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c1e8ba5c17642059b89490a176c1e77, user_id=cd4d7e6e844d444ba75a32e8c76e74c7, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:37.970114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec41a0-f8da-418b-a496-48f835f466d4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:38.000437 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1176/2381] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:37 2022] PUT /identity/v3/projects/6c1e8ba5c17642059b89490a176c1e77/users/cd4d7e6e844d444ba75a32e8c76e74c7/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:38.005381 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cfeaa-4f87-4f2a-afc0-6bf52cadcd56 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:38.006180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cfeaa-4f87-4f2a-afc0-6bf52cadcd56 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:38.006758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cfeaa-4f87-4f2a-afc0-6bf52cadcd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:38.047862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-889cfeaa-4f87-4f2a-afc0-6bf52cadcd56 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:38.049221 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-889cfeaa-4f87-4f2a-afc0-6bf52cadcd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:38.191205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1206/2382] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:38.201661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec41a0-f8da-418b-a496-48f835f466d4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:38.204682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-29ec41a0-f8da-418b-a496-48f835f466d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:38.303130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec41a0-f8da-418b-a496-48f835f466d4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:38.307469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05c549-17aa-48a0-b221-9a7aa339ad00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:38.308194 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05c549-17aa-48a0-b221-9a7aa339ad00 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:38.308476 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05c549-17aa-48a0-b221-9a7aa339ad00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:38.308781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05c549-17aa-48a0-b221-9a7aa339ad00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:38.328261 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05c549-17aa-48a0-b221-9a7aa339ad00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:38.329766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05c549-17aa-48a0-b221-9a7aa339ad00 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:38.342667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1177/2383] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:40.168007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec785e-48b1-4860-bda7-c7f412e813a0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:40.168438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec785e-48b1-4860-bda7-c7f412e813a0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:40.168530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec785e-48b1-4860-bda7-c7f412e813a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:40.225452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-39ec785e-48b1-4860-bda7-c7f412e813a0 None None] MFA Rules not processed for user `cd4d7e6e844d444ba75a32e8c76e74c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:40.232247 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-39ec785e-48b1-4860-bda7-c7f412e813a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:40.371162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1207/2384] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:40.373705 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05c549-17aa-48a0-b221-9a7aa339ad00 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:40.401415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05c549-17aa-48a0-b221-9a7aa339ad00 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:40.411605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0b65d-3f69-4666-bd94-3719582ecbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:40.412625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0b65d-3f69-4666-bd94-3719582ecbd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:40.413105 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0b65d-3f69-4666-bd94-3719582ecbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:40.413546 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0b65d-3f69-4666-bd94-3719582ecbd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:40.414441 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0b65d-3f69-4666-bd94-3719582ecbd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:40.416790 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0b65d-3f69-4666-bd94-3719582ecbd8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:40.481908 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1178/2385] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:40 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:40.488799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec785e-48b1-4860-bda7-c7f412e813a0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:40.509249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec785e-48b1-4860-bda7-c7f412e813a0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:40.610561 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63187c43-28ca-45ea-a3a2-1af94887939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:40.613506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63187c43-28ca-45ea-a3a2-1af94887939b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:40.613883 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63187c43-28ca-45ea-a3a2-1af94887939b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:40.614205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63187c43-28ca-45ea-a3a2-1af94887939b admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:40.615018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63187c43-28ca-45ea-a3a2-1af94887939b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:40.617168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63187c43-28ca-45ea-a3a2-1af94887939b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:40.637180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:40.646984 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1208/2386] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:40 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:40.651685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0b65d-3f69-4666-bd94-3719582ecbd8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:40.663499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0b65d-3f69-4666-bd94-3719582ecbd8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:40.673696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac5b87-4bbf-467f-a94b-966ad9bffc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:40.674409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac5b87-4bbf-467f-a94b-966ad9bffc59 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:40.674688 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac5b87-4bbf-467f-a94b-966ad9bffc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:40.675002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac5b87-4bbf-467f-a94b-966ad9bffc59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:40.675760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac5b87-4bbf-467f-a94b-966ad9bffc59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:40.677408 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac5b87-4bbf-467f-a94b-966ad9bffc59 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:40.703260 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1179/2387] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:40.708325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63187c43-28ca-45ea-a3a2-1af94887939b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:40.725913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63187c43-28ca-45ea-a3a2-1af94887939b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:40.736637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be0160-622b-4d81-8d7a-215d4fac5e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:40.738532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be0160-622b-4d81-8d7a-215d4fac5e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:40.739157 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be0160-622b-4d81-8d7a-215d4fac5e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:40.739673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41be0160-622b-4d81-8d7a-215d4fac5e08 admin admin] PATH_INFO: `/v3/projects/f9c69691525e4884a028b3d7dc4a14de/users/1c1af503224346209f51bd23209429c0/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:40.778128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be0160-622b-4d81-8d7a-215d4fac5e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c69691525e4884a028b3d7dc4a14de, user_id=1c1af503224346209f51bd23209429c0, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:40.787647 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41be0160-622b-4d81-8d7a-215d4fac5e08 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:40.830333 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac5b87-4bbf-467f-a94b-966ad9bffc59 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:40.830794 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1209/2388] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:40 2022] PUT /identity/v3/projects/f9c69691525e4884a028b3d7dc4a14de/users/1c1af503224346209f51bd23209429c0/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:40.842528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac5b87-4bbf-467f-a94b-966ad9bffc59 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:40.864818 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:40.927072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f62bd-a096-4857-a60e-d3892f56a48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:40.930771 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f62bd-a096-4857-a60e-d3892f56a48a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:40.931294 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f62bd-a096-4857-a60e-d3892f56a48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:40.931797 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f62bd-a096-4857-a60e-d3892f56a48a admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:40.933184 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f62bd-a096-4857-a60e-d3892f56a48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:40.936806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f62bd-a096-4857-a60e-d3892f56a48a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:40.967550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be0160-622b-4d81-8d7a-215d4fac5e08 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:40.975508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1180/2389] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:40.989772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41be0160-622b-4d81-8d7a-215d4fac5e08 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:40.995956 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec105d-2f72-473d-b398-f550edf6531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:40.997106 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec105d-2f72-473d-b398-f550edf6531f admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:40.997446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec105d-2f72-473d-b398-f550edf6531f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:40.997851 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec105d-2f72-473d-b398-f550edf6531f admin admin] PATH_INFO: `/v3/projects/f9c69691525e4884a028b3d7dc4a14de/users/1c1af503224346209f51bd23209429c0/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:41.000914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec105d-2f72-473d-b398-f550edf6531f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c69691525e4884a028b3d7dc4a14de, user_id=1c1af503224346209f51bd23209429c0, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:41.004464 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec105d-2f72-473d-b398-f550edf6531f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:41.031970 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1210/2390] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:40 2022] PUT /identity/v3/projects/f9c69691525e4884a028b3d7dc4a14de/users/1c1af503224346209f51bd23209429c0/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:42.028736 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad897a-67b8-40d9-9e37-3cb5a0a00e94 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:42.029448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad897a-67b8-40d9-9e37-3cb5a0a00e94 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:42.030050 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad897a-67b8-40d9-9e37-3cb5a0a00e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:42.131472 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-78ad897a-67b8-40d9-9e37-3cb5a0a00e94 None None] MFA Rules not processed for user `1c1af503224346209f51bd23209429c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:42.131472 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-78ad897a-67b8-40d9-9e37-3cb5a0a00e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:42.280939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1181/2391] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:42.299646 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de448680-84d8-4ad7-aebc-fa9b5fab3bad None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:42.300777 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de448680-84d8-4ad7-aebc-fa9b5fab3bad None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:42.301223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de448680-84d8-4ad7-aebc-fa9b5fab3bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:42.324145 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-de448680-84d8-4ad7-aebc-fa9b5fab3bad None None] MFA Rules not processed for user `cd4d7e6e844d444ba75a32e8c76e74c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:42.325924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-de448680-84d8-4ad7-aebc-fa9b5fab3bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:42.413549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1211/2392] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:42.421659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad897a-67b8-40d9-9e37-3cb5a0a00e94 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:42.430281 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-78ad897a-67b8-40d9-9e37-3cb5a0a00e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:42.560803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad897a-67b8-40d9-9e37-3cb5a0a00e94 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:42.566896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3cc83-d1a7-4630-afce-bd8fbafd4120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:42.567631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3cc83-d1a7-4630-afce-bd8fbafd4120 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:42.568148 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3cc83-d1a7-4630-afce-bd8fbafd4120 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:42.568485 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f3cc83-d1a7-4630-afce-bd8fbafd4120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:42.579634 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3cc83-d1a7-4630-afce-bd8fbafd4120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:42.581400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f3cc83-d1a7-4630-afce-bd8fbafd4120 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:42.591820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1182/2393] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:48.128715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b2849-148a-403e-9326-842a54dc893b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:48.129320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b2849-148a-403e-9326-842a54dc893b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:48.129320 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b2849-148a-403e-9326-842a54dc893b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:48.151243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d32b2849-148a-403e-9326-842a54dc893b None None] MFA Rules not processed for user `288442cf94b84c56ad28957275fa7d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:48.152614 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d32b2849-148a-403e-9326-842a54dc893b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:48.215223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1212/2394] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:07:51.430931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3cc83-d1a7-4630-afce-bd8fbafd4120 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:51.433107 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-92f3cc83-d1a7-4630-afce-bd8fbafd4120 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:51.488062 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:51.551274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f3cc83-d1a7-4630-afce-bd8fbafd4120 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:51.558962 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a35877-623c-487d-84e6-fca48c095911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:51.560315 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a35877-623c-487d-84e6-fca48c095911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:51.560684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a35877-623c-487d-84e6-fca48c095911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:51.561150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a35877-623c-487d-84e6-fca48c095911 admin admin] PATH_INFO: `/v3/users/eed5cc638a544edcbbf0c3c3c4f1ecda` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:51.563420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a35877-623c-487d-84e6-fca48c095911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed5cc638a544edcbbf0c3c3c4f1ecda)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:51.566960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a35877-623c-487d-84e6-fca48c095911 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:51.632781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a3a35877-623c-487d-84e6-fca48c095911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed5cc638a544edcbbf0c3c3c4f1ecda'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:51.642159 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a3a35877-623c-487d-84e6-fca48c095911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed5cc638a544edcbbf0c3c3c4f1ecda'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:51.652184 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a3a35877-623c-487d-84e6-fca48c095911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed5cc638a544edcbbf0c3c3c4f1ecda'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:51.652838 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a3a35877-623c-487d-84e6-fca48c095911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed5cc638a544edcbbf0c3c3c4f1ecda'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:51.653541 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a3a35877-623c-487d-84e6-fca48c095911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed5cc638a544edcbbf0c3c3c4f1ecda'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:51.677967 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1183/2395] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:51 2022] DELETE /identity/v3/users/eed5cc638a544edcbbf0c3c3c4f1ecda => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:51.683369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc42a5-5879-41ee-9459-71f026e7c0a4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:51.684413 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc42a5-5879-41ee-9459-71f026e7c0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:51.684826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc42a5-5879-41ee-9459-71f026e7c0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:51.713733 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f5dc42a5-5879-41ee-9459-71f026e7c0a4 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:51.715867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f5dc42a5-5879-41ee-9459-71f026e7c0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:51.792716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1213/2396] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:51.803139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a35877-623c-487d-84e6-fca48c095911 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:51.804640 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a3a35877-623c-487d-84e6-fca48c095911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:51.863643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a35877-623c-487d-84e6-fca48c095911 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:51.867576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c457df8f-e59d-417a-9a21-91ab8a9ef2bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:51.868233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457df8f-e59d-417a-9a21-91ab8a9ef2bf service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:51.868511 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457df8f-e59d-417a-9a21-91ab8a9ef2bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:51.868768 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c457df8f-e59d-417a-9a21-91ab8a9ef2bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:51.878447 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457df8f-e59d-417a-9a21-91ab8a9ef2bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:51.880145 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c457df8f-e59d-417a-9a21-91ab8a9ef2bf service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:51.889942 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1184/2397] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:52.210487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc42a5-5879-41ee-9459-71f026e7c0a4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:52.213316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f5dc42a5-5879-41ee-9459-71f026e7c0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:52.238401 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc42a5-5879-41ee-9459-71f026e7c0a4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:52.252834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f4125-f4a3-4340-baf7-06f5ce467d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:52.253735 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f4125-f4a3-4340-baf7-06f5ce467d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:52.254021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f4125-f4a3-4340-baf7-06f5ce467d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:52.254290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f4125-f4a3-4340-baf7-06f5ce467d44 admin admin] PATH_INFO: `/v3/projects/d83db8a3b28a4763a6b57e2e7665cbd5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:52.256120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f4125-f4a3-4340-baf7-06f5ce467d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83db8a3b28a4763a6b57e2e7665cbd5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:52.261568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f4125-f4a3-4340-baf7-06f5ce467d44 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:52.274257 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:52.348344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f24f4125-f4a3-4340-baf7-06f5ce467d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83db8a3b28a4763a6b57e2e7665cbd5', 'request_id': 'req-f24f4125-f4a3-4340-baf7-06f5ce467d44'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:52.362690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f24f4125-f4a3-4340-baf7-06f5ce467d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83db8a3b28a4763a6b57e2e7665cbd5', 'request_id': 'req-f24f4125-f4a3-4340-baf7-06f5ce467d44'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:52.371782 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f24f4125-f4a3-4340-baf7-06f5ce467d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83db8a3b28a4763a6b57e2e7665cbd5', 'request_id': 'req-f24f4125-f4a3-4340-baf7-06f5ce467d44'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:52.384454 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f24f4125-f4a3-4340-baf7-06f5ce467d44 admin admin] The token cache is being invalidate because project d83db8a3b28a4763a6b57e2e7665cbd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:52.384735 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f24f4125-f4a3-4340-baf7-06f5ce467d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:52.386302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f24f4125-f4a3-4340-baf7-06f5ce467d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:52.389983 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1214/2398] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:52 2022] DELETE /identity/v3/projects/d83db8a3b28a4763a6b57e2e7665cbd5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:52.395139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d6f3a-e8e6-47f5-8dba-7d53d2416de6 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:52.395443 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d6f3a-e8e6-47f5-8dba-7d53d2416de6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:52.395701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d6f3a-e8e6-47f5-8dba-7d53d2416de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:52.415222 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e98d6f3a-e8e6-47f5-8dba-7d53d2416de6 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:52.416668 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e98d6f3a-e8e6-47f5-8dba-7d53d2416de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:52.479935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:52.506866 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1185/2399] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:52.514956 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68393b5-6767-49df-8fd7-1079c0020224 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:52.515256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68393b5-6767-49df-8fd7-1079c0020224 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:52.515538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68393b5-6767-49df-8fd7-1079c0020224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:52.543550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c68393b5-6767-49df-8fd7-1079c0020224 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:52.545152 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c68393b5-6767-49df-8fd7-1079c0020224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:52.558294 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1215/2400] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:52.558991 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d6f3a-e8e6-47f5-8dba-7d53d2416de6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:52.574947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d6f3a-e8e6-47f5-8dba-7d53d2416de6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:52.581047 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a125b38-6a2a-4aa9-9171-31efc5985b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:52.581709 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a125b38-6a2a-4aa9-9171-31efc5985b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:52.581989 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a125b38-6a2a-4aa9-9171-31efc5985b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:52.582264 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a125b38-6a2a-4aa9-9171-31efc5985b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:52.583082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a125b38-6a2a-4aa9-9171-31efc5985b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:07:52.583397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a125b38-6a2a-4aa9-9171-31efc5985b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:52.585055 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a125b38-6a2a-4aa9-9171-31efc5985b17 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:52.608224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1186/2401] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 16:07:52.613103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68393b5-6767-49df-8fd7-1079c0020224 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:52.625836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68393b5-6767-49df-8fd7-1079c0020224 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:52.633264 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2879fe-efa1-48c6-a05d-5d9e5c8cbc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:52.633969 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2879fe-efa1-48c6-a05d-5d9e5c8cbc70 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:52.634249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2879fe-efa1-48c6-a05d-5d9e5c8cbc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:52.634524 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2879fe-efa1-48c6-a05d-5d9e5c8cbc70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:52.635349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2879fe-efa1-48c6-a05d-5d9e5c8cbc70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:52.637617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2879fe-efa1-48c6-a05d-5d9e5c8cbc70 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:52.679942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1216/2402] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:52 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:52.685470 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a125b38-6a2a-4aa9-9171-31efc5985b17 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:52.703697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a125b38-6a2a-4aa9-9171-31efc5985b17 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:52.819183 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2c355-2a4f-4b5f-9b92-f7c7a2c93100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:52.832189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2c355-2a4f-4b5f-9b92-f7c7a2c93100 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:52.832811 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2c355-2a4f-4b5f-9b92-f7c7a2c93100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:52.833403 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2c355-2a4f-4b5f-9b92-f7c7a2c93100 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:52.834720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2c355-2a4f-4b5f-9b92-f7c7a2c93100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:52.837070 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2c355-2a4f-4b5f-9b92-f7c7a2c93100 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:52.867916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1187/2403] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:52 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:07:52.872595 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2879fe-efa1-48c6-a05d-5d9e5c8cbc70 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:52.889857 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2879fe-efa1-48c6-a05d-5d9e5c8cbc70 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:52.896974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec0ce4-23c4-4bca-846f-5e3d14904c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:52.897669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec0ce4-23c4-4bca-846f-5e3d14904c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:52.897950 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec0ce4-23c4-4bca-846f-5e3d14904c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:52.898226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec0ce4-23c4-4bca-846f-5e3d14904c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:52.899027 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec0ce4-23c4-4bca-846f-5e3d14904c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:52.900946 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec0ce4-23c4-4bca-846f-5e3d14904c90 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:52.930808 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1217/2404] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:52.934876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2c355-2a4f-4b5f-9b92-f7c7a2c93100 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:52.956146 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2c355-2a4f-4b5f-9b92-f7c7a2c93100 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:52.959054 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616df544-431c-47c5-be37-9dcf8074e52b None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:52.960005 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616df544-431c-47c5-be37-9dcf8074e52b None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:52.960451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616df544-431c-47c5-be37-9dcf8074e52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:52.973019 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b813-83e8-4810-a7e0-62fc706e5d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:52.973822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b813-83e8-4810-a7e0-62fc706e5d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:52.974242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b813-83e8-4810-a7e0-62fc706e5d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:52.974453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497b813-83e8-4810-a7e0-62fc706e5d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:52.975474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497b813-83e8-4810-a7e0-62fc706e5d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:52.978974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497b813-83e8-4810-a7e0-62fc706e5d81 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:52.999025 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1188/2405] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:07:52.999268 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-616df544-431c-47c5-be37-9dcf8074e52b None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:53.000043 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b813-83e8-4810-a7e0-62fc706e5d81 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:53.000515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-616df544-431c-47c5-be37-9dcf8074e52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:53.018948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497b813-83e8-4810-a7e0-62fc706e5d81 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:53.032394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdd188-937d-4073-aecc-22024dbe67dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:53.032394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdd188-937d-4073-aecc-22024dbe67dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:53.032394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdd188-937d-4073-aecc-22024dbe67dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:53.032394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdd188-937d-4073-aecc-22024dbe67dd admin admin] PATH_INFO: `/v3/projects/568b4beb25db4fe19b9042b9b075e57f/users/6c9dcf3a630844da9b6fedeebdb4bf8b/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:53.053451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdd188-937d-4073-aecc-22024dbe67dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=568b4beb25db4fe19b9042b9b075e57f, user_id=6c9dcf3a630844da9b6fedeebdb4bf8b, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:53.057404 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdd188-937d-4073-aecc-22024dbe67dd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:53.075010 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1189/2406] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:52 2022] PUT /identity/v3/projects/568b4beb25db4fe19b9042b9b075e57f/users/6c9dcf3a630844da9b6fedeebdb4bf8b/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:53.088111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6e2da-9e2c-4ae7-8abf-9ce166f2b174 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:53.088645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6e2da-9e2c-4ae7-8abf-9ce166f2b174 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:53.089092 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6e2da-9e2c-4ae7-8abf-9ce166f2b174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:53.091884 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1218/2407] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 16:07:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:07:53.109826 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616df544-431c-47c5-be37-9dcf8074e52b None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:53.116285 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-616df544-431c-47c5-be37-9dcf8074e52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:53.135370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-acb6e2da-9e2c-4ae7-8abf-9ce166f2b174 None None] MFA Rules not processed for user `6c9dcf3a630844da9b6fedeebdb4bf8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:53.136740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-acb6e2da-9e2c-4ae7-8abf-9ce166f2b174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:53.232329 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:53.240766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616df544-431c-47c5-be37-9dcf8074e52b None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:53.255102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1190/2408] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:07:53.259927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6e2da-9e2c-4ae7-8abf-9ce166f2b174 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:53.293242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:53.337319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eeb69-51b6-4c92-b17a-dde6eda2ca40 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:53.338271 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eeb69-51b6-4c92-b17a-dde6eda2ca40 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:53.338560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eeb69-51b6-4c92-b17a-dde6eda2ca40 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:53.338959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95eeb69-51b6-4c92-b17a-dde6eda2ca40 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:53.405313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6e2da-9e2c-4ae7-8abf-9ce166f2b174 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:53.414346 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8630a-ee3b-4f9d-a91b-cb09bfb75b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:53.415260 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8630a-ee3b-4f9d-a91b-cb09bfb75b6d admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:53.415624 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8630a-ee3b-4f9d-a91b-cb09bfb75b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:53.415973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8630a-ee3b-4f9d-a91b-cb09bfb75b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:53.417223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8630a-ee3b-4f9d-a91b-cb09bfb75b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:53.420927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb8630a-ee3b-4f9d-a91b-cb09bfb75b6d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:53.462910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1191/2409] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:53 2022] POST /identity/v3/projects => generated 375 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:53.466695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8630a-ee3b-4f9d-a91b-cb09bfb75b6d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:53.470265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95eeb69-51b6-4c92-b17a-dde6eda2ca40 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:53.472121 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95eeb69-51b6-4c92-b17a-dde6eda2ca40 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:53.485449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1219/2410] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:07:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 16:07:53.575756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8630a-ee3b-4f9d-a91b-cb09bfb75b6d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:53.582675 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c7d11-c989-446c-a0f1-248caf526359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:53.585539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c7d11-c989-446c-a0f1-248caf526359 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:53.585539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c7d11-c989-446c-a0f1-248caf526359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:53.585539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c7d11-c989-446c-a0f1-248caf526359 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:53.585539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c7d11-c989-446c-a0f1-248caf526359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:53.587536 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c7d11-c989-446c-a0f1-248caf526359 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:53.619127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1192/2411] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:53 2022] POST /identity/v3/users => generated 288 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:07:53.621253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eeb69-51b6-4c92-b17a-dde6eda2ca40 service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:53.643303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95eeb69-51b6-4c92-b17a-dde6eda2ca40 service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:53.665179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb1d87-9f34-44af-83a5-de6592b7aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:53.670680 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb1d87-9f34-44af-83a5-de6592b7aebf admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:53.671579 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb1d87-9f34-44af-83a5-de6592b7aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:53.674892 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb1d87-9f34-44af-83a5-de6592b7aebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:53.678748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb1d87-9f34-44af-83a5-de6592b7aebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:53.694263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb1d87-9f34-44af-83a5-de6592b7aebf admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:53.740624 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c7d11-c989-446c-a0f1-248caf526359 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:53.750238 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1220/2412] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:53.765355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c7d11-c989-446c-a0f1-248caf526359 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:53.781836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edd817d-10e4-45c1-84aa-b22fc6f93b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:53.786763 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd817d-10e4-45c1-84aa-b22fc6f93b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:53.786763 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd817d-10e4-45c1-84aa-b22fc6f93b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:53.786763 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edd817d-10e4-45c1-84aa-b22fc6f93b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:53.786763 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd817d-10e4-45c1-84aa-b22fc6f93b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:53.789695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edd817d-10e4-45c1-84aa-b22fc6f93b4c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:53.810367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1193/2413] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:53.820687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb1d87-9f34-44af-83a5-de6592b7aebf admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:53.836401 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb1d87-9f34-44af-83a5-de6592b7aebf admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:53.868745 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310febbb-1bb2-44a8-b68f-c8799c28922c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:53.869942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310febbb-1bb2-44a8-b68f-c8799c28922c admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:53.870918 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310febbb-1bb2-44a8-b68f-c8799c28922c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:53.870918 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310febbb-1bb2-44a8-b68f-c8799c28922c admin admin] PATH_INFO: `/v3/projects/c0b4fdcf89204223961df1349b02c0b7/users/b55515c6e2f8456dbf02d0e7f0167749/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:53.921552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310febbb-1bb2-44a8-b68f-c8799c28922c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b4fdcf89204223961df1349b02c0b7, user_id=b55515c6e2f8456dbf02d0e7f0167749, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:53.924559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310febbb-1bb2-44a8-b68f-c8799c28922c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:53.968874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18a9db-0ae5-4248-afe3-e0550dfc622f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:53.969671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18a9db-0ae5-4248-afe3-e0550dfc622f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:53.969671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f18a9db-0ae5-4248-afe3-e0550dfc622f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:53.981325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1221/2414] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:53 2022] PUT /identity/v3/projects/c0b4fdcf89204223961df1349b02c0b7/users/b55515c6e2f8456dbf02d0e7f0167749/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:54.080265 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3f18a9db-0ae5-4248-afe3-e0550dfc622f None None] MFA Rules not processed for user `b55515c6e2f8456dbf02d0e7f0167749`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:54.081500 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3f18a9db-0ae5-4248-afe3-e0550dfc622f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:54.265710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310febbb-1bb2-44a8-b68f-c8799c28922c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:54.268843 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1194/2415] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:54.391556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310febbb-1bb2-44a8-b68f-c8799c28922c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:54.404605 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153539dc-c12b-4cb8-80bf-e76b0e3c1940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:54.406273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153539dc-c12b-4cb8-80bf-e76b0e3c1940 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:54.406715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153539dc-c12b-4cb8-80bf-e76b0e3c1940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:54.406885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153539dc-c12b-4cb8-80bf-e76b0e3c1940 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:54.407957 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153539dc-c12b-4cb8-80bf-e76b0e3c1940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:54.419408 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153539dc-c12b-4cb8-80bf-e76b0e3c1940 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:54.441022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:54.469666 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1222/2416] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:07:54 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:07:54.474445 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18a9db-0ae5-4248-afe3-e0550dfc622f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:54.491745 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f18a9db-0ae5-4248-afe3-e0550dfc622f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:54.507505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:54.589687 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb02b7a-36af-4afc-ba8f-870ec93c2b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:54.591027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb02b7a-36af-4afc-ba8f-870ec93c2b6c admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:54.591311 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb02b7a-36af-4afc-ba8f-870ec93c2b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:54.591586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb02b7a-36af-4afc-ba8f-870ec93c2b6c admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:54.592941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb02b7a-36af-4afc-ba8f-870ec93c2b6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:54.595267 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb02b7a-36af-4afc-ba8f-870ec93c2b6c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:54.622092 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1195/2417] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:07:54 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:07:54.628529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153539dc-c12b-4cb8-80bf-e76b0e3c1940 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:54.655749 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153539dc-c12b-4cb8-80bf-e76b0e3c1940 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:54.663135 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82dd9f-86cd-4ee0-b91c-f6f2af9c95a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:54.665474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82dd9f-86cd-4ee0-b91c-f6f2af9c95a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:54.665828 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82dd9f-86cd-4ee0-b91c-f6f2af9c95a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:54.666611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b82dd9f-86cd-4ee0-b91c-f6f2af9c95a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:54.667570 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82dd9f-86cd-4ee0-b91c-f6f2af9c95a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:54.671916 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b82dd9f-86cd-4ee0-b91c-f6f2af9c95a7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:54.689836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1223/2418] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:54.691300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb02b7a-36af-4afc-ba8f-870ec93c2b6c admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:54.706267 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb02b7a-36af-4afc-ba8f-870ec93c2b6c admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:54.714519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2c93c-ab0d-4785-9e4e-42050b6e16f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:54.715478 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2c93c-ab0d-4785-9e4e-42050b6e16f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:54.715765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2c93c-ab0d-4785-9e4e-42050b6e16f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:54.716042 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2c93c-ab0d-4785-9e4e-42050b6e16f9 admin admin] PATH_INFO: `/v3/projects/da6140e8578f4122a30a33b182a68c05/users/928e6041ab6e44298f012af75e02e61a/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:54.735022 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2c93c-ab0d-4785-9e4e-42050b6e16f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6140e8578f4122a30a33b182a68c05, user_id=928e6041ab6e44298f012af75e02e61a, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:54.750145 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2c93c-ab0d-4785-9e4e-42050b6e16f9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:54.769668 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1196/2419] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:54 2022] PUT /identity/v3/projects/da6140e8578f4122a30a33b182a68c05/users/928e6041ab6e44298f012af75e02e61a/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:54.773588 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82dd9f-86cd-4ee0-b91c-f6f2af9c95a7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:54.785946 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b82dd9f-86cd-4ee0-b91c-f6f2af9c95a7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:54.857103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71028f4-b58c-4363-8f16-87de4028e7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:54.857807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71028f4-b58c-4363-8f16-87de4028e7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:54.858662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71028f4-b58c-4363-8f16-87de4028e7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:54.858662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71028f4-b58c-4363-8f16-87de4028e7a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:54.859325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71028f4-b58c-4363-8f16-87de4028e7a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:54.866743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71028f4-b58c-4363-8f16-87de4028e7a2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:54.885242 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1224/2420] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:07:54.886012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2c93c-ab0d-4785-9e4e-42050b6e16f9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:54.897539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2c93c-ab0d-4785-9e4e-42050b6e16f9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:54.905810 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f15d45-a80d-4476-a951-6851182636c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:54.906909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f15d45-a80d-4476-a951-6851182636c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:54.907306 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f15d45-a80d-4476-a951-6851182636c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:54.907646 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f15d45-a80d-4476-a951-6851182636c1 admin admin] PATH_INFO: `/v3/projects/da6140e8578f4122a30a33b182a68c05/users/928e6041ab6e44298f012af75e02e61a/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:54.909923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f15d45-a80d-4476-a951-6851182636c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6140e8578f4122a30a33b182a68c05, user_id=928e6041ab6e44298f012af75e02e61a, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:54.912839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f15d45-a80d-4476-a951-6851182636c1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:54.929797 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1197/2421] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:07:54 2022] PUT /identity/v3/projects/da6140e8578f4122a30a33b182a68c05/users/928e6041ab6e44298f012af75e02e61a/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:07:54.941672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95bbc5-b9b6-4ab5-90ff-41b5637043d9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:54.943336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95bbc5-b9b6-4ab5-90ff-41b5637043d9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:54.944159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95bbc5-b9b6-4ab5-90ff-41b5637043d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:54.978901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2c95bbc5-b9b6-4ab5-90ff-41b5637043d9 None None] MFA Rules not processed for user `928e6041ab6e44298f012af75e02e61a`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:54.980393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2c95bbc5-b9b6-4ab5-90ff-41b5637043d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:55.068763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1225/2422] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:55.082155 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f15d45-a80d-4476-a951-6851182636c1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:55.085197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-68f15d45-a80d-4476-a951-6851182636c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:55.161338 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f15d45-a80d-4476-a951-6851182636c1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:55.165172 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f642922-b8a7-4a6f-a927-0d9a1dc74df5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:55.165867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f642922-b8a7-4a6f-a927-0d9a1dc74df5 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:55.166150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f642922-b8a7-4a6f-a927-0d9a1dc74df5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:55.166427 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f642922-b8a7-4a6f-a927-0d9a1dc74df5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:55.229641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f642922-b8a7-4a6f-a927-0d9a1dc74df5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:55.231130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f642922-b8a7-4a6f-a927-0d9a1dc74df5 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:55.240868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1198/2423] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:55.837025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3dc83-a066-49a9-af7f-4bb5af470529 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:55.837302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3dc83-a066-49a9-af7f-4bb5af470529 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:55.837594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3dc83-a066-49a9-af7f-4bb5af470529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:55.858346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e2d3dc83-a066-49a9-af7f-4bb5af470529 None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:55.859633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e2d3dc83-a066-49a9-af7f-4bb5af470529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:55.922431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1226/2424] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 16:07:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:55.935553 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f642922-b8a7-4a6f-a927-0d9a1dc74df5 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:55.960025 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:56.016343 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f642922-b8a7-4a6f-a927-0d9a1dc74df5 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:56.021975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a6dfc-5ed6-4c33-90ef-3afbe8007652 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:56.022647 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a6dfc-5ed6-4c33-90ef-3afbe8007652 service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:56.022971 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a6dfc-5ed6-4c33-90ef-3afbe8007652 service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:56.023247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6a6dfc-5ed6-4c33-90ef-3afbe8007652 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:56.032061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a6dfc-5ed6-4c33-90ef-3afbe8007652 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:56.033705 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6a6dfc-5ed6-4c33-90ef-3afbe8007652 service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:56.042214 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1199/2425] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:07:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 16:07:56.602471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3dc83-a066-49a9-af7f-4bb5af470529 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:56.604718 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e2d3dc83-a066-49a9-af7f-4bb5af470529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:56.626502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:56.731903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3dc83-a066-49a9-af7f-4bb5af470529 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:56.745872 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd95fc1-204f-433b-8a13-62f9c3679b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:56.746808 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd95fc1-204f-433b-8a13-62f9c3679b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:56.747543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd95fc1-204f-433b-8a13-62f9c3679b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:56.747543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd95fc1-204f-433b-8a13-62f9c3679b09 admin admin] PATH_INFO: `/v3/users/d9c3721a79b64380aae2781650c39645` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:56.750642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd95fc1-204f-433b-8a13-62f9c3679b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c3721a79b64380aae2781650c39645)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:56.753358 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd95fc1-204f-433b-8a13-62f9c3679b09 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:56.831141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a6dfc-5ed6-4c33-90ef-3afbe8007652 service swift] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:56.832895 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ae6a6dfc-5ed6-4c33-90ef-3afbe8007652 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:56.851080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1dd95fc1-204f-433b-8a13-62f9c3679b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c3721a79b64380aae2781650c39645'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:56.855906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6a6dfc-5ed6-4c33-90ef-3afbe8007652 service swift] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:56.863793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc914-7e4d-4b09-82ce-85772418b7e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:56.864960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc914-7e4d-4b09-82ce-85772418b7e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:56.866725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc914-7e4d-4b09-82ce-85772418b7e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:56.867899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbc914-7e4d-4b09-82ce-85772418b7e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:56.880919 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1dd95fc1-204f-433b-8a13-62f9c3679b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c3721a79b64380aae2781650c39645'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:56.898293 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1dd95fc1-204f-433b-8a13-62f9c3679b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c3721a79b64380aae2781650c39645'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:56.899025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1dd95fc1-204f-433b-8a13-62f9c3679b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c3721a79b64380aae2781650c39645'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:56.914293 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-1dd95fc1-204f-433b-8a13-62f9c3679b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c3721a79b64380aae2781650c39645'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:56.942877 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1227/2426] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:07:56 2022] DELETE /identity/v3/users/d9c3721a79b64380aae2781650c39645 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:56.949127 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cc9bc-3b77-4d84-9c56-20dcf6f66132 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:56.949429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cc9bc-3b77-4d84-9c56-20dcf6f66132 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:56.950037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cc9bc-3b77-4d84-9c56-20dcf6f66132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:57.005114 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a40cc9bc-3b77-4d84-9c56-20dcf6f66132 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:57.007795 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a40cc9bc-3b77-4d84-9c56-20dcf6f66132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:57.040743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbc914-7e4d-4b09-82ce-85772418b7e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:57.048330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efbc914-7e4d-4b09-82ce-85772418b7e4 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:57.073099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1200/2427] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:57.115861 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1228/2428] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:07:57.133571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc914-7e4d-4b09-82ce-85772418b7e4 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:57.135818 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6efbc914-7e4d-4b09-82ce-85772418b7e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:57.314060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbc914-7e4d-4b09-82ce-85772418b7e4 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:57.513344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea110e3-165f-40b1-bbe3-e5a500ec6067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:57.514361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea110e3-165f-40b1-bbe3-e5a500ec6067 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:57.514905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea110e3-165f-40b1-bbe3-e5a500ec6067 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:57.515365 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea110e3-165f-40b1-bbe3-e5a500ec6067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:57.541494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea110e3-165f-40b1-bbe3-e5a500ec6067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:57.543874 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea110e3-165f-40b1-bbe3-e5a500ec6067 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:57.572020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1201/2429] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:58.789860 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cc9bc-3b77-4d84-9c56-20dcf6f66132 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:58.791497 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a40cc9bc-3b77-4d84-9c56-20dcf6f66132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:58.862908 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:58.933788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cc9bc-3b77-4d84-9c56-20dcf6f66132 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:58.938992 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dba16-368d-4b79-8d7f-64d8f8242fdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:58.940066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dba16-368d-4b79-8d7f-64d8f8242fdf service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:58.940533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dba16-368d-4b79-8d7f-64d8f8242fdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:58.940985 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dba16-368d-4b79-8d7f-64d8f8242fdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:58.950876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d52dba16-368d-4b79-8d7f-64d8f8242fdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:59.063896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dba16-368d-4b79-8d7f-64d8f8242fdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:59.065762 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dba16-368d-4b79-8d7f-64d8f8242fdf service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:59.082294 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1229/2430] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:07:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:07:59.564048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea110e3-165f-40b1-bbe3-e5a500ec6067 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:07:59.565522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1ea110e3-165f-40b1-bbe3-e5a500ec6067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:07:59.595602 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea110e3-165f-40b1-bbe3-e5a500ec6067 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:07:59.605710 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2de12f-0fb8-42bd-9d30-fcd1465c8d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:07:59.607135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2de12f-0fb8-42bd-9d30-fcd1465c8d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:59.607135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2de12f-0fb8-42bd-9d30-fcd1465c8d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:59.607662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2de12f-0fb8-42bd-9d30-fcd1465c8d03 admin admin] PATH_INFO: `/v3/projects/0711e63b0e3c4a079d6299966c471207` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:59.608463 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2de12f-0fb8-42bd-9d30-fcd1465c8d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0711e63b0e3c4a079d6299966c471207)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:07:59.611100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2de12f-0fb8-42bd-9d30-fcd1465c8d03 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:07:59.613166 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:07:59.776317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ee2de12f-0fb8-42bd-9d30-fcd1465c8d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0711e63b0e3c4a079d6299966c471207', 'request_id': 'req-ee2de12f-0fb8-42bd-9d30-fcd1465c8d03'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:59.808549 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ee2de12f-0fb8-42bd-9d30-fcd1465c8d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0711e63b0e3c4a079d6299966c471207', 'request_id': 'req-ee2de12f-0fb8-42bd-9d30-fcd1465c8d03'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:59.808549 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ee2de12f-0fb8-42bd-9d30-fcd1465c8d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0711e63b0e3c4a079d6299966c471207', 'request_id': 'req-ee2de12f-0fb8-42bd-9d30-fcd1465c8d03'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:59.847097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ee2de12f-0fb8-42bd-9d30-fcd1465c8d03 admin admin] The token cache is being invalidate because project 0711e63b0e3c4a079d6299966c471207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:07:59.847505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ee2de12f-0fb8-42bd-9d30-fcd1465c8d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:59.848073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-ee2de12f-0fb8-42bd-9d30-fcd1465c8d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:07:59.853877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1202/2431] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:07:59 2022] DELETE /identity/v3/projects/0711e63b0e3c4a079d6299966c471207 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:07:59.855837 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c542baa-c17c-4634-b336-37bbac410c9a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:07:59.856518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c542baa-c17c-4634-b336-37bbac410c9a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:07:59.856518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c542baa-c17c-4634-b336-37bbac410c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:07:59.898922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9c542baa-c17c-4634-b336-37bbac410c9a None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:07:59.900239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9c542baa-c17c-4634-b336-37bbac410c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:00.037328 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1230/2432] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:00.039247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c604e-a6a6-4ee1-be1b-79fe52ec1a16 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:00.039588 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c604e-a6a6-4ee1-be1b-79fe52ec1a16 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:00.039952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c604e-a6a6-4ee1-be1b-79fe52ec1a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:00.095960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-f04c604e-a6a6-4ee1-be1b-79fe52ec1a16 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:00.097622 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f04c604e-a6a6-4ee1-be1b-79fe52ec1a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:00.121632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1203/2433] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:00.130424 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c542baa-c17c-4634-b336-37bbac410c9a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:00.150282 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c542baa-c17c-4634-b336-37bbac410c9a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:00.166757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cbc72-9770-4a37-9849-38750611c9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:00.167661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cbc72-9770-4a37-9849-38750611c9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:00.168045 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cbc72-9770-4a37-9849-38750611c9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:00.168848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cbc72-9770-4a37-9849-38750611c9d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:00.169815 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cbc72-9770-4a37-9849-38750611c9d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:08:00.170218 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cbc72-9770-4a37-9849-38750611c9d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:00.174954 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425cbc72-9770-4a37-9849-38750611c9d1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:00.196287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1231/2434] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:08:00.200471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c604e-a6a6-4ee1-be1b-79fe52ec1a16 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:00.239027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c604e-a6a6-4ee1-be1b-79fe52ec1a16 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:00.259682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfac245-2e92-4e4b-bcdc-f33288a699c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:00.261432 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfac245-2e92-4e4b-bcdc-f33288a699c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:00.264778 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfac245-2e92-4e4b-bcdc-f33288a699c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:00.266013 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfac245-2e92-4e4b-bcdc-f33288a699c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:00.268008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfac245-2e92-4e4b-bcdc-f33288a699c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:00.272400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfac245-2e92-4e4b-bcdc-f33288a699c8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:00.379585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1204/2435] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:08:00 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:08:00.388746 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cbc72-9770-4a37-9849-38750611c9d1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:00.411330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cbc72-9770-4a37-9849-38750611c9d1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:00.507581 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd8905-bb53-423b-bd85-de6ce6d42e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:00.508850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd8905-bb53-423b-bd85-de6ce6d42e5a admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:00.509330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd8905-bb53-423b-bd85-de6ce6d42e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:00.509771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd8905-bb53-423b-bd85-de6ce6d42e5a admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:00.510929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd8905-bb53-423b-bd85-de6ce6d42e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:00.513539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd8905-bb53-423b-bd85-de6ce6d42e5a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:00.528506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:00.559705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1232/2436] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:08:00 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:08:00.560852 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfac245-2e92-4e4b-bcdc-f33288a699c8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:00.585900 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfac245-2e92-4e4b-bcdc-f33288a699c8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:00.596939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439244b1-27f8-4317-94dc-87d8d456dcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:00.599081 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439244b1-27f8-4317-94dc-87d8d456dcdf admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:00.599444 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439244b1-27f8-4317-94dc-87d8d456dcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:00.600765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439244b1-27f8-4317-94dc-87d8d456dcdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:00.601586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439244b1-27f8-4317-94dc-87d8d456dcdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:00.607819 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439244b1-27f8-4317-94dc-87d8d456dcdf admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:00.639132 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1205/2437] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:08:00.640411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd8905-bb53-423b-bd85-de6ce6d42e5a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:00.661234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd8905-bb53-423b-bd85-de6ce6d42e5a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:00.685983 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e7e54-1bdd-4673-a60b-227b650da704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:00.686743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e7e54-1bdd-4673-a60b-227b650da704 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:00.687088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e7e54-1bdd-4673-a60b-227b650da704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:00.687422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e7e54-1bdd-4673-a60b-227b650da704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:00.691193 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e7e54-1bdd-4673-a60b-227b650da704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:00.693624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e7e54-1bdd-4673-a60b-227b650da704 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:00.748328 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1233/2438] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:08:00.749196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439244b1-27f8-4317-94dc-87d8d456dcdf admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:00.764776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439244b1-27f8-4317-94dc-87d8d456dcdf admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:00.788841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1349d-db25-4544-86af-d75ceec4ca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:00.788841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1349d-db25-4544-86af-d75ceec4ca7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:00.788841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1349d-db25-4544-86af-d75ceec4ca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:00.789255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1349d-db25-4544-86af-d75ceec4ca7f admin admin] PATH_INFO: `/v3/projects/87dda33415dc45379a121777b27587f3/users/b594d553e4c44758b3fc653f19546705/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:00.821351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1349d-db25-4544-86af-d75ceec4ca7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=87dda33415dc45379a121777b27587f3, user_id=b594d553e4c44758b3fc653f19546705, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:00.824150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1349d-db25-4544-86af-d75ceec4ca7f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:00.846857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1206/2439] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:08:00 2022] PUT /identity/v3/projects/87dda33415dc45379a121777b27587f3/users/b594d553e4c44758b3fc653f19546705/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:08:00.866942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b766ab-cead-423c-a4b0-e3d1f4f6f829 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:00.866942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b766ab-cead-423c-a4b0-e3d1f4f6f829 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:00.866942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b766ab-cead-423c-a4b0-e3d1f4f6f829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:00.920424 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-97b766ab-cead-423c-a4b0-e3d1f4f6f829 None None] MFA Rules not processed for user `b594d553e4c44758b3fc653f19546705`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:00.921740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-97b766ab-cead-423c-a4b0-e3d1f4f6f829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:01.093701 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1234/2440] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:08:01.106153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1349d-db25-4544-86af-d75ceec4ca7f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:01.108950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-99a1349d-db25-4544-86af-d75ceec4ca7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:01.251094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1349d-db25-4544-86af-d75ceec4ca7f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:01.254723 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fab03b-fed3-4815-a6e4-f42e545356f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:01.255423 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab03b-fed3-4815-a6e4-f42e545356f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:01.255749 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab03b-fed3-4815-a6e4-f42e545356f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:01.255980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fab03b-fed3-4815-a6e4-f42e545356f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:01.265297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fab03b-fed3-4815-a6e4-f42e545356f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:01.266973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fab03b-fed3-4815-a6e4-f42e545356f8 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:01.286707 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1207/2441] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:08:01.304287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b766ab-cead-423c-a4b0-e3d1f4f6f829 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:01.378875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b766ab-cead-423c-a4b0-e3d1f4f6f829 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:01.384204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ce22d-5a2c-4bec-9eb3-63397293d626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:01.385152 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ce22d-5a2c-4bec-9eb3-63397293d626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:01.385438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ce22d-5a2c-4bec-9eb3-63397293d626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:01.385717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ce22d-5a2c-4bec-9eb3-63397293d626 admin admin] PATH_INFO: `/v3/users/b594d553e4c44758b3fc653f19546705` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:01.387176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ce22d-5a2c-4bec-9eb3-63397293d626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b594d553e4c44758b3fc653f19546705)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:01.389335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ce22d-5a2c-4bec-9eb3-63397293d626 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:01.446800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-de6ce22d-5a2c-4bec-9eb3-63397293d626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b594d553e4c44758b3fc653f19546705'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:01.478224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-de6ce22d-5a2c-4bec-9eb3-63397293d626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b594d553e4c44758b3fc653f19546705'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:01.497913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-de6ce22d-5a2c-4bec-9eb3-63397293d626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b594d553e4c44758b3fc653f19546705'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:01.499324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-de6ce22d-5a2c-4bec-9eb3-63397293d626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b594d553e4c44758b3fc653f19546705'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:01.548917 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:01.576378 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-de6ce22d-5a2c-4bec-9eb3-63397293d626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b594d553e4c44758b3fc653f19546705'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:01.608110 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2809d6-50e6-40ac-99ab-d1f70576494e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:01.609066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1235/2442] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:08:01 2022] DELETE /identity/v3/users/b594d553e4c44758b3fc653f19546705 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:01.609255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2809d6-50e6-40ac-99ab-d1f70576494e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:01.609255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2809d6-50e6-40ac-99ab-d1f70576494e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:01.640676 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5a2809d6-50e6-40ac-99ab-d1f70576494e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:01.642529 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5a2809d6-50e6-40ac-99ab-d1f70576494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:01.707109 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:01.785308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1208/2443] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:01.797840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ce22d-5a2c-4bec-9eb3-63397293d626 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:01.799706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-de6ce22d-5a2c-4bec-9eb3-63397293d626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:01.943206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ce22d-5a2c-4bec-9eb3-63397293d626 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:01.962973 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141fa5d-592d-4f5f-948c-f42578f29a0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:01.962973 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141fa5d-592d-4f5f-948c-f42578f29a0a service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:01.963304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141fa5d-592d-4f5f-948c-f42578f29a0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:01.963574 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141fa5d-592d-4f5f-948c-f42578f29a0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:01.984176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141fa5d-592d-4f5f-948c-f42578f29a0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:01.986230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141fa5d-592d-4f5f-948c-f42578f29a0a service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:02.047337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1236/2444] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:08:02.713791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2809d6-50e6-40ac-99ab-d1f70576494e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:02.715454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5a2809d6-50e6-40ac-99ab-d1f70576494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:02.748735 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2809d6-50e6-40ac-99ab-d1f70576494e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:02.760229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b7fe1-f2a7-466b-8b17-fa964f5e9230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:02.761180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b7fe1-f2a7-466b-8b17-fa964f5e9230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:02.761981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b7fe1-f2a7-466b-8b17-fa964f5e9230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:02.762464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b7fe1-f2a7-466b-8b17-fa964f5e9230 admin admin] PATH_INFO: `/v3/projects/87dda33415dc45379a121777b27587f3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:02.765996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b7fe1-f2a7-466b-8b17-fa964f5e9230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87dda33415dc45379a121777b27587f3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:02.768255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b7fe1-f2a7-466b-8b17-fa964f5e9230 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:02.938510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc9b7fe1-f2a7-466b-8b17-fa964f5e9230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87dda33415dc45379a121777b27587f3', 'request_id': 'req-dc9b7fe1-f2a7-466b-8b17-fa964f5e9230'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:02.946208 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc9b7fe1-f2a7-466b-8b17-fa964f5e9230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87dda33415dc45379a121777b27587f3', 'request_id': 'req-dc9b7fe1-f2a7-466b-8b17-fa964f5e9230'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:02.955288 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc9b7fe1-f2a7-466b-8b17-fa964f5e9230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87dda33415dc45379a121777b27587f3', 'request_id': 'req-dc9b7fe1-f2a7-466b-8b17-fa964f5e9230'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:02.981008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc9b7fe1-f2a7-466b-8b17-fa964f5e9230 admin admin] The token cache is being invalidate because project 87dda33415dc45379a121777b27587f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:08:02.982362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc9b7fe1-f2a7-466b-8b17-fa964f5e9230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:02.983893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc9b7fe1-f2a7-466b-8b17-fa964f5e9230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:02.986612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1209/2445] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:08:02 2022] DELETE /identity/v3/projects/87dda33415dc45379a121777b27587f3 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:02.992932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fc765-d4a8-41ea-b07c-c3fb58428ba4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:02.993478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fc765-d4a8-41ea-b07c-c3fb58428ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:02.993478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fc765-d4a8-41ea-b07c-c3fb58428ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:03.015361 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-de9fc765-d4a8-41ea-b07c-c3fb58428ba4 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:03.017010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-de9fc765-d4a8-41ea-b07c-c3fb58428ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:03.099419 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1237/2446] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:03.101877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbc548-ed7e-4829-ad6b-c16708174508 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:03.102254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbc548-ed7e-4829-ad6b-c16708174508 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:03.102561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbc548-ed7e-4829-ad6b-c16708174508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:03.125591 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3acbc548-ed7e-4829-ad6b-c16708174508 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:03.127382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3acbc548-ed7e-4829-ad6b-c16708174508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:03.141039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1210/2447] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:03.142846 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fc765-d4a8-41ea-b07c-c3fb58428ba4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:03.154617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fc765-d4a8-41ea-b07c-c3fb58428ba4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:03.160028 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba43a3-7a10-424a-a60e-2ea0242269d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:03.160716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba43a3-7a10-424a-a60e-2ea0242269d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:03.161004 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba43a3-7a10-424a-a60e-2ea0242269d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:03.161286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba43a3-7a10-424a-a60e-2ea0242269d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:03.162035 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba43a3-7a10-424a-a60e-2ea0242269d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:08:03.162352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba43a3-7a10-424a-a60e-2ea0242269d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:03.164013 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba43a3-7a10-424a-a60e-2ea0242269d3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:03.189694 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1238/2448] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 16:08:03.200220 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbc548-ed7e-4829-ad6b-c16708174508 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:03.210296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbc548-ed7e-4829-ad6b-c16708174508 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:03.215413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44254f79-20a6-4c0e-a8d7-863d46a8ca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:03.216048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44254f79-20a6-4c0e-a8d7-863d46a8ca0f admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:03.216328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44254f79-20a6-4c0e-a8d7-863d46a8ca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:03.216604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44254f79-20a6-4c0e-a8d7-863d46a8ca0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:03.217294 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44254f79-20a6-4c0e-a8d7-863d46a8ca0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:03.219324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44254f79-20a6-4c0e-a8d7-863d46a8ca0f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:03.255130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1211/2449] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:08:03 2022] POST /identity/v3/projects => generated 399 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:08:03.256425 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba43a3-7a10-424a-a60e-2ea0242269d3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:03.282865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba43a3-7a10-424a-a60e-2ea0242269d3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:03.400192 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f11bda-ec39-4dc1-9e96-3723980d27d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:03.401755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f11bda-ec39-4dc1-9e96-3723980d27d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:03.402352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f11bda-ec39-4dc1-9e96-3723980d27d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:03.402922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f11bda-ec39-4dc1-9e96-3723980d27d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:03.404103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f11bda-ec39-4dc1-9e96-3723980d27d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:03.408351 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f11bda-ec39-4dc1-9e96-3723980d27d9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:03.441879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1239/2450] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:08:03 2022] POST /identity/v3/users => generated 300 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:08:03.445850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44254f79-20a6-4c0e-a8d7-863d46a8ca0f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:03.470110 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44254f79-20a6-4c0e-a8d7-863d46a8ca0f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:03.481999 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eb4a6-60eb-46d2-8c4f-307b0f469e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:03.483077 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eb4a6-60eb-46d2-8c4f-307b0f469e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:03.483470 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eb4a6-60eb-46d2-8c4f-307b0f469e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:03.483849 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eb4a6-60eb-46d2-8c4f-307b0f469e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:03.484824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7eb4a6-60eb-46d2-8c4f-307b0f469e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:03.487519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7eb4a6-60eb-46d2-8c4f-307b0f469e38 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:03.502368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1212/2451] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:08:03.506383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f11bda-ec39-4dc1-9e96-3723980d27d9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:03.519417 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f11bda-ec39-4dc1-9e96-3723980d27d9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:03.528895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d14150-0322-4c2d-821e-0cdb28418e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:03.529610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14150-0322-4c2d-821e-0cdb28418e55 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:03.529934 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14150-0322-4c2d-821e-0cdb28418e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:03.530329 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14150-0322-4c2d-821e-0cdb28418e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:03.531421 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d14150-0322-4c2d-821e-0cdb28418e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:03.532990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d14150-0322-4c2d-821e-0cdb28418e55 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:03.549537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1240/2452] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:08:03.553960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eb4a6-60eb-46d2-8c4f-307b0f469e38 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:03.567711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eb4a6-60eb-46d2-8c4f-307b0f469e38 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:03.573089 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa088e-8afc-4857-bd2d-54c9af6e3201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:03.574151 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa088e-8afc-4857-bd2d-54c9af6e3201 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:03.574508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa088e-8afc-4857-bd2d-54c9af6e3201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:03.575680 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa088e-8afc-4857-bd2d-54c9af6e3201 admin admin] PATH_INFO: `/v3/projects/10397e810e2a4d7d9140ff21aae713c8/users/f15ef18af3b54b8d8e0198e2fd49ef68/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:03.605061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa088e-8afc-4857-bd2d-54c9af6e3201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10397e810e2a4d7d9140ff21aae713c8, user_id=f15ef18af3b54b8d8e0198e2fd49ef68, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:03.608436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa088e-8afc-4857-bd2d-54c9af6e3201 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:03.631609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1213/2453] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:08:03 2022] PUT /identity/v3/projects/10397e810e2a4d7d9140ff21aae713c8/users/f15ef18af3b54b8d8e0198e2fd49ef68/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:03.642050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93ae6-e7a3-4ce9-bb4f-a166825a1e85 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:03.642653 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93ae6-e7a3-4ce9-bb4f-a166825a1e85 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:03.643028 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf93ae6-e7a3-4ce9-bb4f-a166825a1e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:03.660018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:03.700355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-fdf93ae6-e7a3-4ce9-bb4f-a166825a1e85 None None] MFA Rules not processed for user `f15ef18af3b54b8d8e0198e2fd49ef68`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:03.704291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fdf93ae6-e7a3-4ce9-bb4f-a166825a1e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:03.859796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1241/2454] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:03.876280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa088e-8afc-4857-bd2d-54c9af6e3201 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:03.878280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-41fa088e-8afc-4857-bd2d-54c9af6e3201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:03.966120 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:03.974337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa088e-8afc-4857-bd2d-54c9af6e3201 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:03.981198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef62db79-9c29-424f-a396-ac8576fea1a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:03.982363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62db79-9c29-424f-a396-ac8576fea1a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:03.983115 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62db79-9c29-424f-a396-ac8576fea1a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:03.983976 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef62db79-9c29-424f-a396-ac8576fea1a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:03.996602 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62db79-9c29-424f-a396-ac8576fea1a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:03.997728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef62db79-9c29-424f-a396-ac8576fea1a9 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:04.023767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1214/2455] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:08:04.107972 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf93ae6-e7a3-4ce9-bb4f-a166825a1e85 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:04.109493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-fdf93ae6-e7a3-4ce9-bb4f-a166825a1e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:04.268281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf93ae6-e7a3-4ce9-bb4f-a166825a1e85 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:04.273756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93cf0f-4965-4587-90ce-ab307757486e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:04.275021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93cf0f-4965-4587-90ce-ab307757486e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:04.275432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93cf0f-4965-4587-90ce-ab307757486e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:04.275813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93cf0f-4965-4587-90ce-ab307757486e admin admin] PATH_INFO: `/v3/users/6c9dcf3a630844da9b6fedeebdb4bf8b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:04.277163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93cf0f-4965-4587-90ce-ab307757486e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9dcf3a630844da9b6fedeebdb4bf8b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:04.279520 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc93cf0f-4965-4587-90ce-ab307757486e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:04.366069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cc93cf0f-4965-4587-90ce-ab307757486e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9dcf3a630844da9b6fedeebdb4bf8b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:04.396938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cc93cf0f-4965-4587-90ce-ab307757486e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9dcf3a630844da9b6fedeebdb4bf8b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:04.410239 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cc93cf0f-4965-4587-90ce-ab307757486e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9dcf3a630844da9b6fedeebdb4bf8b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:04.411521 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cc93cf0f-4965-4587-90ce-ab307757486e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9dcf3a630844da9b6fedeebdb4bf8b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:04.435524 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-cc93cf0f-4965-4587-90ce-ab307757486e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9dcf3a630844da9b6fedeebdb4bf8b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:04.448288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1242/2456] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:08:04 2022] DELETE /identity/v3/users/6c9dcf3a630844da9b6fedeebdb4bf8b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:04.453361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da7149-a049-45f9-8ea3-415368a9de1b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:04.453530 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da7149-a049-45f9-8ea3-415368a9de1b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:04.453814 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da7149-a049-45f9-8ea3-415368a9de1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:04.489737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-17da7149-a049-45f9-8ea3-415368a9de1b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:04.490786 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-17da7149-a049-45f9-8ea3-415368a9de1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:04.690366 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1215/2457] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:08:04.702556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93cf0f-4965-4587-90ce-ab307757486e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:04.704189 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cc93cf0f-4965-4587-90ce-ab307757486e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:04.842143 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:05.005461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc93cf0f-4965-4587-90ce-ab307757486e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:05.027297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf07ef3-65d6-431c-a4ce-535c5f033014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:05.027297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf07ef3-65d6-431c-a4ce-535c5f033014 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:05.027297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf07ef3-65d6-431c-a4ce-535c5f033014 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:05.027297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf07ef3-65d6-431c-a4ce-535c5f033014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:05.058197 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf07ef3-65d6-431c-a4ce-535c5f033014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:05.065980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf07ef3-65d6-431c-a4ce-535c5f033014 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:05.097339 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1243/2458] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:08:05.658620 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da7149-a049-45f9-8ea3-415368a9de1b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:05.660508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-17da7149-a049-45f9-8ea3-415368a9de1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:05.678089 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da7149-a049-45f9-8ea3-415368a9de1b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:05.700128 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23406b0a-1edf-42ce-88e1-21d65a574629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:05.704442 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23406b0a-1edf-42ce-88e1-21d65a574629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:05.704730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23406b0a-1edf-42ce-88e1-21d65a574629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:05.705093 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23406b0a-1edf-42ce-88e1-21d65a574629 admin admin] PATH_INFO: `/v3/projects/568b4beb25db4fe19b9042b9b075e57f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:05.708991 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23406b0a-1edf-42ce-88e1-21d65a574629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=568b4beb25db4fe19b9042b9b075e57f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:05.711608 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23406b0a-1edf-42ce-88e1-21d65a574629 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:05.817486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-23406b0a-1edf-42ce-88e1-21d65a574629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '568b4beb25db4fe19b9042b9b075e57f', 'request_id': 'req-23406b0a-1edf-42ce-88e1-21d65a574629'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:05.827368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-23406b0a-1edf-42ce-88e1-21d65a574629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '568b4beb25db4fe19b9042b9b075e57f', 'request_id': 'req-23406b0a-1edf-42ce-88e1-21d65a574629'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:05.838398 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-23406b0a-1edf-42ce-88e1-21d65a574629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '568b4beb25db4fe19b9042b9b075e57f', 'request_id': 'req-23406b0a-1edf-42ce-88e1-21d65a574629'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:05.863748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-23406b0a-1edf-42ce-88e1-21d65a574629 admin admin] The token cache is being invalidate because project 568b4beb25db4fe19b9042b9b075e57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:08:05.864103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-23406b0a-1edf-42ce-88e1-21d65a574629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:05.865317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-23406b0a-1edf-42ce-88e1-21d65a574629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:05.868127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1216/2459] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:08:05 2022] DELETE /identity/v3/projects/568b4beb25db4fe19b9042b9b075e57f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:05.872508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf07ef3-65d6-431c-a4ce-535c5f033014 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:05.890316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf07ef3-65d6-431c-a4ce-535c5f033014 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:05.981887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4180d62-d365-4019-9d4e-6b1bd0e878fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:05.983916 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180d62-d365-4019-9d4e-6b1bd0e878fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:05.984474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180d62-d365-4019-9d4e-6b1bd0e878fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:05.984952 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180d62-d365-4019-9d4e-6b1bd0e878fc admin admin] PATH_INFO: `/v3/users/b55515c6e2f8456dbf02d0e7f0167749` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:05.986950 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4180d62-d365-4019-9d4e-6b1bd0e878fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b55515c6e2f8456dbf02d0e7f0167749)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:05.989722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4180d62-d365-4019-9d4e-6b1bd0e878fc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:06.102116 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d4180d62-d365-4019-9d4e-6b1bd0e878fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b55515c6e2f8456dbf02d0e7f0167749'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:06.130433 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d4180d62-d365-4019-9d4e-6b1bd0e878fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b55515c6e2f8456dbf02d0e7f0167749'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:06.144523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d4180d62-d365-4019-9d4e-6b1bd0e878fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b55515c6e2f8456dbf02d0e7f0167749'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:06.145685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d4180d62-d365-4019-9d4e-6b1bd0e878fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b55515c6e2f8456dbf02d0e7f0167749'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:06.156961 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d4180d62-d365-4019-9d4e-6b1bd0e878fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b55515c6e2f8456dbf02d0e7f0167749'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:06.165958 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1244/2460] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:08:05 2022] DELETE /identity/v3/users/b55515c6e2f8456dbf02d0e7f0167749 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:06.684995 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23406b0a-1edf-42ce-88e1-21d65a574629 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:06.687634 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-23406b0a-1edf-42ce-88e1-21d65a574629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:06.715251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23406b0a-1edf-42ce-88e1-21d65a574629 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:06.809308 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604963e-4ce9-4d16-a1e3-f4552780cfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:06.810221 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604963e-4ce9-4d16-a1e3-f4552780cfd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:06.810503 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604963e-4ce9-4d16-a1e3-f4552780cfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:06.810781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604963e-4ce9-4d16-a1e3-f4552780cfd9 admin admin] PATH_INFO: `/v3/projects/c0b4fdcf89204223961df1349b02c0b7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:06.813070 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604963e-4ce9-4d16-a1e3-f4552780cfd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b4fdcf89204223961df1349b02c0b7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:06.817900 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604963e-4ce9-4d16-a1e3-f4552780cfd9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:06.845176 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:06.919758 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f604963e-4ce9-4d16-a1e3-f4552780cfd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b4fdcf89204223961df1349b02c0b7', 'request_id': 'req-f604963e-4ce9-4d16-a1e3-f4552780cfd9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:06.939096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f604963e-4ce9-4d16-a1e3-f4552780cfd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b4fdcf89204223961df1349b02c0b7', 'request_id': 'req-f604963e-4ce9-4d16-a1e3-f4552780cfd9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:06.950256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f604963e-4ce9-4d16-a1e3-f4552780cfd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b4fdcf89204223961df1349b02c0b7', 'request_id': 'req-f604963e-4ce9-4d16-a1e3-f4552780cfd9'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:06.974428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f604963e-4ce9-4d16-a1e3-f4552780cfd9 admin admin] The token cache is being invalidate because project c0b4fdcf89204223961df1349b02c0b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:08:06.975570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f604963e-4ce9-4d16-a1e3-f4552780cfd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:06.977724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f604963e-4ce9-4d16-a1e3-f4552780cfd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:06.982852 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1217/2461] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:08:06 2022] DELETE /identity/v3/projects/c0b4fdcf89204223961df1349b02c0b7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:06.984743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4180d62-d365-4019-9d4e-6b1bd0e878fc admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:06.986847 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d4180d62-d365-4019-9d4e-6b1bd0e878fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:07.011707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4180d62-d365-4019-9d4e-6b1bd0e878fc admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:07.084699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:07.153158 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe55b8e-7484-42e8-8b41-6cf8c55cf69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:07.154309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe55b8e-7484-42e8-8b41-6cf8c55cf69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:07.154698 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe55b8e-7484-42e8-8b41-6cf8c55cf69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:07.155102 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe55b8e-7484-42e8-8b41-6cf8c55cf69d admin admin] PATH_INFO: `/v3/users/928e6041ab6e44298f012af75e02e61a` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:07.156976 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe55b8e-7484-42e8-8b41-6cf8c55cf69d admin admin] RBAC: Authorizing `identity:delete_user(user_id=928e6041ab6e44298f012af75e02e61a)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:07.163473 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe55b8e-7484-42e8-8b41-6cf8c55cf69d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:07.252804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bfe55b8e-7484-42e8-8b41-6cf8c55cf69d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928e6041ab6e44298f012af75e02e61a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:07.341607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bfe55b8e-7484-42e8-8b41-6cf8c55cf69d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928e6041ab6e44298f012af75e02e61a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:07.380540 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bfe55b8e-7484-42e8-8b41-6cf8c55cf69d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928e6041ab6e44298f012af75e02e61a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:07.395363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bfe55b8e-7484-42e8-8b41-6cf8c55cf69d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928e6041ab6e44298f012af75e02e61a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:07.451715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bfe55b8e-7484-42e8-8b41-6cf8c55cf69d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928e6041ab6e44298f012af75e02e61a'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:07.489558 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1245/2462] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:08:06 2022] DELETE /identity/v3/users/928e6041ab6e44298f012af75e02e61a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:08.689996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604963e-4ce9-4d16-a1e3-f4552780cfd9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:08.692284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f604963e-4ce9-4d16-a1e3-f4552780cfd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:08.751836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604963e-4ce9-4d16-a1e3-f4552780cfd9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:08.907312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867394f-cb93-439d-a614-7f59a212b517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:08.907312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867394f-cb93-439d-a614-7f59a212b517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:08.907312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867394f-cb93-439d-a614-7f59a212b517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:08.907312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867394f-cb93-439d-a614-7f59a212b517 admin admin] PATH_INFO: `/v3/projects/da6140e8578f4122a30a33b182a68c05` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:08.908443 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867394f-cb93-439d-a614-7f59a212b517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da6140e8578f4122a30a33b182a68c05)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:08.910600 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867394f-cb93-439d-a614-7f59a212b517 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:09.089865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7867394f-cb93-439d-a614-7f59a212b517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da6140e8578f4122a30a33b182a68c05', 'request_id': 'req-7867394f-cb93-439d-a614-7f59a212b517'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:09.097255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7867394f-cb93-439d-a614-7f59a212b517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da6140e8578f4122a30a33b182a68c05', 'request_id': 'req-7867394f-cb93-439d-a614-7f59a212b517'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:09.104341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7867394f-cb93-439d-a614-7f59a212b517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da6140e8578f4122a30a33b182a68c05', 'request_id': 'req-7867394f-cb93-439d-a614-7f59a212b517'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:09.125724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7867394f-cb93-439d-a614-7f59a212b517 admin admin] The token cache is being invalidate because project da6140e8578f4122a30a33b182a68c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:08:09.126015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7867394f-cb93-439d-a614-7f59a212b517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:09.126886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7867394f-cb93-439d-a614-7f59a212b517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:09.132421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1218/2463] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:08:08 2022] DELETE /identity/v3/projects/da6140e8578f4122a30a33b182a68c05 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:09.136864 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9e562-bfcd-449e-b9b9-d34c05a1358a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:09.137900 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9e562-bfcd-449e-b9b9-d34c05a1358a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:09.138344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd9e562-bfcd-449e-b9b9-d34c05a1358a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:09.165179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1fd9e562-bfcd-449e-b9b9-d34c05a1358a None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:09.166430 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1fd9e562-bfcd-449e-b9b9-d34c05a1358a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:09.260579 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1246/2464] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:09.268752 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ee1d7-75db-4027-96c7-d24739669bf3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:09.269047 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ee1d7-75db-4027-96c7-d24739669bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:09.269297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ee1d7-75db-4027-96c7-d24739669bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:09.298035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8a8ee1d7-75db-4027-96c7-d24739669bf3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:09.299480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8a8ee1d7-75db-4027-96c7-d24739669bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:09.308391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1219/2465] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:09.312498 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9e562-bfcd-449e-b9b9-d34c05a1358a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:09.325523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd9e562-bfcd-449e-b9b9-d34c05a1358a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:09.335456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a0d7a-d5ba-43aa-a19b-182ea04aad0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:09.336146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a0d7a-d5ba-43aa-a19b-182ea04aad0e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:09.336456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a0d7a-d5ba-43aa-a19b-182ea04aad0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:09.336726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1a0d7a-d5ba-43aa-a19b-182ea04aad0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:09.337502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a0d7a-d5ba-43aa-a19b-182ea04aad0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:08:09.337807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a0d7a-d5ba-43aa-a19b-182ea04aad0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:09.339617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1a0d7a-d5ba-43aa-a19b-182ea04aad0e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:09.352986 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1247/2466] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:08:09.357172 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ee1d7-75db-4027-96c7-d24739669bf3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:09.366769 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ee1d7-75db-4027-96c7-d24739669bf3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:09.371692 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b7062-737a-4a6a-bebe-5ee390140e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:09.372364 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b7062-737a-4a6a-bebe-5ee390140e3f admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:09.372643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b7062-737a-4a6a-bebe-5ee390140e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:09.372914 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b7062-737a-4a6a-bebe-5ee390140e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:09.373628 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b7062-737a-4a6a-bebe-5ee390140e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:09.375655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b7062-737a-4a6a-bebe-5ee390140e3f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:09.413330 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1220/2467] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:08:09 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:08:09.417512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a0d7a-d5ba-43aa-a19b-182ea04aad0e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:09.434087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1a0d7a-d5ba-43aa-a19b-182ea04aad0e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:09.498895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:09.551444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b6080-81ab-4f44-a558-b393a0161c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:09.552749 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b6080-81ab-4f44-a558-b393a0161c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:09.553324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b6080-81ab-4f44-a558-b393a0161c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:09.553772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b6080-81ab-4f44-a558-b393a0161c49 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:09.554681 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b6080-81ab-4f44-a558-b393a0161c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:09.558429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b6080-81ab-4f44-a558-b393a0161c49 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:09.614945 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1248/2468] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:08:09 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:08:09.618909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b7062-737a-4a6a-bebe-5ee390140e3f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:09.633839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b7062-737a-4a6a-bebe-5ee390140e3f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:09.644989 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b655e-e993-4b73-bb04-b58fd41a400b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:09.646033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b655e-e993-4b73-bb04-b58fd41a400b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:09.646586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b655e-e993-4b73-bb04-b58fd41a400b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:09.647210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b655e-e993-4b73-bb04-b58fd41a400b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:09.647975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b655e-e993-4b73-bb04-b58fd41a400b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:09.649633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b655e-e993-4b73-bb04-b58fd41a400b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:09.651231 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:09.679073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1221/2469] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:08:09.681085 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b6080-81ab-4f44-a558-b393a0161c49 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:09.696929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b6080-81ab-4f44-a558-b393a0161c49 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:09.715779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fd013-adbd-49d4-8e51-1ff3d1519b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:09.716626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fd013-adbd-49d4-8e51-1ff3d1519b8f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:09.716908 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fd013-adbd-49d4-8e51-1ff3d1519b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:09.717312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fd013-adbd-49d4-8e51-1ff3d1519b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:09.718173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fd013-adbd-49d4-8e51-1ff3d1519b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:09.720064 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15fd013-adbd-49d4-8e51-1ff3d1519b8f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:09.748840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1249/2470] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:08:09.759991 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b655e-e993-4b73-bb04-b58fd41a400b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:09.776273 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b655e-e993-4b73-bb04-b58fd41a400b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:09.791075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817021f-bbc8-4fae-8d20-00b5b000387a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:09.792014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817021f-bbc8-4fae-8d20-00b5b000387a admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:09.792290 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817021f-bbc8-4fae-8d20-00b5b000387a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:09.792562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817021f-bbc8-4fae-8d20-00b5b000387a admin admin] PATH_INFO: `/v3/projects/8ef817f770384be1b3b868cc38d1ccda/users/858f5ec58c3f4b19968421f15bb94319/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:09.810729 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817021f-bbc8-4fae-8d20-00b5b000387a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ef817f770384be1b3b868cc38d1ccda, user_id=858f5ec58c3f4b19968421f15bb94319, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:09.813544 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817021f-bbc8-4fae-8d20-00b5b000387a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:09.834111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1222/2471] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:08:09 2022] PUT /identity/v3/projects/8ef817f770384be1b3b868cc38d1ccda/users/858f5ec58c3f4b19968421f15bb94319/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:09.844982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed50a9a-1899-4573-8cf3-a8fb9936a350 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:09.845296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed50a9a-1899-4573-8cf3-a8fb9936a350 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:09.845573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed50a9a-1899-4573-8cf3-a8fb9936a350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:09.886167 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-4ed50a9a-1899-4573-8cf3-a8fb9936a350 None None] MFA Rules not processed for user `858f5ec58c3f4b19968421f15bb94319`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:09.887902 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4ed50a9a-1899-4573-8cf3-a8fb9936a350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:10.013854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1250/2472] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:08:10.193100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817021f-bbc8-4fae-8d20-00b5b000387a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:10.195792 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9817021f-bbc8-4fae-8d20-00b5b000387a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:10.372181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817021f-bbc8-4fae-8d20-00b5b000387a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:10.378341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507f699-5db4-40fb-935f-04de1d8acd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:10.379509 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507f699-5db4-40fb-935f-04de1d8acd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:10.379900 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507f699-5db4-40fb-935f-04de1d8acd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:10.380280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507f699-5db4-40fb-935f-04de1d8acd01 admin admin] PATH_INFO: `/v3/users/f15ef18af3b54b8d8e0198e2fd49ef68` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:10.381651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507f699-5db4-40fb-935f-04de1d8acd01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15ef18af3b54b8d8e0198e2fd49ef68)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:10.383888 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507f699-5db4-40fb-935f-04de1d8acd01 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:10.493397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3507f699-5db4-40fb-935f-04de1d8acd01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15ef18af3b54b8d8e0198e2fd49ef68'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:10.509256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3507f699-5db4-40fb-935f-04de1d8acd01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15ef18af3b54b8d8e0198e2fd49ef68'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:10.527883 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3507f699-5db4-40fb-935f-04de1d8acd01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15ef18af3b54b8d8e0198e2fd49ef68'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:10.528542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3507f699-5db4-40fb-935f-04de1d8acd01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15ef18af3b54b8d8e0198e2fd49ef68'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:10.529190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3507f699-5db4-40fb-935f-04de1d8acd01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15ef18af3b54b8d8e0198e2fd49ef68'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:10.557848 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1223/2473] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:08:10 2022] DELETE /identity/v3/users/f15ef18af3b54b8d8e0198e2fd49ef68 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:10.562766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff8603-5006-4052-990e-10e443c6e746 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:10.563656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff8603-5006-4052-990e-10e443c6e746 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:10.563656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff8603-5006-4052-990e-10e443c6e746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:10.591556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-27ff8603-5006-4052-990e-10e443c6e746 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:10.593661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-27ff8603-5006-4052-990e-10e443c6e746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:10.677444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1251/2474] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:10.688048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507f699-5db4-40fb-935f-04de1d8acd01 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:10.690044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3507f699-5db4-40fb-935f-04de1d8acd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:10.775652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507f699-5db4-40fb-935f-04de1d8acd01 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:10.780902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747aed9-e64c-45e3-9efb-9f4aa5b20f3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:10.781933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747aed9-e64c-45e3-9efb-9f4aa5b20f3b service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:10.782888 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747aed9-e64c-45e3-9efb-9f4aa5b20f3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:10.783604 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747aed9-e64c-45e3-9efb-9f4aa5b20f3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:10.795733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:10.815094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747aed9-e64c-45e3-9efb-9f4aa5b20f3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:10.818856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c747aed9-e64c-45e3-9efb-9f4aa5b20f3b service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:10.845181 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1224/2475] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:08:11.556852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff8603-5006-4052-990e-10e443c6e746 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:11.558582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-27ff8603-5006-4052-990e-10e443c6e746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:11.633187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:11.640671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff8603-5006-4052-990e-10e443c6e746 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:11.648120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c71242d-87f6-404f-9c4e-cce9059e9ea5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3418c0b46c404c8ca445cce9db632d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:11.650035 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71242d-87f6-404f-9c4e-cce9059e9ea5 service glance] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:11.650321 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71242d-87f6-404f-9c4e-cce9059e9ea5 service glance] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:11.650602 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c71242d-87f6-404f-9c4e-cce9059e9ea5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:11.652766 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6c71242d-87f6-404f-9c4e-cce9059e9ea5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:11.786534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71242d-87f6-404f-9c4e-cce9059e9ea5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:11.788118 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c71242d-87f6-404f-9c4e-cce9059e9ea5 service glance] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:11.796649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747aed9-e64c-45e3-9efb-9f4aa5b20f3b service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:11.798385 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c747aed9-e64c-45e3-9efb-9f4aa5b20f3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:11.818273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1252/2476] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:08:11.822774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747aed9-e64c-45e3-9efb-9f4aa5b20f3b service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:11.860136 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46d132-a904-41d3-be13-239cd5f3c5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:11.861295 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46d132-a904-41d3-be13-239cd5f3c5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:11.863672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46d132-a904-41d3-be13-239cd5f3c5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:11.864057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46d132-a904-41d3-be13-239cd5f3c5a8 admin admin] PATH_INFO: `/v3/projects/10397e810e2a4d7d9140ff21aae713c8` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:11.866718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46d132-a904-41d3-be13-239cd5f3c5a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10397e810e2a4d7d9140ff21aae713c8)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:11.868728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46d132-a904-41d3-be13-239cd5f3c5a8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:11.955042 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9e46d132-a904-41d3-be13-239cd5f3c5a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10397e810e2a4d7d9140ff21aae713c8', 'request_id': 'req-9e46d132-a904-41d3-be13-239cd5f3c5a8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:11.965570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9e46d132-a904-41d3-be13-239cd5f3c5a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10397e810e2a4d7d9140ff21aae713c8', 'request_id': 'req-9e46d132-a904-41d3-be13-239cd5f3c5a8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:11.977994 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9e46d132-a904-41d3-be13-239cd5f3c5a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10397e810e2a4d7d9140ff21aae713c8', 'request_id': 'req-9e46d132-a904-41d3-be13-239cd5f3c5a8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:12.002030 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9e46d132-a904-41d3-be13-239cd5f3c5a8 admin admin] The token cache is being invalidate because project 10397e810e2a4d7d9140ff21aae713c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:08:12.002382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9e46d132-a904-41d3-be13-239cd5f3c5a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:12.003130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9e46d132-a904-41d3-be13-239cd5f3c5a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:12.005772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1225/2477] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:08:11 2022] DELETE /identity/v3/projects/10397e810e2a4d7d9140ff21aae713c8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:08:13.224755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04929cb3-3181-4c90-89a8-e0307a0871ba None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:13.225412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04929cb3-3181-4c90-89a8-e0307a0871ba None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:13.225753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04929cb3-3181-4c90-89a8-e0307a0871ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:13.248637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-04929cb3-3181-4c90-89a8-e0307a0871ba None None] MFA Rules not processed for user `35f595da10d34af4b1eeb5a3ec4a69b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:13.250187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-04929cb3-3181-4c90-89a8-e0307a0871ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:13.333510 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1253/2478] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:20.049908 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd3044-75b5-4862-810e-cbe76dc100a3 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:20.050882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd3044-75b5-4862-810e-cbe76dc100a3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:20.051170 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebd3044-75b5-4862-810e-cbe76dc100a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:20.071032 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2ebd3044-75b5-4862-810e-cbe76dc100a3 None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:20.072046 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2ebd3044-75b5-4862-810e-cbe76dc100a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:20.161103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1226/2479] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 21 16:08:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:20.170211 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04929cb3-3181-4c90-89a8-e0307a0871ba None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:20.171838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-04929cb3-3181-4c90-89a8-e0307a0871ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:20.277777 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04929cb3-3181-4c90-89a8-e0307a0871ba None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:20.283697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b2968-86b9-416d-8ce7-e9bf4f2830d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:20.284370 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b2968-86b9-416d-8ce7-e9bf4f2830d8 service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:20.284655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b2968-86b9-416d-8ce7-e9bf4f2830d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:20.284930 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b2968-86b9-416d-8ce7-e9bf4f2830d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:20.294517 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b2968-86b9-416d-8ce7-e9bf4f2830d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:20.296256 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b2968-86b9-416d-8ce7-e9bf4f2830d8 service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:20.305567 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1254/2480] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:08:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 16:08:21.590649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd3044-75b5-4862-810e-cbe76dc100a3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:21.592299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2ebd3044-75b5-4862-810e-cbe76dc100a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:21.674188 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebd3044-75b5-4862-810e-cbe76dc100a3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:21.682359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f620e74-b436-48a1-872a-de8d6398061a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:21.687116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f620e74-b436-48a1-872a-de8d6398061a service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:21.687116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f620e74-b436-48a1-872a-de8d6398061a service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:21.687116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f620e74-b436-48a1-872a-de8d6398061a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:21.691107 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2f620e74-b436-48a1-872a-de8d6398061a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:21.753861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:21.825506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f620e74-b436-48a1-872a-de8d6398061a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:21.827053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f620e74-b436-48a1-872a-de8d6398061a service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:21.854761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1227/2481] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:08:22.651268 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b2968-86b9-416d-8ce7-e9bf4f2830d8 service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:22.652798 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8b7b2968-86b9-416d-8ce7-e9bf4f2830d8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:22.755948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:22.804566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b2968-86b9-416d-8ce7-e9bf4f2830d8 service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:22.812800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57904d1-c951-4da9-b163-a0971c9d8a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:22.814479 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57904d1-c951-4da9-b163-a0971c9d8a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:22.815026 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57904d1-c951-4da9-b163-a0971c9d8a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:22.815659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57904d1-c951-4da9-b163-a0971c9d8a08 admin admin] PATH_INFO: `/v3/users/63bb84b42ce84d509155e0514a3c4378` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:22.823544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57904d1-c951-4da9-b163-a0971c9d8a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63bb84b42ce84d509155e0514a3c4378)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:22.829981 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57904d1-c951-4da9-b163-a0971c9d8a08 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:22.943583 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c57904d1-c951-4da9-b163-a0971c9d8a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63bb84b42ce84d509155e0514a3c4378'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:22.967333 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c57904d1-c951-4da9-b163-a0971c9d8a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63bb84b42ce84d509155e0514a3c4378'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:22.978915 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c57904d1-c951-4da9-b163-a0971c9d8a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63bb84b42ce84d509155e0514a3c4378'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:22.979750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c57904d1-c951-4da9-b163-a0971c9d8a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63bb84b42ce84d509155e0514a3c4378'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:22.989231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c57904d1-c951-4da9-b163-a0971c9d8a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63bb84b42ce84d509155e0514a3c4378'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:23.000111 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1255/2482] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:08:22 2022] DELETE /identity/v3/users/63bb84b42ce84d509155e0514a3c4378 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:23.208370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f620e74-b436-48a1-872a-de8d6398061a service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:23.220894 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f620e74-b436-48a1-872a-de8d6398061a service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:23.295146 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f20ce-0946-408c-9421-0d56a4a9346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:23.296350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f20ce-0946-408c-9421-0d56a4a9346d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:23.296350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f20ce-0946-408c-9421-0d56a4a9346d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:23.296537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f20ce-0946-408c-9421-0d56a4a9346d admin admin] PATH_INFO: `/v3/projects/13c6eb5f7c8349c4bb17494c490f4be8` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:23.297779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f20ce-0946-408c-9421-0d56a4a9346d admin admin] RBAC: Authorizing `identity:delete_project(project_id=13c6eb5f7c8349c4bb17494c490f4be8)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:23.299798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f20ce-0946-408c-9421-0d56a4a9346d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:23.349964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2f8f20ce-0946-408c-9421-0d56a4a9346d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c6eb5f7c8349c4bb17494c490f4be8', 'request_id': 'req-2f8f20ce-0946-408c-9421-0d56a4a9346d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:23.356316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2f8f20ce-0946-408c-9421-0d56a4a9346d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c6eb5f7c8349c4bb17494c490f4be8', 'request_id': 'req-2f8f20ce-0946-408c-9421-0d56a4a9346d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:23.363220 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2f8f20ce-0946-408c-9421-0d56a4a9346d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c6eb5f7c8349c4bb17494c490f4be8', 'request_id': 'req-2f8f20ce-0946-408c-9421-0d56a4a9346d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:23.375976 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2f8f20ce-0946-408c-9421-0d56a4a9346d admin admin] The token cache is being invalidate because project 13c6eb5f7c8349c4bb17494c490f4be8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:08:23.376258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2f8f20ce-0946-408c-9421-0d56a4a9346d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:23.377039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2f8f20ce-0946-408c-9421-0d56a4a9346d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:23.378746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1228/2483] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:08:23 2022] DELETE /identity/v3/projects/13c6eb5f7c8349c4bb17494c490f4be8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:23.383856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf6df2-210f-43de-862f-2094700582f0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:23.384148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf6df2-210f-43de-862f-2094700582f0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:23.384465 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf6df2-210f-43de-862f-2094700582f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:23.404451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7caf6df2-210f-43de-862f-2094700582f0 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:23.405834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7caf6df2-210f-43de-862f-2094700582f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:23.472066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1256/2484] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:23.479933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2172f7-5ff8-446a-a790-b0f21c1cf69a None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:23.480223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2172f7-5ff8-446a-a790-b0f21c1cf69a None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:23.480501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2172f7-5ff8-446a-a790-b0f21c1cf69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:23.499719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ec2172f7-5ff8-446a-a790-b0f21c1cf69a None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:23.500949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ec2172f7-5ff8-446a-a790-b0f21c1cf69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:23.509233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1229/2485] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:23.513796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf6df2-210f-43de-862f-2094700582f0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:23.524474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf6df2-210f-43de-862f-2094700582f0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:23.529724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d5d70-a68f-48f7-a3b3-1d6f2c52ec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:23.530468 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d5d70-a68f-48f7-a3b3-1d6f2c52ec4e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:23.530785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d5d70-a68f-48f7-a3b3-1d6f2c52ec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:23.531099 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d5d70-a68f-48f7-a3b3-1d6f2c52ec4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:23.532015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d5d70-a68f-48f7-a3b3-1d6f2c52ec4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:08:23.532186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d5d70-a68f-48f7-a3b3-1d6f2c52ec4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:23.534000 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d5d70-a68f-48f7-a3b3-1d6f2c52ec4e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:23.549537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1257/2486] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:08:23.553993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2172f7-5ff8-446a-a790-b0f21c1cf69a None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:23.563544 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2172f7-5ff8-446a-a790-b0f21c1cf69a None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:23.568440 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a41fb-d479-47d3-a8a2-2a70e0dc7ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:23.569097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a41fb-d479-47d3-a8a2-2a70e0dc7ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:23.569383 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a41fb-d479-47d3-a8a2-2a70e0dc7ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:23.569660 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002a41fb-d479-47d3-a8a2-2a70e0dc7ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:23.570474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a41fb-d479-47d3-a8a2-2a70e0dc7ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:23.572448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002a41fb-d479-47d3-a8a2-2a70e0dc7ab1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:23.599395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1230/2487] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:08:23 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:08:23.603717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d5d70-a68f-48f7-a3b3-1d6f2c52ec4e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:23.618741 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d5d70-a68f-48f7-a3b3-1d6f2c52ec4e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:23.665784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:23.684595 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fee57-fc66-4277-b185-51b2927bcb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:23.685690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fee57-fc66-4277-b185-51b2927bcb27 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:23.686188 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fee57-fc66-4277-b185-51b2927bcb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:23.686753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fee57-fc66-4277-b185-51b2927bcb27 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:23.687494 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fee57-fc66-4277-b185-51b2927bcb27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:23.689951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fee57-fc66-4277-b185-51b2927bcb27 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:23.713856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1258/2488] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:08:23 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:08:23.718197 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a41fb-d479-47d3-a8a2-2a70e0dc7ab1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:23.729302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002a41fb-d479-47d3-a8a2-2a70e0dc7ab1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:23.734166 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a717de0-2876-4d17-8d61-9c8edf5fd80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:23.734870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a717de0-2876-4d17-8d61-9c8edf5fd80f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:23.735184 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a717de0-2876-4d17-8d61-9c8edf5fd80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:23.735457 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a717de0-2876-4d17-8d61-9c8edf5fd80f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:23.737618 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a717de0-2876-4d17-8d61-9c8edf5fd80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:23.738060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a717de0-2876-4d17-8d61-9c8edf5fd80f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:23.752906 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1231/2489] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:08:23.755976 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fee57-fc66-4277-b185-51b2927bcb27 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:23.768453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fee57-fc66-4277-b185-51b2927bcb27 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:23.773896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11eb3f-5615-4023-8474-4719d97a6bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:23.774674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11eb3f-5615-4023-8474-4719d97a6bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:23.774998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11eb3f-5615-4023-8474-4719d97a6bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:23.775279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11eb3f-5615-4023-8474-4719d97a6bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:23.776033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11eb3f-5615-4023-8474-4719d97a6bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:23.777682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11eb3f-5615-4023-8474-4719d97a6bb7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:23.789304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1259/2490] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:08:23.793994 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a717de0-2876-4d17-8d61-9c8edf5fd80f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:23.804717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a717de0-2876-4d17-8d61-9c8edf5fd80f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:23.809343 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cf0ce-5e91-4eec-a64e-504b477f2b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:23.810232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cf0ce-5e91-4eec-a64e-504b477f2b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:23.810508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cf0ce-5e91-4eec-a64e-504b477f2b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:23.810779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cf0ce-5e91-4eec-a64e-504b477f2b4b admin admin] PATH_INFO: `/v3/projects/233571ff21d34b7c87561ec944a484e6/users/e2c5e05ad77d417282864acdf3a162a5/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:23.825410 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cf0ce-5e91-4eec-a64e-504b477f2b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=233571ff21d34b7c87561ec944a484e6, user_id=e2c5e05ad77d417282864acdf3a162a5, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:23.828155 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cf0ce-5e91-4eec-a64e-504b477f2b4b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:23.838150 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:23.844915 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1232/2491] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:08:23 2022] PUT /identity/v3/projects/233571ff21d34b7c87561ec944a484e6/users/e2c5e05ad77d417282864acdf3a162a5/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:23.855549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88327d7-d1d1-4354-b032-087f2a747dfb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:23.856050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88327d7-d1d1-4354-b032-087f2a747dfb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:23.856329 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88327d7-d1d1-4354-b032-087f2a747dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:23.885232 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f88327d7-d1d1-4354-b032-087f2a747dfb None None] MFA Rules not processed for user `e2c5e05ad77d417282864acdf3a162a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:23.886487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f88327d7-d1d1-4354-b032-087f2a747dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:23.954790 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1260/2492] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:08:23.965591 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cf0ce-5e91-4eec-a64e-504b477f2b4b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:23.967592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ac2cf0ce-5e91-4eec-a64e-504b477f2b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:24.028561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cf0ce-5e91-4eec-a64e-504b477f2b4b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:24.033115 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530c48e-dff5-4e6b-a957-89fc4ca6b49a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:24.033823 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530c48e-dff5-4e6b-a957-89fc4ca6b49a service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:24.034104 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530c48e-dff5-4e6b-a957-89fc4ca6b49a service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:24.034383 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530c48e-dff5-4e6b-a957-89fc4ca6b49a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:24.044507 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530c48e-dff5-4e6b-a957-89fc4ca6b49a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:24.046157 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530c48e-dff5-4e6b-a957-89fc4ca6b49a service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:24.066504 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1233/2493] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:08:33.951891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:34.061632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=27 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:38.448597 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88327d7-d1d1-4354-b032-087f2a747dfb None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:38.452515 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f88327d7-d1d1-4354-b032-087f2a747dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:38.462315 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530c48e-dff5-4e6b-a957-89fc4ca6b49a service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:38.613920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530c48e-dff5-4e6b-a957-89fc4ca6b49a service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:38.615173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88327d7-d1d1-4354-b032-087f2a747dfb None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:38.623672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e9ab3-63db-4389-a061-01d834f8393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:38.624412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b6fa1-2df8-4398-bfc6-48445baa8807 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:38.626268 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e9ab3-63db-4389-a061-01d834f8393a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:38.626654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b6fa1-2df8-4398-bfc6-48445baa8807 service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:38.626768 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e9ab3-63db-4389-a061-01d834f8393a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:38.626956 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b6fa1-2df8-4398-bfc6-48445baa8807 service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:38.627262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e9ab3-63db-4389-a061-01d834f8393a admin admin] PATH_INFO: `/v3/users/e2c5e05ad77d417282864acdf3a162a5` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:38.627452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b6fa1-2df8-4398-bfc6-48445baa8807 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:38.630153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e9ab3-63db-4389-a061-01d834f8393a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c5e05ad77d417282864acdf3a162a5)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:38.631079 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0d3b6fa1-2df8-4398-bfc6-48445baa8807 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:38.634220 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e9ab3-63db-4389-a061-01d834f8393a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:38.652684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b6fa1-2df8-4398-bfc6-48445baa8807 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:38.656023 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b6fa1-2df8-4398-bfc6-48445baa8807 service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:38.682107 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1261/2494] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:08:38.701275 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ace29c-d38a-4055-853e-097759a8d480 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:38.701889 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ace29c-d38a-4055-853e-097759a8d480 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:38.702373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ace29c-d38a-4055-853e-097759a8d480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:38.741336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d8ace29c-d38a-4055-853e-097759a8d480 None None] MFA Rules not processed for user `3212bd24e1f84b70872940214632536f`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:38.743621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d8ace29c-d38a-4055-853e-097759a8d480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:38.759974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a74e9ab3-63db-4389-a061-01d834f8393a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c5e05ad77d417282864acdf3a162a5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:38.783082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a74e9ab3-63db-4389-a061-01d834f8393a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c5e05ad77d417282864acdf3a162a5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:38.803069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a74e9ab3-63db-4389-a061-01d834f8393a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c5e05ad77d417282864acdf3a162a5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:38.804692 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a74e9ab3-63db-4389-a061-01d834f8393a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c5e05ad77d417282864acdf3a162a5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:38.807010 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a74e9ab3-63db-4389-a061-01d834f8393a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c5e05ad77d417282864acdf3a162a5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:38.855301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1234/2495] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:08:38 2022] DELETE /identity/v3/users/e2c5e05ad77d417282864acdf3a162a5 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:38.871623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2f98e-e381-4755-8868-154a668fae5e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:38.872122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2f98e-e381-4755-8868-154a668fae5e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:38.875060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2f98e-e381-4755-8868-154a668fae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:38.878518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1262/2496] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:38.915580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0bc2f98e-e381-4755-8868-154a668fae5e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:38.917247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0bc2f98e-e381-4755-8868-154a668fae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:39.030060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1235/2497] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:39.050418 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ace29c-d38a-4055-853e-097759a8d480 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:39.053260 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d8ace29c-d38a-4055-853e-097759a8d480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:39.201478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ace29c-d38a-4055-853e-097759a8d480 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:39.305301 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677810a-319a-47b8-8ca9-6a5f554259dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:39.306758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677810a-319a-47b8-8ca9-6a5f554259dc service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:39.307113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677810a-319a-47b8-8ca9-6a5f554259dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:39.307737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677810a-319a-47b8-8ca9-6a5f554259dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:39.317241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:39.325601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677810a-319a-47b8-8ca9-6a5f554259dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:39.327300 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677810a-319a-47b8-8ca9-6a5f554259dc service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:39.345037 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1263/2498] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:08:40.525145 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2f98e-e381-4755-8868-154a668fae5e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:40.528156 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0bc2f98e-e381-4755-8868-154a668fae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:40.580872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2f98e-e381-4755-8868-154a668fae5e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:40.596048 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0367f5-31bd-4334-bce6-97b40b892011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:40.596952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0367f5-31bd-4334-bce6-97b40b892011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:40.597233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0367f5-31bd-4334-bce6-97b40b892011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:40.599695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0367f5-31bd-4334-bce6-97b40b892011 admin admin] PATH_INFO: `/v3/projects/233571ff21d34b7c87561ec944a484e6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:40.604454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0367f5-31bd-4334-bce6-97b40b892011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=233571ff21d34b7c87561ec944a484e6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:40.607179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0367f5-31bd-4334-bce6-97b40b892011 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:40.659434 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:40.746661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7d0367f5-31bd-4334-bce6-97b40b892011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '233571ff21d34b7c87561ec944a484e6', 'request_id': 'req-7d0367f5-31bd-4334-bce6-97b40b892011'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:40.760867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7d0367f5-31bd-4334-bce6-97b40b892011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '233571ff21d34b7c87561ec944a484e6', 'request_id': 'req-7d0367f5-31bd-4334-bce6-97b40b892011'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:40.769430 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7d0367f5-31bd-4334-bce6-97b40b892011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '233571ff21d34b7c87561ec944a484e6', 'request_id': 'req-7d0367f5-31bd-4334-bce6-97b40b892011'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:40.805276 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7d0367f5-31bd-4334-bce6-97b40b892011 admin admin] The token cache is being invalidate because project 233571ff21d34b7c87561ec944a484e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:08:40.806198 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7d0367f5-31bd-4334-bce6-97b40b892011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:40.817901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-7d0367f5-31bd-4334-bce6-97b40b892011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:40.833039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1236/2499] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:08:40 2022] DELETE /identity/v3/projects/233571ff21d34b7c87561ec944a484e6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:41.290139 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677810a-319a-47b8-8ca9-6a5f554259dc service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:41.292674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d677810a-319a-47b8-8ca9-6a5f554259dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:41.314748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677810a-319a-47b8-8ca9-6a5f554259dc service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:41.426199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef430f-5dd8-423f-8958-b4cf4888662f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:41.427426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef430f-5dd8-423f-8958-b4cf4888662f service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:41.427794 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef430f-5dd8-423f-8958-b4cf4888662f service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:41.428222 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef430f-5dd8-423f-8958-b4cf4888662f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:41.431992 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e8ef430f-5dd8-423f-8958-b4cf4888662f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:41.550651 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef430f-5dd8-423f-8958-b4cf4888662f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:41.552208 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef430f-5dd8-423f-8958-b4cf4888662f service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:41.567234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1264/2500] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:08:41.681548 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcce2bf-ea6c-4b31-830c-e519bd7d96c0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:41.682121 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcce2bf-ea6c-4b31-830c-e519bd7d96c0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:41.682121 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcce2bf-ea6c-4b31-830c-e519bd7d96c0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:41.683996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1237/2501] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 16:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:08:41.691325 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4ad44-ef15-40b1-bab1-3ded4fe63a99 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:41.691626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4ad44-ef15-40b1-bab1-3ded4fe63a99 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:41.691888 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4ad44-ef15-40b1-bab1-3ded4fe63a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:41.718414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-93e4ad44-ef15-40b1-bab1-3ded4fe63a99 None None] MFA Rules not processed for user `e9a1ec1f6bb7467dbd63ad1da36d48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:41.720727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-93e4ad44-ef15-40b1-bab1-3ded4fe63a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:41.857011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1265/2502] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 16:08:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:41.872102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcce2bf-ea6c-4b31-830c-e519bd7d96c0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:41.874482 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bbcce2bf-ea6c-4b31-830c-e519bd7d96c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:41.935869 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcce2bf-ea6c-4b31-830c-e519bd7d96c0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:41.943100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02266031-e52f-4753-878a-86fbcefe20a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:41.943872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02266031-e52f-4753-878a-86fbcefe20a8 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:41.944118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02266031-e52f-4753-878a-86fbcefe20a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:41.944419 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02266031-e52f-4753-878a-86fbcefe20a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:41.955374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02266031-e52f-4753-878a-86fbcefe20a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:41.957488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02266031-e52f-4753-878a-86fbcefe20a8 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:41.972655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1238/2503] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:08:47.956583 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4ad44-ef15-40b1-bab1-3ded4fe63a99 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:47.958302 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-93e4ad44-ef15-40b1-bab1-3ded4fe63a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:48.018374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:48.053632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4ad44-ef15-40b1-bab1-3ded4fe63a99 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:48.059399 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5e567-2950-4135-b395-0b7ca659cf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:48.062427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5e567-2950-4135-b395-0b7ca659cf7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:48.062427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5e567-2950-4135-b395-0b7ca659cf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:48.062427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5e567-2950-4135-b395-0b7ca659cf7d admin admin] PATH_INFO: `/v3/users/858f5ec58c3f4b19968421f15bb94319` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:48.062427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5e567-2950-4135-b395-0b7ca659cf7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=858f5ec58c3f4b19968421f15bb94319)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:48.064813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5e567-2950-4135-b395-0b7ca659cf7d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:48.131163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f1f5e567-2950-4135-b395-0b7ca659cf7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '858f5ec58c3f4b19968421f15bb94319'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:48.144935 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f1f5e567-2950-4135-b395-0b7ca659cf7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '858f5ec58c3f4b19968421f15bb94319'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:48.153357 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f1f5e567-2950-4135-b395-0b7ca659cf7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '858f5ec58c3f4b19968421f15bb94319'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:48.154031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f1f5e567-2950-4135-b395-0b7ca659cf7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '858f5ec58c3f4b19968421f15bb94319'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:48.163029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f1f5e567-2950-4135-b395-0b7ca659cf7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '858f5ec58c3f4b19968421f15bb94319'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:48.176549 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1266/2504] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:08:47 2022] DELETE /identity/v3/users/858f5ec58c3f4b19968421f15bb94319 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:48.178635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de74f9-4970-4fa7-ba2d-ae2d488797ad None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:48.179242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de74f9-4970-4fa7-ba2d-ae2d488797ad None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:48.179242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de74f9-4970-4fa7-ba2d-ae2d488797ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:48.205470 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a4de74f9-4970-4fa7-ba2d-ae2d488797ad None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:48.206737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a4de74f9-4970-4fa7-ba2d-ae2d488797ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:48.280371 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1239/2505] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:48.291731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5e567-2950-4135-b395-0b7ca659cf7d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:48.294904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f1f5e567-2950-4135-b395-0b7ca659cf7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:48.405572 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5e567-2950-4135-b395-0b7ca659cf7d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:48.411044 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f6cdf-c063-4e5c-a350-8b2cab7d7663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:48.411541 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f6cdf-c063-4e5c-a350-8b2cab7d7663 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:48.412897 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f6cdf-c063-4e5c-a350-8b2cab7d7663 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:48.413191 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f6cdf-c063-4e5c-a350-8b2cab7d7663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:48.427353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f6cdf-c063-4e5c-a350-8b2cab7d7663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:48.429123 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f6cdf-c063-4e5c-a350-8b2cab7d7663 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:48.446616 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1267/2506] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:08:48.931785 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de74f9-4970-4fa7-ba2d-ae2d488797ad None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:48.933653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a4de74f9-4970-4fa7-ba2d-ae2d488797ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:48.953660 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de74f9-4970-4fa7-ba2d-ae2d488797ad None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:48.966774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b0a42-3d8a-488d-abfb-cd3905f05162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:48.967706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b0a42-3d8a-488d-abfb-cd3905f05162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:48.968041 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b0a42-3d8a-488d-abfb-cd3905f05162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:48.968322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b0a42-3d8a-488d-abfb-cd3905f05162 admin admin] PATH_INFO: `/v3/projects/8ef817f770384be1b3b868cc38d1ccda` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:48.969632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b0a42-3d8a-488d-abfb-cd3905f05162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ef817f770384be1b3b868cc38d1ccda)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:48.971671 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b0a42-3d8a-488d-abfb-cd3905f05162 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:49.085354 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9a6b0a42-3d8a-488d-abfb-cd3905f05162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ef817f770384be1b3b868cc38d1ccda', 'request_id': 'req-9a6b0a42-3d8a-488d-abfb-cd3905f05162'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:49.093910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9a6b0a42-3d8a-488d-abfb-cd3905f05162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ef817f770384be1b3b868cc38d1ccda', 'request_id': 'req-9a6b0a42-3d8a-488d-abfb-cd3905f05162'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:49.101103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9a6b0a42-3d8a-488d-abfb-cd3905f05162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ef817f770384be1b3b868cc38d1ccda', 'request_id': 'req-9a6b0a42-3d8a-488d-abfb-cd3905f05162'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:49.115866 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9a6b0a42-3d8a-488d-abfb-cd3905f05162 admin admin] The token cache is being invalidate because project 8ef817f770384be1b3b868cc38d1ccda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:08:49.116202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9a6b0a42-3d8a-488d-abfb-cd3905f05162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:49.116996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9a6b0a42-3d8a-488d-abfb-cd3905f05162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:49.118777 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1240/2507] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:08:48 2022] DELETE /identity/v3/projects/8ef817f770384be1b3b868cc38d1ccda => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:08:49.125555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6f01c-c0d7-4bb8-b60b-9511654c6664 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:49.126117 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6f01c-c0d7-4bb8-b60b-9511654c6664 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:49.126331 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6f01c-c0d7-4bb8-b60b-9511654c6664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:49.151461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e4c6f01c-c0d7-4bb8-b60b-9511654c6664 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:49.153929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e4c6f01c-c0d7-4bb8-b60b-9511654c6664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:49.232890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:49.247238 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1268/2508] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:49.255303 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6f4a8-fb77-43a2-b4b1-ebc7ad489187 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:49.256256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6f4a8-fb77-43a2-b4b1-ebc7ad489187 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:49.256925 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6f4a8-fb77-43a2-b4b1-ebc7ad489187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:49.281326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2ab6f4a8-fb77-43a2-b4b1-ebc7ad489187 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:49.282623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2ab6f4a8-fb77-43a2-b4b1-ebc7ad489187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:49.295435 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1241/2509] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:49.301950 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6f01c-c0d7-4bb8-b60b-9511654c6664 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:49.321035 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6f01c-c0d7-4bb8-b60b-9511654c6664 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:49.328552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28cdf9-4aa2-4610-8159-9c4f1e53577b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:49.329456 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28cdf9-4aa2-4610-8159-9c4f1e53577b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:49.329923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28cdf9-4aa2-4610-8159-9c4f1e53577b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:49.330403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28cdf9-4aa2-4610-8159-9c4f1e53577b admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:49.331561 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28cdf9-4aa2-4610-8159-9c4f1e53577b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:08:49.332069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28cdf9-4aa2-4610-8159-9c4f1e53577b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:49.334748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28cdf9-4aa2-4610-8159-9c4f1e53577b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:49.357014 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1269/2510] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:08:49.362230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6f4a8-fb77-43a2-b4b1-ebc7ad489187 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:49.374762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6f4a8-fb77-43a2-b4b1-ebc7ad489187 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:49.379802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c41dc1-87f4-42cf-862b-639002663ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:49.380483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c41dc1-87f4-42cf-862b-639002663ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:49.380767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c41dc1-87f4-42cf-862b-639002663ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:49.381045 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c41dc1-87f4-42cf-862b-639002663ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:49.381741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c41dc1-87f4-42cf-862b-639002663ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:49.383745 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c41dc1-87f4-42cf-862b-639002663ae0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:49.387583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:49.418672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1242/2511] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:08:49 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:08:49.424850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28cdf9-4aa2-4610-8159-9c4f1e53577b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:49.437936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28cdf9-4aa2-4610-8159-9c4f1e53577b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:49.510661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04557b81-8cc9-4b62-98ee-8650b8aab646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:49.511335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04557b81-8cc9-4b62-98ee-8650b8aab646 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:49.511620 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04557b81-8cc9-4b62-98ee-8650b8aab646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:49.511900 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04557b81-8cc9-4b62-98ee-8650b8aab646 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:49.512627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04557b81-8cc9-4b62-98ee-8650b8aab646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:49.514552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04557b81-8cc9-4b62-98ee-8650b8aab646 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:49.538219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1270/2512] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:08:49 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:08:49.543323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c41dc1-87f4-42cf-862b-639002663ae0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:49.556309 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c41dc1-87f4-42cf-862b-639002663ae0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:49.563027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e3577-4fe8-4f6d-a51a-5dbf1548bb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:49.563870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e3577-4fe8-4f6d-a51a-5dbf1548bb38 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:49.564295 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e3577-4fe8-4f6d-a51a-5dbf1548bb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:49.564624 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e3577-4fe8-4f6d-a51a-5dbf1548bb38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:49.565618 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e3577-4fe8-4f6d-a51a-5dbf1548bb38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:49.567757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e3577-4fe8-4f6d-a51a-5dbf1548bb38 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:49.587557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1243/2513] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:08:49.592015 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04557b81-8cc9-4b62-98ee-8650b8aab646 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:49.602856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04557b81-8cc9-4b62-98ee-8650b8aab646 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:49.607884 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3f453-3be3-4bfb-88d0-128f684c351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:49.608573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3f453-3be3-4bfb-88d0-128f684c351b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:49.608908 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3f453-3be3-4bfb-88d0-128f684c351b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:49.609184 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3f453-3be3-4bfb-88d0-128f684c351b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:49.609963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3f453-3be3-4bfb-88d0-128f684c351b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:49.611649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3f453-3be3-4bfb-88d0-128f684c351b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:49.622439 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1271/2514] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:08:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:08:49.628210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e3577-4fe8-4f6d-a51a-5dbf1548bb38 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:49.639036 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e3577-4fe8-4f6d-a51a-5dbf1548bb38 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:49.644840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37143806-bd9b-4219-a694-d7747f8ae31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:49.645742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37143806-bd9b-4219-a694-d7747f8ae31b admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:49.645997 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37143806-bd9b-4219-a694-d7747f8ae31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:49.646289 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37143806-bd9b-4219-a694-d7747f8ae31b admin admin] PATH_INFO: `/v3/projects/a31586041dc046769f0b36edea77b036/users/52da45929be04b9fa67c8056928c7724/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:49.663228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37143806-bd9b-4219-a694-d7747f8ae31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a31586041dc046769f0b36edea77b036, user_id=52da45929be04b9fa67c8056928c7724, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:49.666257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37143806-bd9b-4219-a694-d7747f8ae31b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:49.680858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1244/2515] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:08:49 2022] PUT /identity/v3/projects/a31586041dc046769f0b36edea77b036/users/52da45929be04b9fa67c8056928c7724/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:49.691865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96f699-b66b-43ab-a6db-c8944f7faf84 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:49.692211 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96f699-b66b-43ab-a6db-c8944f7faf84 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:49.692508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff96f699-b66b-43ab-a6db-c8944f7faf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:49.729998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ff96f699-b66b-43ab-a6db-c8944f7faf84 None None] MFA Rules not processed for user `52da45929be04b9fa67c8056928c7724`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:49.731423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ff96f699-b66b-43ab-a6db-c8944f7faf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:49.819567 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1272/2516] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:49.830761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37143806-bd9b-4219-a694-d7747f8ae31b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:49.833136 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-37143806-bd9b-4219-a694-d7747f8ae31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:49.906421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37143806-bd9b-4219-a694-d7747f8ae31b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:49.911035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f5829-5faf-4ad6-8179-07771f7ab78a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:49.911795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f5829-5faf-4ad6-8179-07771f7ab78a service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:49.912124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f5829-5faf-4ad6-8179-07771f7ab78a service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:49.912408 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f5829-5faf-4ad6-8179-07771f7ab78a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:49.922965 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f5829-5faf-4ad6-8179-07771f7ab78a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:49.924474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f5829-5faf-4ad6-8179-07771f7ab78a service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:49.935424 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1245/2517] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:08:51.508655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269a5bc-357c-4df1-87d4-6dbdc756aca0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:51.509437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269a5bc-357c-4df1-87d4-6dbdc756aca0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:51.509732 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269a5bc-357c-4df1-87d4-6dbdc756aca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:51.535352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2269a5bc-357c-4df1-87d4-6dbdc756aca0 None None] MFA Rules not processed for user `52da45929be04b9fa67c8056928c7724`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:51.536710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2269a5bc-357c-4df1-87d4-6dbdc756aca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:51.546412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1273/2518] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:08:51.975125 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f5829-5faf-4ad6-8179-07771f7ab78a service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:51.976768 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a40f5829-5faf-4ad6-8179-07771f7ab78a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:52.088356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f5829-5faf-4ad6-8179-07771f7ab78a service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:52.093887 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6059b07-3fab-4a2e-bb1e-b2dd558d3458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:52.095185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6059b07-3fab-4a2e-bb1e-b2dd558d3458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:52.095578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6059b07-3fab-4a2e-bb1e-b2dd558d3458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:52.095919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6059b07-3fab-4a2e-bb1e-b2dd558d3458 admin admin] PATH_INFO: `/v3/users/cd4d7e6e844d444ba75a32e8c76e74c7` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:52.097849 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6059b07-3fab-4a2e-bb1e-b2dd558d3458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd4d7e6e844d444ba75a32e8c76e74c7)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:52.100642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6059b07-3fab-4a2e-bb1e-b2dd558d3458 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:52.198319 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c6059b07-3fab-4a2e-bb1e-b2dd558d3458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd4d7e6e844d444ba75a32e8c76e74c7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:52.212240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:52.216995 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c6059b07-3fab-4a2e-bb1e-b2dd558d3458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd4d7e6e844d444ba75a32e8c76e74c7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:52.234333 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c6059b07-3fab-4a2e-bb1e-b2dd558d3458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd4d7e6e844d444ba75a32e8c76e74c7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:52.236130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c6059b07-3fab-4a2e-bb1e-b2dd558d3458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd4d7e6e844d444ba75a32e8c76e74c7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:52.237329 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-c6059b07-3fab-4a2e-bb1e-b2dd558d3458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd4d7e6e844d444ba75a32e8c76e74c7'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:52.297523 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1246/2519] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:08:51 2022] DELETE /identity/v3/users/cd4d7e6e844d444ba75a32e8c76e74c7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:52.537373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269a5bc-357c-4df1-87d4-6dbdc756aca0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:52.552868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269a5bc-357c-4df1-87d4-6dbdc756aca0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:52.612220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:52.628639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455cf8a-e4a2-4de7-831b-0385f51ce638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:52.629799 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455cf8a-e4a2-4de7-831b-0385f51ce638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:52.631028 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455cf8a-e4a2-4de7-831b-0385f51ce638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:52.631337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455cf8a-e4a2-4de7-831b-0385f51ce638 admin admin] PATH_INFO: `/v3/projects/6c1e8ba5c17642059b89490a176c1e77` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:52.632825 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455cf8a-e4a2-4de7-831b-0385f51ce638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c1e8ba5c17642059b89490a176c1e77)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:52.634971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455cf8a-e4a2-4de7-831b-0385f51ce638 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:52.695226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3455cf8a-e4a2-4de7-831b-0385f51ce638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c1e8ba5c17642059b89490a176c1e77', 'request_id': 'req-3455cf8a-e4a2-4de7-831b-0385f51ce638'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:52.706448 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3455cf8a-e4a2-4de7-831b-0385f51ce638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c1e8ba5c17642059b89490a176c1e77', 'request_id': 'req-3455cf8a-e4a2-4de7-831b-0385f51ce638'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:52.718490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3455cf8a-e4a2-4de7-831b-0385f51ce638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c1e8ba5c17642059b89490a176c1e77', 'request_id': 'req-3455cf8a-e4a2-4de7-831b-0385f51ce638'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:52.737002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3455cf8a-e4a2-4de7-831b-0385f51ce638 admin admin] The token cache is being invalidate because project 6c1e8ba5c17642059b89490a176c1e77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:08:52.737503 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3455cf8a-e4a2-4de7-831b-0385f51ce638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:52.738621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3455cf8a-e4a2-4de7-831b-0385f51ce638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:52.741277 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1274/2520] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:08:52 2022] DELETE /identity/v3/projects/6c1e8ba5c17642059b89490a176c1e77 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:52.747272 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6059b07-3fab-4a2e-bb1e-b2dd558d3458 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:52.748610 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c6059b07-3fab-4a2e-bb1e-b2dd558d3458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:52.764678 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6059b07-3fab-4a2e-bb1e-b2dd558d3458 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:52.846420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd298ae-d59d-46cc-9c58-fe59ba046baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:52.847372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd298ae-d59d-46cc-9c58-fe59ba046baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:52.847649 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd298ae-d59d-46cc-9c58-fe59ba046baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:52.847919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd298ae-d59d-46cc-9c58-fe59ba046baa admin admin] PATH_INFO: `/v3/users/1c1af503224346209f51bd23209429c0` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:52.849393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd298ae-d59d-46cc-9c58-fe59ba046baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c1af503224346209f51bd23209429c0)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:52.851334 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd298ae-d59d-46cc-9c58-fe59ba046baa admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:52.919459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-acd298ae-d59d-46cc-9c58-fe59ba046baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c1af503224346209f51bd23209429c0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:52.930558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-acd298ae-d59d-46cc-9c58-fe59ba046baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c1af503224346209f51bd23209429c0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:52.940683 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-acd298ae-d59d-46cc-9c58-fe59ba046baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c1af503224346209f51bd23209429c0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:52.941344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-acd298ae-d59d-46cc-9c58-fe59ba046baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c1af503224346209f51bd23209429c0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:52.941945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-acd298ae-d59d-46cc-9c58-fe59ba046baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c1af503224346209f51bd23209429c0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:52.966520 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1247/2521] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:08:52 2022] DELETE /identity/v3/users/1c1af503224346209f51bd23209429c0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:53.167437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455cf8a-e4a2-4de7-831b-0385f51ce638 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:53.169478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3455cf8a-e4a2-4de7-831b-0385f51ce638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:53.185590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455cf8a-e4a2-4de7-831b-0385f51ce638 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:53.256031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f515b23-4310-4653-88c1-2d2c43587cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:53.257073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f515b23-4310-4653-88c1-2d2c43587cde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:53.257392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f515b23-4310-4653-88c1-2d2c43587cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:53.257758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f515b23-4310-4653-88c1-2d2c43587cde admin admin] PATH_INFO: `/v3/projects/f9c69691525e4884a028b3d7dc4a14de` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:53.259407 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f515b23-4310-4653-88c1-2d2c43587cde admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c69691525e4884a028b3d7dc4a14de)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:53.262461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f515b23-4310-4653-88c1-2d2c43587cde admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:53.319087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3f515b23-4310-4653-88c1-2d2c43587cde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c69691525e4884a028b3d7dc4a14de', 'request_id': 'req-3f515b23-4310-4653-88c1-2d2c43587cde'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:53.328930 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3f515b23-4310-4653-88c1-2d2c43587cde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c69691525e4884a028b3d7dc4a14de', 'request_id': 'req-3f515b23-4310-4653-88c1-2d2c43587cde'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:53.336295 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3f515b23-4310-4653-88c1-2d2c43587cde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c69691525e4884a028b3d7dc4a14de', 'request_id': 'req-3f515b23-4310-4653-88c1-2d2c43587cde'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:53.351750 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3f515b23-4310-4653-88c1-2d2c43587cde admin admin] The token cache is being invalidate because project f9c69691525e4884a028b3d7dc4a14de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:08:53.352122 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3f515b23-4310-4653-88c1-2d2c43587cde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:53.352800 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-3f515b23-4310-4653-88c1-2d2c43587cde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:08:53.354473 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1275/2522] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:08:53 2022] DELETE /identity/v3/projects/f9c69691525e4884a028b3d7dc4a14de => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:53.359803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e1623-f6e2-41e6-adfb-bf64ba1a9b7f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:53.360319 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e1623-f6e2-41e6-adfb-bf64ba1a9b7f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:53.360426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e1623-f6e2-41e6-adfb-bf64ba1a9b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:53.381135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-c73e1623-f6e2-41e6-adfb-bf64ba1a9b7f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:53.382362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-c73e1623-f6e2-41e6-adfb-bf64ba1a9b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:53.437259 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:53.456327 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1248/2523] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:53.466314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb330bbb-0375-4d61-bfad-53aa3d8769fa None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:53.466550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb330bbb-0375-4d61-bfad-53aa3d8769fa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:53.467633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb330bbb-0375-4d61-bfad-53aa3d8769fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:53.483902 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:53.494342 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-eb330bbb-0375-4d61-bfad-53aa3d8769fa None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:53.501258 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-eb330bbb-0375-4d61-bfad-53aa3d8769fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:53.515516 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1276/2524] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:53.520269 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e1623-f6e2-41e6-adfb-bf64ba1a9b7f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:53.531120 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e1623-f6e2-41e6-adfb-bf64ba1a9b7f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:53.537760 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41879007-389a-440a-aa0f-39a4432e5149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:53.538509 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41879007-389a-440a-aa0f-39a4432e5149 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:53.538794 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41879007-389a-440a-aa0f-39a4432e5149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:53.539201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41879007-389a-440a-aa0f-39a4432e5149 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:53.540361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41879007-389a-440a-aa0f-39a4432e5149 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:08:53.540715 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41879007-389a-440a-aa0f-39a4432e5149 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:53.542628 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41879007-389a-440a-aa0f-39a4432e5149 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:53.557362 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1249/2525] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 16:08:53.561687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb330bbb-0375-4d61-bfad-53aa3d8769fa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:53.573250 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb330bbb-0375-4d61-bfad-53aa3d8769fa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:53.579751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f117eec-e7cc-4449-baef-9f89dac30f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:53.580672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f117eec-e7cc-4449-baef-9f89dac30f64 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:53.580963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f117eec-e7cc-4449-baef-9f89dac30f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:53.581243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f117eec-e7cc-4449-baef-9f89dac30f64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:53.581978 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f117eec-e7cc-4449-baef-9f89dac30f64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:53.584128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f117eec-e7cc-4449-baef-9f89dac30f64 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:53.633184 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1277/2526] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:08:53 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:08:53.634508 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41879007-389a-440a-aa0f-39a4432e5149 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:53.646146 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41879007-389a-440a-aa0f-39a4432e5149 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:53.771061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a22ea-64ca-4012-b946-073adab12556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:53.771954 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a22ea-64ca-4012-b946-073adab12556 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:53.772380 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a22ea-64ca-4012-b946-073adab12556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:53.773216 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a22ea-64ca-4012-b946-073adab12556 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:53.773757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a22ea-64ca-4012-b946-073adab12556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:53.775929 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a22ea-64ca-4012-b946-073adab12556 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:53.813714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1250/2527] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:08:53 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:08:53.815479 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f117eec-e7cc-4449-baef-9f89dac30f64 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:53.827453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f117eec-e7cc-4449-baef-9f89dac30f64 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:53.832941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12762381-a320-4013-91b5-77b6fe74e480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:53.833764 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12762381-a320-4013-91b5-77b6fe74e480 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:53.834152 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12762381-a320-4013-91b5-77b6fe74e480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:53.834551 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12762381-a320-4013-91b5-77b6fe74e480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:53.835635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12762381-a320-4013-91b5-77b6fe74e480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:53.837529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12762381-a320-4013-91b5-77b6fe74e480 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:53.851563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1278/2528] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:08:53.856278 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a22ea-64ca-4012-b946-073adab12556 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:53.870108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a22ea-64ca-4012-b946-073adab12556 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:53.875969 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06275b8f-3e5a-4ae8-aece-b8190ab9fc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:53.876658 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06275b8f-3e5a-4ae8-aece-b8190ab9fc99 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:53.876939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06275b8f-3e5a-4ae8-aece-b8190ab9fc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:53.877280 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06275b8f-3e5a-4ae8-aece-b8190ab9fc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:53.878102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06275b8f-3e5a-4ae8-aece-b8190ab9fc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:53.879994 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06275b8f-3e5a-4ae8-aece-b8190ab9fc99 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:53.893033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1251/2529] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:08:53.897283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12762381-a320-4013-91b5-77b6fe74e480 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:53.909056 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12762381-a320-4013-91b5-77b6fe74e480 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:53.914651 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de87a41-adf5-4f10-9361-494449a14e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:53.915990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de87a41-adf5-4f10-9361-494449a14e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:53.916271 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de87a41-adf5-4f10-9361-494449a14e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:53.916548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de87a41-adf5-4f10-9361-494449a14e45 admin admin] PATH_INFO: `/v3/projects/57f2e6976ce040268978c196ae07dc60/users/053785c929364571a8648890e9275a98/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:53.935410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de87a41-adf5-4f10-9361-494449a14e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f2e6976ce040268978c196ae07dc60, user_id=053785c929364571a8648890e9275a98, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:53.938891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de87a41-adf5-4f10-9361-494449a14e45 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:53.954707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1279/2530] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:08:53 2022] PUT /identity/v3/projects/57f2e6976ce040268978c196ae07dc60/users/053785c929364571a8648890e9275a98/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:54.027966 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05694df-b4ea-41d7-b464-3f54652eb029 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:54.028368 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05694df-b4ea-41d7-b464-3f54652eb029 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:54.028820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05694df-b4ea-41d7-b464-3f54652eb029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:54.065202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b05694df-b4ea-41d7-b464-3f54652eb029 None None] MFA Rules not processed for user `053785c929364571a8648890e9275a98`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:54.066487 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b05694df-b4ea-41d7-b464-3f54652eb029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:54.170780 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1252/2531] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:54.175523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de87a41-adf5-4f10-9361-494449a14e45 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:54.268062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de87a41-adf5-4f10-9361-494449a14e45 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:54.276220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bf37e-2a9d-4b0a-bb22-7df77e3876e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:54.277470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bf37e-2a9d-4b0a-bb22-7df77e3876e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:54.277470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bf37e-2a9d-4b0a-bb22-7df77e3876e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:54.277723 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bf37e-2a9d-4b0a-bb22-7df77e3876e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:54.278428 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bf37e-2a9d-4b0a-bb22-7df77e3876e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:54.280986 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828bf37e-2a9d-4b0a-bb22-7df77e3876e9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:54.316299 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1280/2532] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:08:54 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:08:54.321324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05694df-b4ea-41d7-b464-3f54652eb029 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:54.334921 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05694df-b4ea-41d7-b464-3f54652eb029 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:54.392586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:54.409974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6efaba-f266-4e65-9cf1-ce1719e5aa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:54.410656 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6efaba-f266-4e65-9cf1-ce1719e5aa06 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:54.411020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6efaba-f266-4e65-9cf1-ce1719e5aa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:54.411451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6efaba-f266-4e65-9cf1-ce1719e5aa06 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:54.412399 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6efaba-f266-4e65-9cf1-ce1719e5aa06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:54.414627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6efaba-f266-4e65-9cf1-ce1719e5aa06 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:54.444463 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1253/2533] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:08:54 2022] POST /identity/v3/users => generated 298 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:08:54.446654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bf37e-2a9d-4b0a-bb22-7df77e3876e9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:54.458479 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828bf37e-2a9d-4b0a-bb22-7df77e3876e9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:54.463468 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c56a08-c205-4cfe-9020-c129a4612d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:54.464153 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c56a08-c205-4cfe-9020-c129a4612d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:54.464435 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c56a08-c205-4cfe-9020-c129a4612d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:54.464713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c56a08-c205-4cfe-9020-c129a4612d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:54.465454 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c56a08-c205-4cfe-9020-c129a4612d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:54.467324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c56a08-c205-4cfe-9020-c129a4612d5f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:54.480577 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1281/2534] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:08:54.484245 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6efaba-f266-4e65-9cf1-ce1719e5aa06 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:54.500186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6efaba-f266-4e65-9cf1-ce1719e5aa06 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:54.506550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8694514-6e3b-4c35-bac8-747db99a81f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:54.507593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8694514-6e3b-4c35-bac8-747db99a81f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:54.507876 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8694514-6e3b-4c35-bac8-747db99a81f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:54.508161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8694514-6e3b-4c35-bac8-747db99a81f2 admin admin] PATH_INFO: `/v3/projects/73bc801267824c6bbd104bf58ec8ac9f/users/54b448538689415a871be5620abfe874/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:54.528272 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8694514-6e3b-4c35-bac8-747db99a81f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bc801267824c6bbd104bf58ec8ac9f, user_id=54b448538689415a871be5620abfe874, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:54.531996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8694514-6e3b-4c35-bac8-747db99a81f2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:54.552469 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1254/2535] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:08:54 2022] PUT /identity/v3/projects/73bc801267824c6bbd104bf58ec8ac9f/users/54b448538689415a871be5620abfe874/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:54.557489 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c56a08-c205-4cfe-9020-c129a4612d5f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:54.569822 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c56a08-c205-4cfe-9020-c129a4612d5f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:54.646319 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210ffd6-8153-432f-8dcf-2b9f92ae1983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:54.647055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210ffd6-8153-432f-8dcf-2b9f92ae1983 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:54.647339 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210ffd6-8153-432f-8dcf-2b9f92ae1983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:54.647613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210ffd6-8153-432f-8dcf-2b9f92ae1983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:54.648352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210ffd6-8153-432f-8dcf-2b9f92ae1983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:54.649981 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210ffd6-8153-432f-8dcf-2b9f92ae1983 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:54.662310 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1282/2536] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:08:54.667053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8694514-6e3b-4c35-bac8-747db99a81f2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:54.678091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8694514-6e3b-4c35-bac8-747db99a81f2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:54.683327 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88531508-c9a5-414a-9b7b-433f98325f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:54.684301 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88531508-c9a5-414a-9b7b-433f98325f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:54.684564 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88531508-c9a5-414a-9b7b-433f98325f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:54.685480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88531508-c9a5-414a-9b7b-433f98325f62 admin admin] PATH_INFO: `/v3/projects/73bc801267824c6bbd104bf58ec8ac9f/users/54b448538689415a871be5620abfe874/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:54.687104 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88531508-c9a5-414a-9b7b-433f98325f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bc801267824c6bbd104bf58ec8ac9f, user_id=54b448538689415a871be5620abfe874, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:54.689776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88531508-c9a5-414a-9b7b-433f98325f62 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:54.701950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1255/2537] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:08:54 2022] PUT /identity/v3/projects/73bc801267824c6bbd104bf58ec8ac9f/users/54b448538689415a871be5620abfe874/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:08:54.713288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b27aff-0d08-4492-b811-e5127b9866ed None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:54.713794 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b27aff-0d08-4492-b811-e5127b9866ed None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:54.714252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b27aff-0d08-4492-b811-e5127b9866ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:54.753066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:08:54.757660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b3b27aff-0d08-4492-b811-e5127b9866ed None None] MFA Rules not processed for user `54b448538689415a871be5620abfe874`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:08:54.759717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b3b27aff-0d08-4492-b811-e5127b9866ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:54.862468 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1283/2538] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:08:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:08:54.874545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88531508-c9a5-414a-9b7b-433f98325f62 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:54.876527 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-88531508-c9a5-414a-9b7b-433f98325f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:54.950311 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88531508-c9a5-414a-9b7b-433f98325f62 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:54.955934 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee662087-6f83-4fe7-8db5-b09f126998f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:54.956871 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee662087-6f83-4fe7-8db5-b09f126998f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:54.957345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee662087-6f83-4fe7-8db5-b09f126998f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:54.957571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee662087-6f83-4fe7-8db5-b09f126998f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:55.029642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee662087-6f83-4fe7-8db5-b09f126998f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:55.031556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee662087-6f83-4fe7-8db5-b09f126998f7 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:55.043468 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1256/2539] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:08:59.632547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b27aff-0d08-4492-b811-e5127b9866ed None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:08:59.634182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b3b27aff-0d08-4492-b811-e5127b9866ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:08:59.647686 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b27aff-0d08-4492-b811-e5127b9866ed None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:08:59.652613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b23f8-6650-45ce-b656-84fbb7297f5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:08:59.653276 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b23f8-6650-45ce-b656-84fbb7297f5f service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:08:59.653559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b23f8-6650-45ce-b656-84fbb7297f5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:08:59.653839 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b23f8-6650-45ce-b656-84fbb7297f5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:08:59.665012 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b23f8-6650-45ce-b656-84fbb7297f5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:08:59.666584 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b23f8-6650-45ce-b656-84fbb7297f5f service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:08:59.680155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1284/2540] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:08:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:09:04.737803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee662087-6f83-4fe7-8db5-b09f126998f7 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:04.800279 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:09:04.812753 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee662087-6f83-4fe7-8db5-b09f126998f7 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:04.817566 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d401a1-ad7a-46a4-a34c-5b25ff83f804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:04.818464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d401a1-ad7a-46a4-a34c-5b25ff83f804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:04.818746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d401a1-ad7a-46a4-a34c-5b25ff83f804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:04.819144 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d401a1-ad7a-46a4-a34c-5b25ff83f804 admin admin] PATH_INFO: `/v3/users/053785c929364571a8648890e9275a98` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:04.820258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d401a1-ad7a-46a4-a34c-5b25ff83f804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=053785c929364571a8648890e9275a98)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:04.822206 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d401a1-ad7a-46a4-a34c-5b25ff83f804 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:04.872576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-81d401a1-ad7a-46a4-a34c-5b25ff83f804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '053785c929364571a8648890e9275a98'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:04.882997 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-81d401a1-ad7a-46a4-a34c-5b25ff83f804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '053785c929364571a8648890e9275a98'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:04.891655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-81d401a1-ad7a-46a4-a34c-5b25ff83f804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '053785c929364571a8648890e9275a98'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:04.892374 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-81d401a1-ad7a-46a4-a34c-5b25ff83f804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '053785c929364571a8648890e9275a98'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:04.892970 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-81d401a1-ad7a-46a4-a34c-5b25ff83f804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '053785c929364571a8648890e9275a98'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:04.911788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1257/2541] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:09:04 2022] DELETE /identity/v3/users/053785c929364571a8648890e9275a98 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:09:04.916699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88285516-548d-4709-858a-fff6ca166ac0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:04.917233 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88285516-548d-4709-858a-fff6ca166ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:04.917346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88285516-548d-4709-858a-fff6ca166ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:04.936351 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-88285516-548d-4709-858a-fff6ca166ac0 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:09:04.937578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-88285516-548d-4709-858a-fff6ca166ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:05.000177 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1285/2542] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:09:05.011012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d401a1-ad7a-46a4-a34c-5b25ff83f804 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:05.012813 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-81d401a1-ad7a-46a4-a34c-5b25ff83f804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:05.073398 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d401a1-ad7a-46a4-a34c-5b25ff83f804 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:05.077774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78111e3-5ca0-42df-a092-0fc03ffe3460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:05.078435 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78111e3-5ca0-42df-a092-0fc03ffe3460 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:05.078713 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78111e3-5ca0-42df-a092-0fc03ffe3460 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:05.079026 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78111e3-5ca0-42df-a092-0fc03ffe3460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:05.089763 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78111e3-5ca0-42df-a092-0fc03ffe3460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:05.091262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78111e3-5ca0-42df-a092-0fc03ffe3460 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:05.101470 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1258/2543] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:09:05.410307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88285516-548d-4709-858a-fff6ca166ac0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:05.411875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-88285516-548d-4709-858a-fff6ca166ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:05.429900 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88285516-548d-4709-858a-fff6ca166ac0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:05.436021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e319f-f5e8-47d7-b967-53f6fa448e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:05.437123 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e319f-f5e8-47d7-b967-53f6fa448e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:05.437362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e319f-f5e8-47d7-b967-53f6fa448e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:05.437470 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e319f-f5e8-47d7-b967-53f6fa448e0c admin admin] PATH_INFO: `/v3/projects/57f2e6976ce040268978c196ae07dc60` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:05.438767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e319f-f5e8-47d7-b967-53f6fa448e0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f2e6976ce040268978c196ae07dc60)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:05.440757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e319f-f5e8-47d7-b967-53f6fa448e0c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:05.491566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d46e319f-f5e8-47d7-b967-53f6fa448e0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f2e6976ce040268978c196ae07dc60', 'request_id': 'req-d46e319f-f5e8-47d7-b967-53f6fa448e0c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:05.501190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d46e319f-f5e8-47d7-b967-53f6fa448e0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f2e6976ce040268978c196ae07dc60', 'request_id': 'req-d46e319f-f5e8-47d7-b967-53f6fa448e0c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:05.508090 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d46e319f-f5e8-47d7-b967-53f6fa448e0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f2e6976ce040268978c196ae07dc60', 'request_id': 'req-d46e319f-f5e8-47d7-b967-53f6fa448e0c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:05.520004 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d46e319f-f5e8-47d7-b967-53f6fa448e0c admin admin] The token cache is being invalidate because project 57f2e6976ce040268978c196ae07dc60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:09:05.520298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d46e319f-f5e8-47d7-b967-53f6fa448e0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:05.521044 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d46e319f-f5e8-47d7-b967-53f6fa448e0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:05.522834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1286/2544] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:09:05 2022] DELETE /identity/v3/projects/57f2e6976ce040268978c196ae07dc60 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:09:05.527140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78111e3-5ca0-42df-a092-0fc03ffe3460 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:05.536949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78111e3-5ca0-42df-a092-0fc03ffe3460 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:05.595314 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283825d-eae2-4bb3-a5d0-f2a97a8a0af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:05.596206 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283825d-eae2-4bb3-a5d0-f2a97a8a0af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:05.596483 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283825d-eae2-4bb3-a5d0-f2a97a8a0af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:05.596753 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283825d-eae2-4bb3-a5d0-f2a97a8a0af2 admin admin] PATH_INFO: `/v3/users/54b448538689415a871be5620abfe874` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:05.597957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283825d-eae2-4bb3-a5d0-f2a97a8a0af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b448538689415a871be5620abfe874)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:05.599949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283825d-eae2-4bb3-a5d0-f2a97a8a0af2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:05.617979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:09:05.657788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b283825d-eae2-4bb3-a5d0-f2a97a8a0af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b448538689415a871be5620abfe874'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:05.666957 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b283825d-eae2-4bb3-a5d0-f2a97a8a0af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b448538689415a871be5620abfe874'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:05.676706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b283825d-eae2-4bb3-a5d0-f2a97a8a0af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b448538689415a871be5620abfe874'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:05.677450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b283825d-eae2-4bb3-a5d0-f2a97a8a0af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b448538689415a871be5620abfe874'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:05.678064 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b283825d-eae2-4bb3-a5d0-f2a97a8a0af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b448538689415a871be5620abfe874'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:05.703044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1259/2545] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:09:05 2022] DELETE /identity/v3/users/54b448538689415a871be5620abfe874 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:09:05.992943 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e319f-f5e8-47d7-b967-53f6fa448e0c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:05.994424 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d46e319f-f5e8-47d7-b967-53f6fa448e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:06.009100 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e319f-f5e8-47d7-b967-53f6fa448e0c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:06.015652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:09:06.075289 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a28b15-0b5e-4e1a-af0b-86553202d2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:06.076098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a28b15-0b5e-4e1a-af0b-86553202d2bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:06.076383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a28b15-0b5e-4e1a-af0b-86553202d2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:06.076707 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a28b15-0b5e-4e1a-af0b-86553202d2bd admin admin] PATH_INFO: `/v3/projects/73bc801267824c6bbd104bf58ec8ac9f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:06.078120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a28b15-0b5e-4e1a-af0b-86553202d2bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=73bc801267824c6bbd104bf58ec8ac9f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:06.080283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a28b15-0b5e-4e1a-af0b-86553202d2bd admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:06.132062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-47a28b15-0b5e-4e1a-af0b-86553202d2bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73bc801267824c6bbd104bf58ec8ac9f', 'request_id': 'req-47a28b15-0b5e-4e1a-af0b-86553202d2bd'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:06.140771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-47a28b15-0b5e-4e1a-af0b-86553202d2bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73bc801267824c6bbd104bf58ec8ac9f', 'request_id': 'req-47a28b15-0b5e-4e1a-af0b-86553202d2bd'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:06.147537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-47a28b15-0b5e-4e1a-af0b-86553202d2bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73bc801267824c6bbd104bf58ec8ac9f', 'request_id': 'req-47a28b15-0b5e-4e1a-af0b-86553202d2bd'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:06.159608 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-47a28b15-0b5e-4e1a-af0b-86553202d2bd admin admin] The token cache is being invalidate because project 73bc801267824c6bbd104bf58ec8ac9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:09:06.159901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-47a28b15-0b5e-4e1a-af0b-86553202d2bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:06.160626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-47a28b15-0b5e-4e1a-af0b-86553202d2bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:06.162327 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1287/2546] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:09:05 2022] DELETE /identity/v3/projects/73bc801267824c6bbd104bf58ec8ac9f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:09:06.168991 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b0de2-603a-47a8-b5e6-7bae67d87932 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:06.169515 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b0de2-603a-47a8-b5e6-7bae67d87932 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:06.169515 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b0de2-603a-47a8-b5e6-7bae67d87932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:06.189882 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bd2b0de2-603a-47a8-b5e6-7bae67d87932 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:09:06.191090 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bd2b0de2-603a-47a8-b5e6-7bae67d87932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:06.257628 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1260/2547] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:09:06.267639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b005e-63cd-4ce6-85ba-da03b5ac7ccb None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:06.267928 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b005e-63cd-4ce6-85ba-da03b5ac7ccb None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:06.268220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b005e-63cd-4ce6-85ba-da03b5ac7ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:06.290259 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-845b005e-63cd-4ce6-85ba-da03b5ac7ccb None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:09:06.292025 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-845b005e-63cd-4ce6-85ba-da03b5ac7ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:06.301448 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1288/2548] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:09:06.306075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b0de2-603a-47a8-b5e6-7bae67d87932 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:06.316184 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b0de2-603a-47a8-b5e6-7bae67d87932 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:06.321735 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ee81a-5a5a-4de4-93f7-24712e274255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:06.322396 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ee81a-5a5a-4de4-93f7-24712e274255 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:06.322679 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ee81a-5a5a-4de4-93f7-24712e274255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:06.322980 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ee81a-5a5a-4de4-93f7-24712e274255 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:06.323721 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ee81a-5a5a-4de4-93f7-24712e274255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:09:06.324012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ee81a-5a5a-4de4-93f7-24712e274255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:06.325709 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ee81a-5a5a-4de4-93f7-24712e274255 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:06.338242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1261/2549] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:09:06.342640 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b005e-63cd-4ce6-85ba-da03b5ac7ccb None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:06.352559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b005e-63cd-4ce6-85ba-da03b5ac7ccb None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:06.358571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5655cb-7553-4624-8f81-2f81501b1386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:06.359283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5655cb-7553-4624-8f81-2f81501b1386 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:06.359582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5655cb-7553-4624-8f81-2f81501b1386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:06.359854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5655cb-7553-4624-8f81-2f81501b1386 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:06.360564 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5655cb-7553-4624-8f81-2f81501b1386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:06.362511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5655cb-7553-4624-8f81-2f81501b1386 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:06.400041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1289/2550] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:09:06 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:09:06.405125 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ee81a-5a5a-4de4-93f7-24712e274255 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:06.416405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ee81a-5a5a-4de4-93f7-24712e274255 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:06.479647 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da760643-225d-4537-95db-5522bd4e3b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:06.480344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da760643-225d-4537-95db-5522bd4e3b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:06.480627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da760643-225d-4537-95db-5522bd4e3b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:06.480903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da760643-225d-4537-95db-5522bd4e3b07 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:06.481606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da760643-225d-4537-95db-5522bd4e3b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:06.483660 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da760643-225d-4537-95db-5522bd4e3b07 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:06.509091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1262/2551] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:09:06 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:09:06.513388 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5655cb-7553-4624-8f81-2f81501b1386 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:06.525817 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5655cb-7553-4624-8f81-2f81501b1386 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:06.531411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf492e-fe69-4b6a-ac9f-b846fcf2e39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:06.532202 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf492e-fe69-4b6a-ac9f-b846fcf2e39b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:06.532478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf492e-fe69-4b6a-ac9f-b846fcf2e39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:06.532753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf492e-fe69-4b6a-ac9f-b846fcf2e39b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:06.533491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf492e-fe69-4b6a-ac9f-b846fcf2e39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:06.535117 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf492e-fe69-4b6a-ac9f-b846fcf2e39b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:06.549148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1290/2552] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:09:06.553662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da760643-225d-4537-95db-5522bd4e3b07 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:06.565134 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da760643-225d-4537-95db-5522bd4e3b07 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:06.570642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28d2b4-192c-4d0b-ad73-39779057f3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:06.571390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28d2b4-192c-4d0b-ad73-39779057f3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:06.571830 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28d2b4-192c-4d0b-ad73-39779057f3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:06.572118 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28d2b4-192c-4d0b-ad73-39779057f3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:06.572831 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28d2b4-192c-4d0b-ad73-39779057f3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:06.574609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca28d2b4-192c-4d0b-ad73-39779057f3a3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:06.581673 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:09:06.590540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1263/2553] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:09:06.593742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf492e-fe69-4b6a-ac9f-b846fcf2e39b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:06.605423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf492e-fe69-4b6a-ac9f-b846fcf2e39b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:06.610223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944dab34-4854-4490-a5e4-097f4747a3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:06.611173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dab34-4854-4490-a5e4-097f4747a3a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:06.611483 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dab34-4854-4490-a5e4-097f4747a3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:06.611757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944dab34-4854-4490-a5e4-097f4747a3a0 admin admin] PATH_INFO: `/v3/projects/47875613157f4fe5a404f8f1942ff65c/users/3bbe7e6110d24acc88ad9f0ae1912230/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:06.629166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944dab34-4854-4490-a5e4-097f4747a3a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47875613157f4fe5a404f8f1942ff65c, user_id=3bbe7e6110d24acc88ad9f0ae1912230, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:06.631992 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944dab34-4854-4490-a5e4-097f4747a3a0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:06.649336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1291/2554] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:09:06 2022] PUT /identity/v3/projects/47875613157f4fe5a404f8f1942ff65c/users/3bbe7e6110d24acc88ad9f0ae1912230/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:09:06.661557 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc3394-f59f-482f-a031-6b503e2785dc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:06.661840 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc3394-f59f-482f-a031-6b503e2785dc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:06.662116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc3394-f59f-482f-a031-6b503e2785dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:06.695454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-38cc3394-f59f-482f-a031-6b503e2785dc None None] MFA Rules not processed for user `3bbe7e6110d24acc88ad9f0ae1912230`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:09:06.696696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-38cc3394-f59f-482f-a031-6b503e2785dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:06.771394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1264/2555] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:09:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:09:06.783513 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944dab34-4854-4490-a5e4-097f4747a3a0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:06.785481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-944dab34-4854-4490-a5e4-097f4747a3a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:06.829680 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:09:06.852462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944dab34-4854-4490-a5e4-097f4747a3a0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:06.856961 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4258b-9c2f-44c7-bb40-08f67720a67b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:06.858216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4258b-9c2f-44c7-bb40-08f67720a67b service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:06.858685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4258b-9c2f-44c7-bb40-08f67720a67b service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:06.859042 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4258b-9c2f-44c7-bb40-08f67720a67b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:06.874379 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4258b-9c2f-44c7-bb40-08f67720a67b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:06.875860 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4258b-9c2f-44c7-bb40-08f67720a67b service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:06.885495 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1292/2556] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:09:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:09:09.460025 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc3394-f59f-482f-a031-6b503e2785dc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:09.526944 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc3394-f59f-482f-a031-6b503e2785dc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:09.531701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40b88d-0459-42ad-9d15-e3f64afe4368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:09.532589 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40b88d-0459-42ad-9d15-e3f64afe4368 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:09.532870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40b88d-0459-42ad-9d15-e3f64afe4368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:09.533139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b40b88d-0459-42ad-9d15-e3f64afe4368 admin admin] PATH_INFO: `/v3/users/3bbe7e6110d24acc88ad9f0ae1912230` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:09.534342 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40b88d-0459-42ad-9d15-e3f64afe4368 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bbe7e6110d24acc88ad9f0ae1912230)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:09.536315 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b40b88d-0459-42ad-9d15-e3f64afe4368 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:09.585655 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4b40b88d-0459-42ad-9d15-e3f64afe4368 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bbe7e6110d24acc88ad9f0ae1912230'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:09.592539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4b40b88d-0459-42ad-9d15-e3f64afe4368 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bbe7e6110d24acc88ad9f0ae1912230'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:09.599901 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4b40b88d-0459-42ad-9d15-e3f64afe4368 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bbe7e6110d24acc88ad9f0ae1912230'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:09.600540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4b40b88d-0459-42ad-9d15-e3f64afe4368 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bbe7e6110d24acc88ad9f0ae1912230'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:09.601206 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-4b40b88d-0459-42ad-9d15-e3f64afe4368 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bbe7e6110d24acc88ad9f0ae1912230'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:09.619792 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1265/2557] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:09:09 2022] DELETE /identity/v3/users/3bbe7e6110d24acc88ad9f0ae1912230 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:09:09.625018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979665-cd5b-49d7-bcd3-60b82b50113d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:09.625552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979665-cd5b-49d7-bcd3-60b82b50113d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:09.625552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61979665-cd5b-49d7-bcd3-60b82b50113d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:09.643586 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-61979665-cd5b-49d7-bcd3-60b82b50113d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:09:09.644805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-61979665-cd5b-49d7-bcd3-60b82b50113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:09.708253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1293/2558] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:09:09.719130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40b88d-0459-42ad-9d15-e3f64afe4368 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:09.721493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4b40b88d-0459-42ad-9d15-e3f64afe4368 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:09.735438 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:09:09.798163 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b40b88d-0459-42ad-9d15-e3f64afe4368 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:09.802261 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdccf10-f2ca-4277-9ea2-22c2f563b54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:09.803002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdccf10-f2ca-4277-9ea2-22c2f563b54a service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:09.803286 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdccf10-f2ca-4277-9ea2-22c2f563b54a service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:09.803561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdccf10-f2ca-4277-9ea2-22c2f563b54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:09.815787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdccf10-f2ca-4277-9ea2-22c2f563b54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:09.817337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdccf10-f2ca-4277-9ea2-22c2f563b54a service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:09.827710 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1266/2559] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:09:10.156561 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61979665-cd5b-49d7-bcd3-60b82b50113d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:10.162712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-61979665-cd5b-49d7-bcd3-60b82b50113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:10.190036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61979665-cd5b-49d7-bcd3-60b82b50113d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:10.203635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0605ec-894a-4d54-b0be-de0e65a39b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:10.205002 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0605ec-894a-4d54-b0be-de0e65a39b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:10.205523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0605ec-894a-4d54-b0be-de0e65a39b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:10.206487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0605ec-894a-4d54-b0be-de0e65a39b20 admin admin] PATH_INFO: `/v3/projects/47875613157f4fe5a404f8f1942ff65c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:10.208447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0605ec-894a-4d54-b0be-de0e65a39b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47875613157f4fe5a404f8f1942ff65c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:10.210903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0605ec-894a-4d54-b0be-de0e65a39b20 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:10.339107 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b0605ec-894a-4d54-b0be-de0e65a39b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47875613157f4fe5a404f8f1942ff65c', 'request_id': 'req-8b0605ec-894a-4d54-b0be-de0e65a39b20'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:10.349998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b0605ec-894a-4d54-b0be-de0e65a39b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47875613157f4fe5a404f8f1942ff65c', 'request_id': 'req-8b0605ec-894a-4d54-b0be-de0e65a39b20'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:10.357463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b0605ec-894a-4d54-b0be-de0e65a39b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47875613157f4fe5a404f8f1942ff65c', 'request_id': 'req-8b0605ec-894a-4d54-b0be-de0e65a39b20'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:10.370896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b0605ec-894a-4d54-b0be-de0e65a39b20 admin admin] The token cache is being invalidate because project 47875613157f4fe5a404f8f1942ff65c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:09:10.371098 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b0605ec-894a-4d54-b0be-de0e65a39b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:10.371804 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b0605ec-894a-4d54-b0be-de0e65a39b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:10.373838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1294/2560] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:09:10 2022] DELETE /identity/v3/projects/47875613157f4fe5a404f8f1942ff65c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:09:11.503193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75c292-9f88-4583-a5ed-60172a91f6ef None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:11.503659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75c292-9f88-4583-a5ed-60172a91f6ef None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:11.503750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75c292-9f88-4583-a5ed-60172a91f6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:11.522378 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4d75c292-9f88-4583-a5ed-60172a91f6ef None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:09:11.523647 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4d75c292-9f88-4583-a5ed-60172a91f6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:11.583555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1267/2561] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 16:09:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:09:11.605436 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0605ec-894a-4d54-b0be-de0e65a39b20 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:11.607186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8b0605ec-894a-4d54-b0be-de0e65a39b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:11.674305 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:09:11.679378 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0605ec-894a-4d54-b0be-de0e65a39b20 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:11.686103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380b319-4234-4688-a169-91196dd1519e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:11.687114 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380b319-4234-4688-a169-91196dd1519e service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:11.687421 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380b319-4234-4688-a169-91196dd1519e service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:11.687805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380b319-4234-4688-a169-91196dd1519e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:11.696564 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380b319-4234-4688-a169-91196dd1519e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:11.698179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7380b319-4234-4688-a169-91196dd1519e service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:11.706755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1295/2562] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:09:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 16:09:12.255791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93656c01-26a6-4d6e-819f-62077bf2590c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:12.256161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93656c01-26a6-4d6e-819f-62077bf2590c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:12.256449 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93656c01-26a6-4d6e-819f-62077bf2590c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:12.276312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-93656c01-26a6-4d6e-819f-62077bf2590c None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:09:12.277584 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-93656c01-26a6-4d6e-819f-62077bf2590c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:12.285340 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1268/2563] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 21 16:09:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:09:12.299559 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380b319-4234-4688-a169-91196dd1519e service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:12.311283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380b319-4234-4688-a169-91196dd1519e service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:12.317362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a985c-03c7-4b71-a9fa-8131edeeb48e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:12.318042 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a985c-03c7-4b71-a9fa-8131edeeb48e service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:12.318337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a985c-03c7-4b71-a9fa-8131edeeb48e service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:12.318594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a985c-03c7-4b71-a9fa-8131edeeb48e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:12.328813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a985c-03c7-4b71-a9fa-8131edeeb48e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:12.330455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582a985c-03c7-4b71-a9fa-8131edeeb48e service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:12.340358 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1296/2564] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:09:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 16:09:12.570358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1782f-3b96-4cd5-9109-d13a635a6d69 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:12.570844 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1782f-3b96-4cd5-9109-d13a635a6d69 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:12.570959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1782f-3b96-4cd5-9109-d13a635a6d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:12.589040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-e3a1782f-3b96-4cd5-9109-d13a635a6d69 None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:09:12.590230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e3a1782f-3b96-4cd5-9109-d13a635a6d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:12.597902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1269/2565] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 16:09:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:09:12.610431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a985c-03c7-4b71-a9fa-8131edeeb48e service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:12.621805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a985c-03c7-4b71-a9fa-8131edeeb48e service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:12.628249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb351fd-953c-49be-a7ab-67c44d7ba9ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:12.628886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb351fd-953c-49be-a7ab-67c44d7ba9ed service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:12.629198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb351fd-953c-49be-a7ab-67c44d7ba9ed service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:12.629479 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb351fd-953c-49be-a7ab-67c44d7ba9ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:12.638467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb351fd-953c-49be-a7ab-67c44d7ba9ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:12.640113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb351fd-953c-49be-a7ab-67c44d7ba9ed service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:12.648691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1297/2566] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:09:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 16:09:12.989688 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0afae9-d12b-49b3-8d70-56c328ef758b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:12.989974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0afae9-d12b-49b3-8d70-56c328ef758b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:12.990250 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0afae9-d12b-49b3-8d70-56c328ef758b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:13.009289 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0a0afae9-d12b-49b3-8d70-56c328ef758b None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:09:13.010408 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0a0afae9-d12b-49b3-8d70-56c328ef758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:13.020389 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1270/2567] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 21 16:09:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:09:13.032885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb351fd-953c-49be-a7ab-67c44d7ba9ed service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:13.044514 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb351fd-953c-49be-a7ab-67c44d7ba9ed service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:13.051189 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4532a-2a4e-49f4-8796-72057c125bec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:13.051842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4532a-2a4e-49f4-8796-72057c125bec service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:13.052117 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4532a-2a4e-49f4-8796-72057c125bec service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:13.052392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4532a-2a4e-49f4-8796-72057c125bec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:13.061681 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4532a-2a4e-49f4-8796-72057c125bec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:13.063309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4532a-2a4e-49f4-8796-72057c125bec service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:13.071612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1298/2568] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:09:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 16:09:15.149940 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0afae9-d12b-49b3-8d70-56c328ef758b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:15.151827 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0a0afae9-d12b-49b3-8d70-56c328ef758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:15.230084 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0afae9-d12b-49b3-8d70-56c328ef758b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:15.235919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0fd07-d92b-485a-b357-adbb4d5e57b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:15.236853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0fd07-d92b-485a-b357-adbb4d5e57b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:15.237130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0fd07-d92b-485a-b357-adbb4d5e57b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:15.237397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0fd07-d92b-485a-b357-adbb4d5e57b0 admin admin] PATH_INFO: `/v3/users/52da45929be04b9fa67c8056928c7724` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:15.238761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0fd07-d92b-485a-b357-adbb4d5e57b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52da45929be04b9fa67c8056928c7724)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:15.240775 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0fd07-d92b-485a-b357-adbb4d5e57b0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:15.290317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:09:15.298780 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fea0fd07-d92b-485a-b357-adbb4d5e57b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52da45929be04b9fa67c8056928c7724'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:15.306189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fea0fd07-d92b-485a-b357-adbb4d5e57b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52da45929be04b9fa67c8056928c7724'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:15.315418 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fea0fd07-d92b-485a-b357-adbb4d5e57b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52da45929be04b9fa67c8056928c7724'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:15.316051 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fea0fd07-d92b-485a-b357-adbb4d5e57b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52da45929be04b9fa67c8056928c7724'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:15.316940 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fea0fd07-d92b-485a-b357-adbb4d5e57b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52da45929be04b9fa67c8056928c7724'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:15.336095 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1271/2569] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:09:15 2022] DELETE /identity/v3/users/52da45929be04b9fa67c8056928c7724 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:09:15.341622 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a41bd1-83be-41d6-83d1-74cf104cb09d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:15.342132 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a41bd1-83be-41d6-83d1-74cf104cb09d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:15.342268 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a41bd1-83be-41d6-83d1-74cf104cb09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:15.364784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-99a41bd1-83be-41d6-83d1-74cf104cb09d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:09:15.366023 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-99a41bd1-83be-41d6-83d1-74cf104cb09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:15.432393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1299/2570] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:09:15.444358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0fd07-d92b-485a-b357-adbb4d5e57b0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:15.446829 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fea0fd07-d92b-485a-b357-adbb4d5e57b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:15.507899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0fd07-d92b-485a-b357-adbb4d5e57b0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:15.511841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f11eb0-e4d2-4fef-a104-37112596a821 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:15.512487 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f11eb0-e4d2-4fef-a104-37112596a821 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:15.512765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f11eb0-e4d2-4fef-a104-37112596a821 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:15.513034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f11eb0-e4d2-4fef-a104-37112596a821 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:15.522843 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f11eb0-e4d2-4fef-a104-37112596a821 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:15.524320 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f11eb0-e4d2-4fef-a104-37112596a821 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:15.533964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1272/2571] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:09:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:09:15.713310 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a41bd1-83be-41d6-83d1-74cf104cb09d None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:09:15.714848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-99a41bd1-83be-41d6-83d1-74cf104cb09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:09:15.727965 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a41bd1-83be-41d6-83d1-74cf104cb09d None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:09:15.733932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:09:15.734847 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:09:15.735139 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:09:15.735794 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1 admin admin] PATH_INFO: `/v3/projects/a31586041dc046769f0b36edea77b036` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:09:15.736936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a31586041dc046769f0b36edea77b036)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:09:15.738920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:09:15.788259 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a31586041dc046769f0b36edea77b036', 'request_id': 'req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:15.796405 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a31586041dc046769f0b36edea77b036', 'request_id': 'req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:15.802737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a31586041dc046769f0b36edea77b036', 'request_id': 'req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:15.813639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1 admin admin] The token cache is being invalidate because project a31586041dc046769f0b36edea77b036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:09:15.813925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:15.814587 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:09:15.816210 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1300/2572] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:09:15 2022] DELETE /identity/v3/projects/a31586041dc046769f0b36edea77b036 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:09:25.529660 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=5,keystone:SELECT=40,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:09:25.810628 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:10:36.110941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45fa47-706f-4530-a647-578316a558df None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:10:36.111554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45fa47-706f-4530-a647-578316a558df None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:10:36.111554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45fa47-706f-4530-a647-578316a558df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:10:36.129219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cf45fa47-706f-4530-a647-578316a558df None None] MFA Rules not processed for user `35f595da10d34af4b1eeb5a3ec4a69b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:10:36.130446 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cf45fa47-706f-4530-a647-578316a558df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:10:36.189285 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1273/2573] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:10:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:10:43.495958 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:10:43.497684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:10:43.567880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816a9cb-9060-4954-a4df-cc1a34ba1ac1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:10:43.572097 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f889e-3256-4438-a6ed-10f46f213ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:10:43.572768 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f889e-3256-4438-a6ed-10f46f213ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:10:43.573058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f889e-3256-4438-a6ed-10f46f213ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:10:43.573343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f889e-3256-4438-a6ed-10f46f213ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:10:43.575649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4f5f889e-3256-4438-a6ed-10f46f213ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:10:43.651782 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f889e-3256-4438-a6ed-10f46f213ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:10:43.653352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f889e-3256-4438-a6ed-10f46f213ed1 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:10:43.666534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1301/2574] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:10:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:10:46.182435 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=25 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:10:49.197715 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20953aa0-6637-4abe-9be7-de9348f295a1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:10:49.198268 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20953aa0-6637-4abe-9be7-de9348f295a1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:10:49.198268 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20953aa0-6637-4abe-9be7-de9348f295a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:10:49.217422 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-20953aa0-6637-4abe-9be7-de9348f295a1 None None] MFA Rules not processed for user `3212bd24e1f84b70872940214632536f`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:10:49.218663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-20953aa0-6637-4abe-9be7-de9348f295a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:10:49.276357 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1274/2575] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:10:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:10:49.289253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f889e-3256-4438-a6ed-10f46f213ed1 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:10:49.290876 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4f5f889e-3256-4438-a6ed-10f46f213ed1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:10:49.305637 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f889e-3256-4438-a6ed-10f46f213ed1 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:10:49.311950 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868858c-a655-4fb0-958f-c8e89b0201bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:10:49.312685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868858c-a655-4fb0-958f-c8e89b0201bb service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:10:49.312898 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868858c-a655-4fb0-958f-c8e89b0201bb service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:10:49.313187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868858c-a655-4fb0-958f-c8e89b0201bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:10:49.315106 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1868858c-a655-4fb0-958f-c8e89b0201bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:10:49.326599 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868858c-a655-4fb0-958f-c8e89b0201bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:10:49.328252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1868858c-a655-4fb0-958f-c8e89b0201bb service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:10:49.337388 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1302/2576] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:10:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:10:49.961089 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20953aa0-6637-4abe-9be7-de9348f295a1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:10:49.971059 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20953aa0-6637-4abe-9be7-de9348f295a1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:10:49.974708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d1408-0cee-489c-baae-87eda5603246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:10:49.975395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d1408-0cee-489c-baae-87eda5603246 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:10:49.975673 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d1408-0cee-489c-baae-87eda5603246 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:10:49.975942 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d1408-0cee-489c-baae-87eda5603246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:10:49.977835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cf5d1408-0cee-489c-baae-87eda5603246 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:10:49.992728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d1408-0cee-489c-baae-87eda5603246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:10:49.994205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d1408-0cee-489c-baae-87eda5603246 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:10:50.006575 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1275/2577] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:10:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:10:59.333287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=60 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:11:00.000665 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=31 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:11:32.185010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868858c-a655-4fb0-958f-c8e89b0201bb service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:11:32.186624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1868858c-a655-4fb0-958f-c8e89b0201bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:11:32.207337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868858c-a655-4fb0-958f-c8e89b0201bb service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:11:32.211779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf344a-c1b5-4f19-9405-62685b268974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:11:32.213093 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf344a-c1b5-4f19-9405-62685b268974 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:11:32.213539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf344a-c1b5-4f19-9405-62685b268974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:11:32.214016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf344a-c1b5-4f19-9405-62685b268974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:11:32.216979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c3cf344a-c1b5-4f19-9405-62685b268974 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:11:32.229758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf344a-c1b5-4f19-9405-62685b268974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:11:32.232359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf344a-c1b5-4f19-9405-62685b268974 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:11:32.246287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1303/2578] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:11:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:11:41.251238 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d1408-0cee-489c-baae-87eda5603246 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:11:41.263886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d1408-0cee-489c-baae-87eda5603246 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:11:41.270801 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3029c-5312-4b08-a1b1-b6662434f10a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:11:41.271727 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3029c-5312-4b08-a1b1-b6662434f10a service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:11:41.272037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3029c-5312-4b08-a1b1-b6662434f10a service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:11:41.272302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3029c-5312-4b08-a1b1-b6662434f10a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:11:41.275311 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d4e3029c-5312-4b08-a1b1-b6662434f10a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:11:41.295614 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3029c-5312-4b08-a1b1-b6662434f10a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:11:41.298748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3029c-5312-4b08-a1b1-b6662434f10a service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:11:41.317821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1276/2579] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:11:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:11:42.239830 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:11:42.615851 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a509306-9e47-49f3-be47-11deb138f4aa None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:11:42.616151 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a509306-9e47-49f3-be47-11deb138f4aa None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:11:42.616436 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a509306-9e47-49f3-be47-11deb138f4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:11:42.637865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7a509306-9e47-49f3-be47-11deb138f4aa None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:11:42.639214 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7a509306-9e47-49f3-be47-11deb138f4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:11:42.708333 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1304/2580] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 21 16:11:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:11:42.764576 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3029c-5312-4b08-a1b1-b6662434f10a service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:11:42.766094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d4e3029c-5312-4b08-a1b1-b6662434f10a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:11:42.839565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3029c-5312-4b08-a1b1-b6662434f10a service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:11:42.846435 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b682c85-5967-42da-8d9b-3338ec62be45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:11:42.847452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b682c85-5967-42da-8d9b-3338ec62be45 service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:11:42.847828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b682c85-5967-42da-8d9b-3338ec62be45 service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:11:42.848236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b682c85-5967-42da-8d9b-3338ec62be45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:11:42.861010 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b682c85-5967-42da-8d9b-3338ec62be45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:11:42.863377 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b682c85-5967-42da-8d9b-3338ec62be45 service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:11:42.875757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1277/2581] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:11:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 16:11:46.830550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a509306-9e47-49f3-be47-11deb138f4aa None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:11:46.832930 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7a509306-9e47-49f3-be47-11deb138f4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:11:46.956949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a509306-9e47-49f3-be47-11deb138f4aa None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:11:46.966726 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e548a3-8118-43a4-a451-a0333b6d94bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:11:46.967853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e548a3-8118-43a4-a451-a0333b6d94bd service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:11:46.968446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e548a3-8118-43a4-a451-a0333b6d94bd service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:11:46.969007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e548a3-8118-43a4-a451-a0333b6d94bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:11:46.972314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-67e548a3-8118-43a4-a451-a0333b6d94bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:11:46.994167 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e548a3-8118-43a4-a451-a0333b6d94bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:11:46.997175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e548a3-8118-43a4-a451-a0333b6d94bd service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:11:47.015211 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1305/2582] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:11:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:11:49.183586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b682c85-5967-42da-8d9b-3338ec62be45 service swift] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:11:49.188166 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7b682c85-5967-42da-8d9b-3338ec62be45 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:11:49.280102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b682c85-5967-42da-8d9b-3338ec62be45 service swift] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:11:49.284328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad54f1-cf7d-416f-8f2e-9753738be063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:11:49.285055 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad54f1-cf7d-416f-8f2e-9753738be063 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:11:49.285341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad54f1-cf7d-416f-8f2e-9753738be063 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:11:49.285619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad54f1-cf7d-416f-8f2e-9753738be063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:11:49.287696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b7ad54f1-cf7d-416f-8f2e-9753738be063 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:11:49.303985 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad54f1-cf7d-416f-8f2e-9753738be063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:11:49.305456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad54f1-cf7d-416f-8f2e-9753738be063 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:11:49.316131 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1278/2583] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:11:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:11:50.454736 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e548a3-8118-43a4-a451-a0333b6d94bd service placement] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:11:50.457066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-67e548a3-8118-43a4-a451-a0333b6d94bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:11:50.537310 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e548a3-8118-43a4-a451-a0333b6d94bd service placement] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:11:50.543756 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb69f53-f113-4d02-b8f5-26a8ad4bb896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:11:50.544820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb69f53-f113-4d02-b8f5-26a8ad4bb896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:11:50.545285 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb69f53-f113-4d02-b8f5-26a8ad4bb896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:11:50.545573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb69f53-f113-4d02-b8f5-26a8ad4bb896 admin admin] PATH_INFO: `/v3/users/288442cf94b84c56ad28957275fa7d7b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:11:50.547075 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb69f53-f113-4d02-b8f5-26a8ad4bb896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=288442cf94b84c56ad28957275fa7d7b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:11:50.549124 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb69f53-f113-4d02-b8f5-26a8ad4bb896 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:11:50.605390 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:11:50.622030 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-abb69f53-f113-4d02-b8f5-26a8ad4bb896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '288442cf94b84c56ad28957275fa7d7b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:50.638867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-abb69f53-f113-4d02-b8f5-26a8ad4bb896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '288442cf94b84c56ad28957275fa7d7b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:50.648050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-abb69f53-f113-4d02-b8f5-26a8ad4bb896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '288442cf94b84c56ad28957275fa7d7b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:50.648886 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-abb69f53-f113-4d02-b8f5-26a8ad4bb896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '288442cf94b84c56ad28957275fa7d7b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:50.657572 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-abb69f53-f113-4d02-b8f5-26a8ad4bb896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '288442cf94b84c56ad28957275fa7d7b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:50.663907 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1306/2584] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:11:50 2022] DELETE /identity/v3/users/288442cf94b84c56ad28957275fa7d7b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:11:50.882589 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad54f1-cf7d-416f-8f2e-9753738be063 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:11:50.901084 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad54f1-cf7d-416f-8f2e-9753738be063 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:11:50.978969 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc7e73-25bc-44ea-ad79-4d53488175a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:11:50.980294 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc7e73-25bc-44ea-ad79-4d53488175a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:11:50.980580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc7e73-25bc-44ea-ad79-4d53488175a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:11:50.980857 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc7e73-25bc-44ea-ad79-4d53488175a5 admin admin] PATH_INFO: `/v3/projects/74b182011cbe4f8498ccd5d8d454b6ae` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:11:50.982205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc7e73-25bc-44ea-ad79-4d53488175a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b182011cbe4f8498ccd5d8d454b6ae)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:11:50.984192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc7e73-25bc-44ea-ad79-4d53488175a5 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:11:51.014705 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:11:51.050453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f4bc7e73-25bc-44ea-ad79-4d53488175a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b182011cbe4f8498ccd5d8d454b6ae', 'request_id': 'req-f4bc7e73-25bc-44ea-ad79-4d53488175a5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:51.058082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f4bc7e73-25bc-44ea-ad79-4d53488175a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b182011cbe4f8498ccd5d8d454b6ae', 'request_id': 'req-f4bc7e73-25bc-44ea-ad79-4d53488175a5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:51.064830 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f4bc7e73-25bc-44ea-ad79-4d53488175a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b182011cbe4f8498ccd5d8d454b6ae', 'request_id': 'req-f4bc7e73-25bc-44ea-ad79-4d53488175a5'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:51.079316 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f4bc7e73-25bc-44ea-ad79-4d53488175a5 admin admin] The token cache is being invalidate because project 74b182011cbe4f8498ccd5d8d454b6ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:11:51.079615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f4bc7e73-25bc-44ea-ad79-4d53488175a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:51.080673 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-f4bc7e73-25bc-44ea-ad79-4d53488175a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:51.082243 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1279/2585] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:11:50 2022] DELETE /identity/v3/projects/74b182011cbe4f8498ccd5d8d454b6ae => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:11:51.086655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb69f53-f113-4d02-b8f5-26a8ad4bb896 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:11:51.088171 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-abb69f53-f113-4d02-b8f5-26a8ad4bb896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:11:51.102842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb69f53-f113-4d02-b8f5-26a8ad4bb896 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:11:51.167918 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322de6-850b-47e9-8889-f9d4d47e596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:11:51.168204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322de6-850b-47e9-8889-f9d4d47e596f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:11:51.168519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322de6-850b-47e9-8889-f9d4d47e596f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:11:51.168807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b322de6-850b-47e9-8889-f9d4d47e596f admin admin] PATH_INFO: `/v3/users/65476251f2fe40ccb80331e7a6cc14ec` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:11:51.170072 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b322de6-850b-47e9-8889-f9d4d47e596f admin admin] RBAC: Authorizing `identity:delete_user(user_id=65476251f2fe40ccb80331e7a6cc14ec)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:11:51.172061 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b322de6-850b-47e9-8889-f9d4d47e596f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:11:51.240209 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b322de6-850b-47e9-8889-f9d4d47e596f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65476251f2fe40ccb80331e7a6cc14ec'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:51.255250 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b322de6-850b-47e9-8889-f9d4d47e596f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65476251f2fe40ccb80331e7a6cc14ec'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:51.265584 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b322de6-850b-47e9-8889-f9d4d47e596f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65476251f2fe40ccb80331e7a6cc14ec'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:51.266628 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b322de6-850b-47e9-8889-f9d4d47e596f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65476251f2fe40ccb80331e7a6cc14ec'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:51.279441 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8b322de6-850b-47e9-8889-f9d4d47e596f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65476251f2fe40ccb80331e7a6cc14ec'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:51.290369 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1307/2586] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:11:51 2022] DELETE /identity/v3/users/65476251f2fe40ccb80331e7a6cc14ec => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:11:51.511021 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc7e73-25bc-44ea-ad79-4d53488175a5 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:11:51.513456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f4bc7e73-25bc-44ea-ad79-4d53488175a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:11:51.535853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc7e73-25bc-44ea-ad79-4d53488175a5 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:11:51.609167 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafff464-6425-428d-9439-e47a207ef36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:11:51.610705 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafff464-6425-428d-9439-e47a207ef36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:11:51.611295 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafff464-6425-428d-9439-e47a207ef36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:11:51.611809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafff464-6425-428d-9439-e47a207ef36f admin admin] PATH_INFO: `/v3/projects/949cc83380004b6c880606c522b6ce8c` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:11:51.613960 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafff464-6425-428d-9439-e47a207ef36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=949cc83380004b6c880606c522b6ce8c)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:11:51.617816 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafff464-6425-428d-9439-e47a207ef36f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:11:51.683436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eafff464-6425-428d-9439-e47a207ef36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '949cc83380004b6c880606c522b6ce8c', 'request_id': 'req-eafff464-6425-428d-9439-e47a207ef36f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:51.691414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eafff464-6425-428d-9439-e47a207ef36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '949cc83380004b6c880606c522b6ce8c', 'request_id': 'req-eafff464-6425-428d-9439-e47a207ef36f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:51.698607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eafff464-6425-428d-9439-e47a207ef36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '949cc83380004b6c880606c522b6ce8c', 'request_id': 'req-eafff464-6425-428d-9439-e47a207ef36f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:51.712714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eafff464-6425-428d-9439-e47a207ef36f admin admin] The token cache is being invalidate because project 949cc83380004b6c880606c522b6ce8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:11:51.712995 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eafff464-6425-428d-9439-e47a207ef36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:51.713619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-eafff464-6425-428d-9439-e47a207ef36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:11:51.715251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1280/2587] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:11:51 2022] DELETE /identity/v3/projects/949cc83380004b6c880606c522b6ce8c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:12:01.283453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=68,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:12:01.709506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:12:07.366628 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322de6-850b-47e9-8889-f9d4d47e596f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:12:07.368255 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8b322de6-850b-47e9-8889-f9d4d47e596f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:07.430160 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b322de6-850b-47e9-8889-f9d4d47e596f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:12:07.483631 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e975f2-067b-4a6d-8017-aef6e085b801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:12:07.484267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e975f2-067b-4a6d-8017-aef6e085b801 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:07.484557 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e975f2-067b-4a6d-8017-aef6e085b801 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:07.484834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e975f2-067b-4a6d-8017-aef6e085b801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:07.486949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-09e975f2-067b-4a6d-8017-aef6e085b801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:07.550827 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e975f2-067b-4a6d-8017-aef6e085b801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:12:07.552310 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e975f2-067b-4a6d-8017-aef6e085b801 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:12:07.562430 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1308/2588] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:12:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:12:10.791451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafff464-6425-428d-9439-e47a207ef36f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:12:10.792992 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-eafff464-6425-428d-9439-e47a207ef36f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:10.872563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e975f2-067b-4a6d-8017-aef6e085b801 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:12:10.874303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-09e975f2-067b-4a6d-8017-aef6e085b801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:10.888528 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e975f2-067b-4a6d-8017-aef6e085b801 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:12:10.888782 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafff464-6425-428d-9439-e47a207ef36f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:12:10.893784 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fea7ae-bd8d-4c54-acb3-3f9fc401bc81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:12:10.894448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fea7ae-bd8d-4c54-acb3-3f9fc401bc81 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:10.894726 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fea7ae-bd8d-4c54-acb3-3f9fc401bc81 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:10.895028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fea7ae-bd8d-4c54-acb3-3f9fc401bc81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:10.896794 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-41fea7ae-bd8d-4c54-acb3-3f9fc401bc81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:10.901697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01cca8b-16df-4c18-a6d7-7e18d200c1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:12:10.903553 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cca8b-16df-4c18-a6d7-7e18d200c1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:10.904898 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cca8b-16df-4c18-a6d7-7e18d200c1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:10.905432 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01cca8b-16df-4c18-a6d7-7e18d200c1c4 admin admin] PATH_INFO: `/v3/users/35f595da10d34af4b1eeb5a3ec4a69b7` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:10.907138 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cca8b-16df-4c18-a6d7-7e18d200c1c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f595da10d34af4b1eeb5a3ec4a69b7)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:12:10.909201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01cca8b-16df-4c18-a6d7-7e18d200c1c4 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:12:10.919138 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fea7ae-bd8d-4c54-acb3-3f9fc401bc81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:12:10.920847 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fea7ae-bd8d-4c54-acb3-3f9fc401bc81 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:12:10.933402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1281/2589] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:12:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:12:10.969066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e01cca8b-16df-4c18-a6d7-7e18d200c1c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f595da10d34af4b1eeb5a3ec4a69b7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:12:10.982222 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:12:10.985209 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e01cca8b-16df-4c18-a6d7-7e18d200c1c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f595da10d34af4b1eeb5a3ec4a69b7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:12:10.994685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e01cca8b-16df-4c18-a6d7-7e18d200c1c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f595da10d34af4b1eeb5a3ec4a69b7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:12:10.995498 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e01cca8b-16df-4c18-a6d7-7e18d200c1c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f595da10d34af4b1eeb5a3ec4a69b7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:12:11.002865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e01cca8b-16df-4c18-a6d7-7e18d200c1c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f595da10d34af4b1eeb5a3ec4a69b7'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:12:11.009058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1309/2590] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:12:10 2022] DELETE /identity/v3/users/35f595da10d34af4b1eeb5a3ec4a69b7 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:12:11.188662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fea7ae-bd8d-4c54-acb3-3f9fc401bc81 service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:12:11.212652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fea7ae-bd8d-4c54-acb3-3f9fc401bc81 service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:12:11.275465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75579cd6-c34f-478e-8cb4-4c809e7751cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:12:11.276356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75579cd6-c34f-478e-8cb4-4c809e7751cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:11.276631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75579cd6-c34f-478e-8cb4-4c809e7751cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:11.276902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75579cd6-c34f-478e-8cb4-4c809e7751cb admin admin] PATH_INFO: `/v3/projects/a6434c8ace4940eab84d949fe10245ae` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:11.278633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75579cd6-c34f-478e-8cb4-4c809e7751cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6434c8ace4940eab84d949fe10245ae)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:12:11.280632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75579cd6-c34f-478e-8cb4-4c809e7751cb admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:12:11.338633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-75579cd6-c34f-478e-8cb4-4c809e7751cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6434c8ace4940eab84d949fe10245ae', 'request_id': 'req-75579cd6-c34f-478e-8cb4-4c809e7751cb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:12:11.345363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-75579cd6-c34f-478e-8cb4-4c809e7751cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6434c8ace4940eab84d949fe10245ae', 'request_id': 'req-75579cd6-c34f-478e-8cb4-4c809e7751cb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:12:11.351361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-75579cd6-c34f-478e-8cb4-4c809e7751cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6434c8ace4940eab84d949fe10245ae', 'request_id': 'req-75579cd6-c34f-478e-8cb4-4c809e7751cb'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:12:11.365726 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-75579cd6-c34f-478e-8cb4-4c809e7751cb admin admin] The token cache is being invalidate because project a6434c8ace4940eab84d949fe10245ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:12:11.366100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-75579cd6-c34f-478e-8cb4-4c809e7751cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:12:11.366767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-75579cd6-c34f-478e-8cb4-4c809e7751cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:12:11.368369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1282/2591] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:12:11 2022] DELETE /identity/v3/projects/a6434c8ace4940eab84d949fe10245ae => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:12:11.373564 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1a676-79b8-4d7d-b242-dfbace459057 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:11.373860 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1a676-79b8-4d7d-b242-dfbace459057 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:11.374147 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1a676-79b8-4d7d-b242-dfbace459057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:11.392991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-94e1a676-79b8-4d7d-b242-dfbace459057 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:12:11.394233 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-94e1a676-79b8-4d7d-b242-dfbace459057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:11.459598 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1310/2592] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:12:11.467699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753ecf2-3a6b-42ac-88fe-002c93b030bb None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:11.468016 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753ecf2-3a6b-42ac-88fe-002c93b030bb None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:11.468345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753ecf2-3a6b-42ac-88fe-002c93b030bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:11.487148 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-9753ecf2-3a6b-42ac-88fe-002c93b030bb None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:12:11.488373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9753ecf2-3a6b-42ac-88fe-002c93b030bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:11.497259 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1283/2593] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:12:11.501796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1a676-79b8-4d7d-b242-dfbace459057 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:12:11.511690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1a676-79b8-4d7d-b242-dfbace459057 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:12:11.516401 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64940a-1aef-4fba-a78b-5fa0e356fcea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:12:11.517083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64940a-1aef-4fba-a78b-5fa0e356fcea admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:11.517364 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64940a-1aef-4fba-a78b-5fa0e356fcea admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:11.517639 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64940a-1aef-4fba-a78b-5fa0e356fcea admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:11.518384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64940a-1aef-4fba-a78b-5fa0e356fcea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:12:11.518686 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64940a-1aef-4fba-a78b-5fa0e356fcea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:12:11.520359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64940a-1aef-4fba-a78b-5fa0e356fcea admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:12:11.534005 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1311/2594] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:12:11.538730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753ecf2-3a6b-42ac-88fe-002c93b030bb None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:12:11.548426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753ecf2-3a6b-42ac-88fe-002c93b030bb None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:12:11.554398 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171630e1-edc5-40a9-afc7-2f96a524f27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:12:11.555108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171630e1-edc5-40a9-afc7-2f96a524f27e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:11.555385 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171630e1-edc5-40a9-afc7-2f96a524f27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:11.555626 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171630e1-edc5-40a9-afc7-2f96a524f27e admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:11.556335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171630e1-edc5-40a9-afc7-2f96a524f27e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:12:11.558249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171630e1-edc5-40a9-afc7-2f96a524f27e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:12:11.569207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:12:11.586913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1284/2595] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:12:11 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:12:11.591890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64940a-1aef-4fba-a78b-5fa0e356fcea admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:12:11.602618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64940a-1aef-4fba-a78b-5fa0e356fcea admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:12:11.666651 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97feea-9f2f-45f3-aaf9-7ff161ac9f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:12:11.667392 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97feea-9f2f-45f3-aaf9-7ff161ac9f6a admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:11.667676 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97feea-9f2f-45f3-aaf9-7ff161ac9f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:11.667962 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97feea-9f2f-45f3-aaf9-7ff161ac9f6a admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:11.668682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97feea-9f2f-45f3-aaf9-7ff161ac9f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:12:11.670635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97feea-9f2f-45f3-aaf9-7ff161ac9f6a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:12:11.691645 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1312/2596] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:12:11 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:12:11.696088 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171630e1-edc5-40a9-afc7-2f96a524f27e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:12:11.706849 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171630e1-edc5-40a9-afc7-2f96a524f27e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:12:11.712653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bc991-6f67-4217-8ab3-b67b0785645f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:12:11.713327 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bc991-6f67-4217-8ab3-b67b0785645f admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:11.713635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bc991-6f67-4217-8ab3-b67b0785645f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:11.713879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90bc991-6f67-4217-8ab3-b67b0785645f admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:11.714617 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90bc991-6f67-4217-8ab3-b67b0785645f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:12:11.716314 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90bc991-6f67-4217-8ab3-b67b0785645f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:12:11.727339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1285/2597] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:12:11.731716 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97feea-9f2f-45f3-aaf9-7ff161ac9f6a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:12:11.742236 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97feea-9f2f-45f3-aaf9-7ff161ac9f6a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:12:11.747380 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1abe892-28c6-465c-b57a-0e0f3796104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:12:11.748044 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abe892-28c6-465c-b57a-0e0f3796104c admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:11.748327 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abe892-28c6-465c-b57a-0e0f3796104c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:11.748607 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1abe892-28c6-465c-b57a-0e0f3796104c admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:11.749379 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1abe892-28c6-465c-b57a-0e0f3796104c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:12:11.751033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1abe892-28c6-465c-b57a-0e0f3796104c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:12:11.761609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1313/2598] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:12:11.766006 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bc991-6f67-4217-8ab3-b67b0785645f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:12:11.776471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90bc991-6f67-4217-8ab3-b67b0785645f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:12:11.782421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995f319-f341-4411-90aa-0612bd2679bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:12:11.783386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995f319-f341-4411-90aa-0612bd2679bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:11.783672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995f319-f341-4411-90aa-0612bd2679bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:11.783947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995f319-f341-4411-90aa-0612bd2679bd admin admin] PATH_INFO: `/v3/projects/09f00bf2b35846eb8d91a5464d348d0c/users/dd0f22fa4ee8472f89eb3de52d066cfd/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:11.799510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995f319-f341-4411-90aa-0612bd2679bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f00bf2b35846eb8d91a5464d348d0c, user_id=dd0f22fa4ee8472f89eb3de52d066cfd, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:12:11.802196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995f319-f341-4411-90aa-0612bd2679bd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:12:11.818060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1286/2599] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:12:11 2022] PUT /identity/v3/projects/09f00bf2b35846eb8d91a5464d348d0c/users/dd0f22fa4ee8472f89eb3de52d066cfd/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:12:11.823405 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a38719-e491-48fe-8ee7-815a44e78bbe None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:11.823699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a38719-e491-48fe-8ee7-815a44e78bbe None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:11.823981 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a38719-e491-48fe-8ee7-815a44e78bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:11.972034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a2a38719-e491-48fe-8ee7-815a44e78bbe None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:12:11.973161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a2a38719-e491-48fe-8ee7-815a44e78bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:12.015052 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:12:12.038071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1314/2600] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:12:12.048136 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995f319-f341-4411-90aa-0612bd2679bd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:12:12.049988 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6995f319-f341-4411-90aa-0612bd2679bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:12.109378 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995f319-f341-4411-90aa-0612bd2679bd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:12:12.113291 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f264665-ed33-4c6a-a9a4-5703916fd15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:12:12.113942 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f264665-ed33-4c6a-a9a4-5703916fd15f service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:12.114227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f264665-ed33-4c6a-a9a4-5703916fd15f service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:12.114500 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f264665-ed33-4c6a-a9a4-5703916fd15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:12.124424 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f264665-ed33-4c6a-a9a4-5703916fd15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:12:12.125935 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f264665-ed33-4c6a-a9a4-5703916fd15f service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:12:12.135987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1287/2601] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:12:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:12:16.127519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b9299-aede-41e5-a9b0-95f27748a513 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:16.128304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b9299-aede-41e5-a9b0-95f27748a513 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:16.128304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b9299-aede-41e5-a9b0-95f27748a513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:16.155936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-151b9299-aede-41e5-a9b0-95f27748a513 None None] MFA Rules not processed for user `dd0f22fa4ee8472f89eb3de52d066cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:12:16.157046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-151b9299-aede-41e5-a9b0-95f27748a513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:16.235103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1315/2602] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:12:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:12:16.250461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f264665-ed33-4c6a-a9a4-5703916fd15f service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:12:16.252064 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0f264665-ed33-4c6a-a9a4-5703916fd15f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:16.333268 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f264665-ed33-4c6a-a9a4-5703916fd15f service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:12:16.339164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cefc5e-664a-4167-bdc6-6c12c842bfd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:12:16.339841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cefc5e-664a-4167-bdc6-6c12c842bfd4 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:16.340126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cefc5e-664a-4167-bdc6-6c12c842bfd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:16.340403 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cefc5e-664a-4167-bdc6-6c12c842bfd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:16.349518 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cefc5e-664a-4167-bdc6-6c12c842bfd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:12:16.351223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cefc5e-664a-4167-bdc6-6c12c842bfd4 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:12:16.363447 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1288/2603] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:12:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:12:17.836189 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55650e-5f04-465c-8c5b-4520a394cd6e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:17.836837 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55650e-5f04-465c-8c5b-4520a394cd6e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:17.836837 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55650e-5f04-465c-8c5b-4520a394cd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:17.856154 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-1d55650e-5f04-465c-8c5b-4520a394cd6e None None] MFA Rules not processed for user `dd0f22fa4ee8472f89eb3de52d066cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:12:17.857373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1d55650e-5f04-465c-8c5b-4520a394cd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:17.864589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1316/2604] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:12:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:12:18.229646 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cefc5e-664a-4167-bdc6-6c12c842bfd4 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:12:18.231176 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-62cefc5e-664a-4167-bdc6-6c12c842bfd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:18.243958 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cefc5e-664a-4167-bdc6-6c12c842bfd4 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:12:18.248062 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989d3f9-a858-4315-bb8c-692c1d3bdcf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:12:18.248726 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989d3f9-a858-4315-bb8c-692c1d3bdcf8 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:18.249000 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989d3f9-a858-4315-bb8c-692c1d3bdcf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:18.249273 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989d3f9-a858-4315-bb8c-692c1d3bdcf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:18.251152 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5989d3f9-a858-4315-bb8c-692c1d3bdcf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:18.261551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989d3f9-a858-4315-bb8c-692c1d3bdcf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:12:18.263141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989d3f9-a858-4315-bb8c-692c1d3bdcf8 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:12:18.271657 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1289/2605] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:12:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:12:18.840899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55650e-5f04-465c-8c5b-4520a394cd6e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:12:18.842906 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1d55650e-5f04-465c-8c5b-4520a394cd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:18.971656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55650e-5f04-465c-8c5b-4520a394cd6e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:12:18.977880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66c36f-6625-4b1b-b41f-38a746c61464 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:12:18.978699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66c36f-6625-4b1b-b41f-38a746c61464 service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:18.979292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66c36f-6625-4b1b-b41f-38a746c61464 service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:18.979810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66c36f-6625-4b1b-b41f-38a746c61464 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:18.981668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-4e66c36f-6625-4b1b-b41f-38a746c61464 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:18.994986 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66c36f-6625-4b1b-b41f-38a746c61464 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:12:18.997068 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66c36f-6625-4b1b-b41f-38a746c61464 service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:12:19.010365 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1317/2606] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:12:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:12:28.267607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=84,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:12:29.005942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=74 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:12:30.649624 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989d3f9-a858-4315-bb8c-692c1d3bdcf8 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:12:30.651298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5989d3f9-a858-4315-bb8c-692c1d3bdcf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:30.671097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989d3f9-a858-4315-bb8c-692c1d3bdcf8 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:12:30.677586 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73837cd-5be6-488c-9345-80f069728f25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:12:30.678661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73837cd-5be6-488c-9345-80f069728f25 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:30.679202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73837cd-5be6-488c-9345-80f069728f25 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:30.679729 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73837cd-5be6-488c-9345-80f069728f25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:30.682069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e73837cd-5be6-488c-9345-80f069728f25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:30.699478 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73837cd-5be6-488c-9345-80f069728f25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:12:30.701200 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73837cd-5be6-488c-9345-80f069728f25 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:12:30.705298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0679a7-59a9-4ba1-b6a4-3dd8ce131044 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:12:30.706272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0679a7-59a9-4ba1-b6a4-3dd8ce131044 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:12:30.706802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0679a7-59a9-4ba1-b6a4-3dd8ce131044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:12:30.716109 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1290/2607] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:12:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:12:30.725977 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-6f0679a7-59a9-4ba1-b6a4-3dd8ce131044 None None] MFA Rules not processed for user `3212bd24e1f84b70872940214632536f`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:12:30.727265 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6f0679a7-59a9-4ba1-b6a4-3dd8ce131044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:12:30.798980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1318/2608] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:12:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:12:40.709434 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:12:40.790357 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=25 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:13:38.560765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73837cd-5be6-488c-9345-80f069728f25 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:13:38.629625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73837cd-5be6-488c-9345-80f069728f25 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:13:38.635063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094fa02-2288-4327-9cf3-030dee6a177e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:13:38.635731 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094fa02-2288-4327-9cf3-030dee6a177e service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:13:38.636015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094fa02-2288-4327-9cf3-030dee6a177e service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:13:38.636293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094fa02-2288-4327-9cf3-030dee6a177e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:13:38.638166 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2094fa02-2288-4327-9cf3-030dee6a177e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:13:38.678210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094fa02-2288-4327-9cf3-030dee6a177e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:13:38.679878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094fa02-2288-4327-9cf3-030dee6a177e service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:13:38.691690 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1291/2609] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:13:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:13:48.686306 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=36 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:15.133656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cee001-f51c-4bfb-8c47-581ddd1b888a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:15.134203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cee001-f51c-4bfb-8c47-581ddd1b888a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:15.134203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cee001-f51c-4bfb-8c47-581ddd1b888a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:15.167956 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b9cee001-f51c-4bfb-8c47-581ddd1b888a None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:15.169943 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b9cee001-f51c-4bfb-8c47-581ddd1b888a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:15.237314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1319/2610] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 16:14:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:15.286034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094fa02-2288-4327-9cf3-030dee6a177e service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:15.287505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2094fa02-2288-4327-9cf3-030dee6a177e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:15.358519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094fa02-2288-4327-9cf3-030dee6a177e service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:15.364271 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fc516-50a4-4eda-b7d7-3fb146ca27dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:15.364922 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fc516-50a4-4eda-b7d7-3fb146ca27dc service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:15.365203 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fc516-50a4-4eda-b7d7-3fb146ca27dc service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:15.365472 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fc516-50a4-4eda-b7d7-3fb146ca27dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:15.374848 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fc516-50a4-4eda-b7d7-3fb146ca27dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:15.375860 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fc516-50a4-4eda-b7d7-3fb146ca27dc service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:15.384234 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1292/2611] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:14:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 16:14:16.064332 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cee001-f51c-4bfb-8c47-581ddd1b888a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:16.092542 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cee001-f51c-4bfb-8c47-581ddd1b888a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:16.097191 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce1d3a-89e3-40d4-8895-455d51d85a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:16.097860 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce1d3a-89e3-40d4-8895-455d51d85a43 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:16.098147 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce1d3a-89e3-40d4-8895-455d51d85a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:16.098455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce1d3a-89e3-40d4-8895-455d51d85a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:16.100349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d9ce1d3a-89e3-40d4-8895-455d51d85a43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:16.170833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce1d3a-89e3-40d4-8895-455d51d85a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:16.173159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce1d3a-89e3-40d4-8895-455d51d85a43 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:16.215604 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1320/2612] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:14:20.556831 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fc516-50a4-4eda-b7d7-3fb146ca27dc service swift] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:20.559620 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-921fc516-50a4-4eda-b7d7-3fb146ca27dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:20.591127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fc516-50a4-4eda-b7d7-3fb146ca27dc service swift] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:20.597444 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7aad86-97eb-42a2-ba5f-446c46ea6ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:20.598839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aad86-97eb-42a2-ba5f-446c46ea6ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:20.599357 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aad86-97eb-42a2-ba5f-446c46ea6ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:20.599815 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7aad86-97eb-42a2-ba5f-446c46ea6ea8 admin admin] PATH_INFO: `/v3/users/3212bd24e1f84b70872940214632536f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:20.601270 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7aad86-97eb-42a2-ba5f-446c46ea6ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3212bd24e1f84b70872940214632536f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:20.603661 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7aad86-97eb-42a2-ba5f-446c46ea6ea8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:20.689200 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f7aad86-97eb-42a2-ba5f-446c46ea6ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3212bd24e1f84b70872940214632536f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:20.698766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f7aad86-97eb-42a2-ba5f-446c46ea6ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3212bd24e1f84b70872940214632536f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:20.709277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f7aad86-97eb-42a2-ba5f-446c46ea6ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3212bd24e1f84b70872940214632536f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:20.710339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f7aad86-97eb-42a2-ba5f-446c46ea6ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3212bd24e1f84b70872940214632536f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:20.711156 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-0f7aad86-97eb-42a2-ba5f-446c46ea6ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3212bd24e1f84b70872940214632536f'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:20.738137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1293/2613] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:14:20 2022] DELETE /identity/v3/users/3212bd24e1f84b70872940214632536f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:20.967811 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce1d3a-89e3-40d4-8895-455d51d85a43 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:20.979282 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce1d3a-89e3-40d4-8895-455d51d85a43 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:21.087398 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4703f-4f4e-47ea-8cc6-b5f4a22b9e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:21.089164 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4703f-4f4e-47ea-8cc6-b5f4a22b9e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:21.089521 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4703f-4f4e-47ea-8cc6-b5f4a22b9e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:21.089991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4703f-4f4e-47ea-8cc6-b5f4a22b9e43 admin admin] PATH_INFO: `/v3/projects/67471d558ecc44a78ee7fff455977b44` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:21.092047 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4703f-4f4e-47ea-8cc6-b5f4a22b9e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67471d558ecc44a78ee7fff455977b44)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:21.094776 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b4703f-4f4e-47ea-8cc6-b5f4a22b9e43 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:21.164977 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:21.173270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a7b4703f-4f4e-47ea-8cc6-b5f4a22b9e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67471d558ecc44a78ee7fff455977b44', 'request_id': 'req-a7b4703f-4f4e-47ea-8cc6-b5f4a22b9e43'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:21.187393 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a7b4703f-4f4e-47ea-8cc6-b5f4a22b9e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67471d558ecc44a78ee7fff455977b44', 'request_id': 'req-a7b4703f-4f4e-47ea-8cc6-b5f4a22b9e43'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:21.197701 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a7b4703f-4f4e-47ea-8cc6-b5f4a22b9e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67471d558ecc44a78ee7fff455977b44', 'request_id': 'req-a7b4703f-4f4e-47ea-8cc6-b5f4a22b9e43'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:21.220467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a7b4703f-4f4e-47ea-8cc6-b5f4a22b9e43 admin admin] The token cache is being invalidate because project 67471d558ecc44a78ee7fff455977b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:14:21.221420 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a7b4703f-4f4e-47ea-8cc6-b5f4a22b9e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:21.222544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a7b4703f-4f4e-47ea-8cc6-b5f4a22b9e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:21.225314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1321/2614] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:14:20 2022] DELETE /identity/v3/projects/67471d558ecc44a78ee7fff455977b44 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:21.232371 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40012883-c714-43f6-bb19-4a11f68ef2a0 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:21.232815 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40012883-c714-43f6-bb19-4a11f68ef2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:21.233117 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40012883-c714-43f6-bb19-4a11f68ef2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:21.327391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-40012883-c714-43f6-bb19-4a11f68ef2a0 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:21.329023 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-40012883-c714-43f6-bb19-4a11f68ef2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:21.366328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:21.430355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1294/2615] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:14:21.438773 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45344e1b-e265-44a7-bf2c-7c75193e6da3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:21.439096 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45344e1b-e265-44a7-bf2c-7c75193e6da3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:21.439376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45344e1b-e265-44a7-bf2c-7c75193e6da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:21.459939 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-45344e1b-e265-44a7-bf2c-7c75193e6da3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:21.461195 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-45344e1b-e265-44a7-bf2c-7c75193e6da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:21.476831 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1322/2616] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:21.482625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40012883-c714-43f6-bb19-4a11f68ef2a0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:21.503180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40012883-c714-43f6-bb19-4a11f68ef2a0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:21.509580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637447f-1639-4b07-b34a-29a84dbb6013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:21.510789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637447f-1639-4b07-b34a-29a84dbb6013 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:21.511530 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637447f-1639-4b07-b34a-29a84dbb6013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:21.511999 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637447f-1639-4b07-b34a-29a84dbb6013 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:21.513433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637447f-1639-4b07-b34a-29a84dbb6013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:14:21.513991 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637447f-1639-4b07-b34a-29a84dbb6013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:21.516051 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6637447f-1639-4b07-b34a-29a84dbb6013 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:21.537614 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45344e1b-e265-44a7-bf2c-7c75193e6da3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:21.539091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1295/2617] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:14:21.548366 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45344e1b-e265-44a7-bf2c-7c75193e6da3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:21.553949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9317be0-3fda-43eb-9693-366f0dae0b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:21.554649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9317be0-3fda-43eb-9693-366f0dae0b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:21.555452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9317be0-3fda-43eb-9693-366f0dae0b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:21.555452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9317be0-3fda-43eb-9693-366f0dae0b98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:21.555949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9317be0-3fda-43eb-9693-366f0dae0b98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:21.557879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9317be0-3fda-43eb-9693-366f0dae0b98 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:21.597737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1323/2618] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:14:21 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:14:21.602113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637447f-1639-4b07-b34a-29a84dbb6013 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:21.620528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637447f-1639-4b07-b34a-29a84dbb6013 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:21.716493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd20e6-8913-4fcb-84a9-2b79b8af8046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:21.717411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd20e6-8913-4fcb-84a9-2b79b8af8046 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:21.717824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd20e6-8913-4fcb-84a9-2b79b8af8046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:21.718166 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd20e6-8913-4fcb-84a9-2b79b8af8046 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:21.718996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd20e6-8913-4fcb-84a9-2b79b8af8046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:21.721946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd20e6-8913-4fcb-84a9-2b79b8af8046 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:21.751159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9317be0-3fda-43eb-9693-366f0dae0b98 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:21.758880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1296/2619] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:14:21 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:14:21.764621 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9317be0-3fda-43eb-9693-366f0dae0b98 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:21.769463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd368e7-8433-4dca-a09a-4c6c29e39b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:21.770231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd368e7-8433-4dca-a09a-4c6c29e39b6a admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:21.770959 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd368e7-8433-4dca-a09a-4c6c29e39b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:21.771241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd368e7-8433-4dca-a09a-4c6c29e39b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:21.771994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd368e7-8433-4dca-a09a-4c6c29e39b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:21.773907 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd368e7-8433-4dca-a09a-4c6c29e39b6a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:21.791767 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd20e6-8913-4fcb-84a9-2b79b8af8046 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:21.803756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd20e6-8913-4fcb-84a9-2b79b8af8046 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:21.804719 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1324/2620] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:14:21.809341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aff72a-d250-475d-a73a-5964cbb157db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:21.810039 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aff72a-d250-475d-a73a-5964cbb157db admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:21.810323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aff72a-d250-475d-a73a-5964cbb157db admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:21.810600 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aff72a-d250-475d-a73a-5964cbb157db admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:21.811477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aff72a-d250-475d-a73a-5964cbb157db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:21.814134 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aff72a-d250-475d-a73a-5964cbb157db admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:21.831097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1297/2621] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:14:21.832672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd368e7-8433-4dca-a09a-4c6c29e39b6a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:21.843950 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd368e7-8433-4dca-a09a-4c6c29e39b6a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:21.850106 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092909df-2f28-44be-962a-b21737e32b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:21.851352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092909df-2f28-44be-962a-b21737e32b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:21.851781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092909df-2f28-44be-962a-b21737e32b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:21.852065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092909df-2f28-44be-962a-b21737e32b22 admin admin] PATH_INFO: `/v3/projects/97d8aa05dc8249058166a102516daaa0/users/97dfbc73205643b69cba2d23646db431/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:21.880889 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092909df-2f28-44be-962a-b21737e32b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97d8aa05dc8249058166a102516daaa0, user_id=97dfbc73205643b69cba2d23646db431, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:21.883759 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092909df-2f28-44be-962a-b21737e32b22 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:21.910548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1325/2622] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:14:21 2022] PUT /identity/v3/projects/97d8aa05dc8249058166a102516daaa0/users/97dfbc73205643b69cba2d23646db431/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:21.914524 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661b6e8-38b1-4d0e-aca7-4ebf36389411 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:21.914902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661b6e8-38b1-4d0e-aca7-4ebf36389411 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:21.915199 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3661b6e8-38b1-4d0e-aca7-4ebf36389411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:21.944978 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3661b6e8-38b1-4d0e-aca7-4ebf36389411 None None] MFA Rules not processed for user `97dfbc73205643b69cba2d23646db431`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:21.946223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3661b6e8-38b1-4d0e-aca7-4ebf36389411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:22.029001 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1298/2623] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:22.043039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092909df-2f28-44be-962a-b21737e32b22 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:22.045146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-092909df-2f28-44be-962a-b21737e32b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:22.147856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092909df-2f28-44be-962a-b21737e32b22 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:22.151874 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0487805c-0dbd-4a1a-8266-ce5985cc68a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:22.152543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487805c-0dbd-4a1a-8266-ce5985cc68a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:22.152829 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487805c-0dbd-4a1a-8266-ce5985cc68a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:22.153104 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0487805c-0dbd-4a1a-8266-ce5985cc68a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:22.164396 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487805c-0dbd-4a1a-8266-ce5985cc68a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:22.165852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0487805c-0dbd-4a1a-8266-ce5985cc68a6 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:22.180493 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1326/2624] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:14:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:14:29.552162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661b6e8-38b1-4d0e-aca7-4ebf36389411 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:29.553849 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3661b6e8-38b1-4d0e-aca7-4ebf36389411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:29.586544 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:29.628689 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3661b6e8-38b1-4d0e-aca7-4ebf36389411 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:29.633051 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13748ad-b3ec-4438-8370-ae1894130b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:29.633746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13748ad-b3ec-4438-8370-ae1894130b73 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:29.633991 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13748ad-b3ec-4438-8370-ae1894130b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:29.634294 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13748ad-b3ec-4438-8370-ae1894130b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:29.636490 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-e13748ad-b3ec-4438-8370-ae1894130b73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:29.647172 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13748ad-b3ec-4438-8370-ae1894130b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:29.648613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13748ad-b3ec-4438-8370-ae1894130b73 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:29.657744 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1299/2625] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:14:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:14:29.774974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd4f1a-4f6a-45c7-ab1f-f285767eb53f None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:29.775815 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd4f1a-4f6a-45c7-ab1f-f285767eb53f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:29.775991 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd4f1a-4f6a-45c7-ab1f-f285767eb53f None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:29.778217 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1327/2626] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 16:14:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 16:14:29.787179 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0f1e7-b734-4d3b-a2ee-0c7dbd339911 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:29.787737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0f1e7-b734-4d3b-a2ee-0c7dbd339911 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:29.788248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d0f1e7-b734-4d3b-a2ee-0c7dbd339911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:29.837147 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-a0d0f1e7-b734-4d3b-a2ee-0c7dbd339911 None None] MFA Rules not processed for user `e9a1ec1f6bb7467dbd63ad1da36d48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:29.838558 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a0d0f1e7-b734-4d3b-a2ee-0c7dbd339911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:29.942571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1300/2627] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 16:14:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:29.954932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd4f1a-4f6a-45c7-ab1f-f285767eb53f None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:29.956896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-20dd4f1a-4f6a-45c7-ab1f-f285767eb53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:30.011340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:30.016972 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd4f1a-4f6a-45c7-ab1f-f285767eb53f None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:30.022560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da75e0-4e86-4ee1-a13f-ba538643e715 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3418c0b46c404c8ca445cce9db632d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:30.023341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da75e0-4e86-4ee1-a13f-ba538643e715 service glance] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:30.023692 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da75e0-4e86-4ee1-a13f-ba538643e715 service glance] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:30.023971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da75e0-4e86-4ee1-a13f-ba538643e715 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:30.035274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da75e0-4e86-4ee1-a13f-ba538643e715 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:30.036748 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da75e0-4e86-4ee1-a13f-ba538643e715 service glance] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:30.049335 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1328/2628] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:14:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:14:30.129384 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2f314-9087-46f1-98fd-fc7557037fe3 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:30.129668 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2f314-9087-46f1-98fd-fc7557037fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:30.129941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2f314-9087-46f1-98fd-fc7557037fe3 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:30.131371 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1301/2629] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 16:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:14:30.136228 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d74568-055e-4f6c-9701-68d0bc044b85 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:30.136517 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d74568-055e-4f6c-9701-68d0bc044b85 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:30.136814 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d74568-055e-4f6c-9701-68d0bc044b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:30.156503 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-59d74568-055e-4f6c-9701-68d0bc044b85 None None] MFA Rules not processed for user `1b46a82ffe92437fb8205bd186a8b05e`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:30.157812 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-59d74568-055e-4f6c-9701-68d0bc044b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:30.164842 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1329/2630] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 16:14:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:30.177065 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2f314-9087-46f1-98fd-fc7557037fe3 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:30.189872 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2f314-9087-46f1-98fd-fc7557037fe3 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:30.194471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757e590-2f28-4045-9b4f-c5814f9fcb55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:30.195173 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757e590-2f28-4045-9b4f-c5814f9fcb55 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:30.195487 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757e590-2f28-4045-9b4f-c5814f9fcb55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:30.195891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757e590-2f28-4045-9b4f-c5814f9fcb55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:30.204091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757e590-2f28-4045-9b4f-c5814f9fcb55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:30.205448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757e590-2f28-4045-9b4f-c5814f9fcb55 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:30.213610 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1302/2631] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:14:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:14:30.332083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339de49-e233-4e41-b902-c1616ca9dc57 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:30.332368 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339de49-e233-4e41-b902-c1616ca9dc57 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:30.332636 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339de49-e233-4e41-b902-c1616ca9dc57 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:30.334031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1330/2632] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 16:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:14:30.339552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364afe9c-382f-44fb-b443-269cdfaba87f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:30.339842 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364afe9c-382f-44fb-b443-269cdfaba87f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:30.340116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364afe9c-382f-44fb-b443-269cdfaba87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:30.361667 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-364afe9c-382f-44fb-b443-269cdfaba87f None None] MFA Rules not processed for user `e9a1ec1f6bb7467dbd63ad1da36d48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:30.362955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-364afe9c-382f-44fb-b443-269cdfaba87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:30.373562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1303/2633] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 16:14:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:30.384675 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339de49-e233-4e41-b902-c1616ca9dc57 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:30.386737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0339de49-e233-4e41-b902-c1616ca9dc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:30.402485 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339de49-e233-4e41-b902-c1616ca9dc57 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:30.406379 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65878c8d-9f79-42b5-8044-f93decb34fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:30.407179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65878c8d-9f79-42b5-8044-f93decb34fbc service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:30.407469 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65878c8d-9f79-42b5-8044-f93decb34fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:30.407752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65878c8d-9f79-42b5-8044-f93decb34fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:30.418441 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65878c8d-9f79-42b5-8044-f93decb34fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:30.419912 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65878c8d-9f79-42b5-8044-f93decb34fbc service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:30.430773 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1331/2634] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:14:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:14:30.878233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364afe9c-382f-44fb-b443-269cdfaba87f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:30.950369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364afe9c-382f-44fb-b443-269cdfaba87f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:30.957020 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d64b1-403c-40f1-9c7b-815be4a5463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:30.960715 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d64b1-403c-40f1-9c7b-815be4a5463f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:30.960715 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d64b1-403c-40f1-9c7b-815be4a5463f admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:30.960715 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d64b1-403c-40f1-9c7b-815be4a5463f admin admin] PATH_INFO: `/v3/users/97dfbc73205643b69cba2d23646db431` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:30.960715 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d64b1-403c-40f1-9c7b-815be4a5463f admin admin] RBAC: Authorizing `identity:delete_user(user_id=97dfbc73205643b69cba2d23646db431)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:30.962044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d64b1-403c-40f1-9c7b-815be4a5463f admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:30.980379 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:31.025952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-429d64b1-403c-40f1-9c7b-815be4a5463f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97dfbc73205643b69cba2d23646db431'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:31.033022 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-429d64b1-403c-40f1-9c7b-815be4a5463f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97dfbc73205643b69cba2d23646db431'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:31.048002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-429d64b1-403c-40f1-9c7b-815be4a5463f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97dfbc73205643b69cba2d23646db431'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:31.048701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-429d64b1-403c-40f1-9c7b-815be4a5463f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97dfbc73205643b69cba2d23646db431'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:31.049583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-429d64b1-403c-40f1-9c7b-815be4a5463f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97dfbc73205643b69cba2d23646db431'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:31.071699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1304/2635] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:14:30 2022] DELETE /identity/v3/users/97dfbc73205643b69cba2d23646db431 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:31.075977 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792219a-7a6b-423a-802b-26a526c8cb97 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:31.076468 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792219a-7a6b-423a-802b-26a526c8cb97 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:31.076568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792219a-7a6b-423a-802b-26a526c8cb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:31.097233 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b792219a-7a6b-423a-802b-26a526c8cb97 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:31.098877 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b792219a-7a6b-423a-802b-26a526c8cb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:31.165451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1332/2636] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:31.175921 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d64b1-403c-40f1-9c7b-815be4a5463f admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:31.178265 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-429d64b1-403c-40f1-9c7b-815be4a5463f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:31.254839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d64b1-403c-40f1-9c7b-815be4a5463f admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:31.259033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03906b43-ad2d-4545-bbe6-7253fd763212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:31.259991 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03906b43-ad2d-4545-bbe6-7253fd763212 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:31.260430 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03906b43-ad2d-4545-bbe6-7253fd763212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:31.260720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03906b43-ad2d-4545-bbe6-7253fd763212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:31.271637 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03906b43-ad2d-4545-bbe6-7253fd763212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:31.273140 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03906b43-ad2d-4545-bbe6-7253fd763212 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:31.285757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1305/2637] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:14:31.573213 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792219a-7a6b-423a-802b-26a526c8cb97 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:31.575309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b792219a-7a6b-423a-802b-26a526c8cb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:31.593823 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792219a-7a6b-423a-802b-26a526c8cb97 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:31.599672 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f0ec4-0870-49ec-a0b8-c4201a97f322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:31.600198 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f0ec4-0870-49ec-a0b8-c4201a97f322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:31.600487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f0ec4-0870-49ec-a0b8-c4201a97f322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:31.600767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f0ec4-0870-49ec-a0b8-c4201a97f322 admin admin] PATH_INFO: `/v3/projects/97d8aa05dc8249058166a102516daaa0` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:31.602082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f0ec4-0870-49ec-a0b8-c4201a97f322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97d8aa05dc8249058166a102516daaa0)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:31.604168 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f0ec4-0870-49ec-a0b8-c4201a97f322 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:31.662926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fa1f0ec4-0870-49ec-a0b8-c4201a97f322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97d8aa05dc8249058166a102516daaa0', 'request_id': 'req-fa1f0ec4-0870-49ec-a0b8-c4201a97f322'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:31.671275 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fa1f0ec4-0870-49ec-a0b8-c4201a97f322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97d8aa05dc8249058166a102516daaa0', 'request_id': 'req-fa1f0ec4-0870-49ec-a0b8-c4201a97f322'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:31.677495 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fa1f0ec4-0870-49ec-a0b8-c4201a97f322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97d8aa05dc8249058166a102516daaa0', 'request_id': 'req-fa1f0ec4-0870-49ec-a0b8-c4201a97f322'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:31.687763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fa1f0ec4-0870-49ec-a0b8-c4201a97f322 admin admin] The token cache is being invalidate because project 97d8aa05dc8249058166a102516daaa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:14:31.688200 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fa1f0ec4-0870-49ec-a0b8-c4201a97f322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:31.689075 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-fa1f0ec4-0870-49ec-a0b8-c4201a97f322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:31.690671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1333/2638] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:14:31 2022] DELETE /identity/v3/projects/97d8aa05dc8249058166a102516daaa0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:31.695950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc408971-1409-4109-988f-bdb625eb47b5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:31.696253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc408971-1409-4109-988f-bdb625eb47b5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:31.696510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc408971-1409-4109-988f-bdb625eb47b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:31.714319 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-dc408971-1409-4109-988f-bdb625eb47b5 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:31.715560 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dc408971-1409-4109-988f-bdb625eb47b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:31.778747 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1306/2639] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:31.787083 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba1e7b-e9bf-40f2-bb85-a019beae7f62 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:31.787460 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba1e7b-e9bf-40f2-bb85-a019beae7f62 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:31.787829 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba1e7b-e9bf-40f2-bb85-a019beae7f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:31.808589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2cba1e7b-e9bf-40f2-bb85-a019beae7f62 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:31.809824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2cba1e7b-e9bf-40f2-bb85-a019beae7f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:31.818746 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1334/2640] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:31.823304 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc408971-1409-4109-988f-bdb625eb47b5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:31.833550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc408971-1409-4109-988f-bdb625eb47b5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:31.838993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09855e71-4505-4f0b-a841-b2d429dacb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:31.839653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09855e71-4505-4f0b-a841-b2d429dacb28 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:31.839929 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09855e71-4505-4f0b-a841-b2d429dacb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:31.840203 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09855e71-4505-4f0b-a841-b2d429dacb28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:31.840930 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09855e71-4505-4f0b-a841-b2d429dacb28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:14:31.841235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09855e71-4505-4f0b-a841-b2d429dacb28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:31.842851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09855e71-4505-4f0b-a841-b2d429dacb28 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:31.856224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1307/2641] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:14:31.860767 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba1e7b-e9bf-40f2-bb85-a019beae7f62 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:31.872466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba1e7b-e9bf-40f2-bb85-a019beae7f62 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:31.878915 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2362a-0300-4b13-885f-2ed0b6191da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:31.879593 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2362a-0300-4b13-885f-2ed0b6191da0 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:31.879880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2362a-0300-4b13-885f-2ed0b6191da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:31.880156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2362a-0300-4b13-885f-2ed0b6191da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:31.880887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2362a-0300-4b13-885f-2ed0b6191da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:31.882794 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2362a-0300-4b13-885f-2ed0b6191da0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:31.913230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1335/2642] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:14:31 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:14:31.917837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09855e71-4505-4f0b-a841-b2d429dacb28 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:31.929313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09855e71-4505-4f0b-a841-b2d429dacb28 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:31.947600 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:31.992172 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145ba88-8c8c-4d4d-b92c-ba8a968ea335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:31.992877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145ba88-8c8c-4d4d-b92c-ba8a968ea335 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:31.993219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145ba88-8c8c-4d4d-b92c-ba8a968ea335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:31.993450 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145ba88-8c8c-4d4d-b92c-ba8a968ea335 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:31.994139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145ba88-8c8c-4d4d-b92c-ba8a968ea335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:31.996077 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145ba88-8c8c-4d4d-b92c-ba8a968ea335 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:32.018799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1308/2643] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:14:31 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:14:32.023563 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2362a-0300-4b13-885f-2ed0b6191da0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:32.034223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2362a-0300-4b13-885f-2ed0b6191da0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:32.039379 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8978f8-2dc3-4973-8906-7eb4a9bf1df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:32.040073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8978f8-2dc3-4973-8906-7eb4a9bf1df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:32.040358 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8978f8-2dc3-4973-8906-7eb4a9bf1df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:32.040642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8978f8-2dc3-4973-8906-7eb4a9bf1df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:32.041706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8978f8-2dc3-4973-8906-7eb4a9bf1df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:32.043807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8978f8-2dc3-4973-8906-7eb4a9bf1df2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:32.059413 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1336/2644] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:14:32.064084 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145ba88-8c8c-4d4d-b92c-ba8a968ea335 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:32.075660 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145ba88-8c8c-4d4d-b92c-ba8a968ea335 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:32.080841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415ba4a-69e9-444f-9ab7-fd086ed265e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:32.081530 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415ba4a-69e9-444f-9ab7-fd086ed265e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:32.081822 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415ba4a-69e9-444f-9ab7-fd086ed265e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:32.082089 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415ba4a-69e9-444f-9ab7-fd086ed265e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:32.082869 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415ba4a-69e9-444f-9ab7-fd086ed265e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:32.084500 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415ba4a-69e9-444f-9ab7-fd086ed265e1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:32.095370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1309/2645] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:14:32.099968 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8978f8-2dc3-4973-8906-7eb4a9bf1df2 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:32.111438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8978f8-2dc3-4973-8906-7eb4a9bf1df2 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:32.117715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3144ec-ec43-4c7a-ad9f-05a2a3702f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:32.119147 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3144ec-ec43-4c7a-ad9f-05a2a3702f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:32.119560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3144ec-ec43-4c7a-ad9f-05a2a3702f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:32.119942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3144ec-ec43-4c7a-ad9f-05a2a3702f7f admin admin] PATH_INFO: `/v3/projects/c8a2141887174e81a14731c0f1ef17bd/users/68b5d62e2eb4480e9e560583c84b6d8d/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:32.134952 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:32.138994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3144ec-ec43-4c7a-ad9f-05a2a3702f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a2141887174e81a14731c0f1ef17bd, user_id=68b5d62e2eb4480e9e560583c84b6d8d, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:32.142029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3144ec-ec43-4c7a-ad9f-05a2a3702f7f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:32.161307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1337/2646] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:14:32 2022] PUT /identity/v3/projects/c8a2141887174e81a14731c0f1ef17bd/users/68b5d62e2eb4480e9e560583c84b6d8d/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:14:32.172057 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b47219-23e6-4fc5-96ce-30dc16578ebc None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:32.172398 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b47219-23e6-4fc5-96ce-30dc16578ebc None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:32.172684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b47219-23e6-4fc5-96ce-30dc16578ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:32.210617 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-02b47219-23e6-4fc5-96ce-30dc16578ebc None None] MFA Rules not processed for user `68b5d62e2eb4480e9e560583c84b6d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:32.212108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-02b47219-23e6-4fc5-96ce-30dc16578ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:32.316540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1310/2647] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:32.321190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3144ec-ec43-4c7a-ad9f-05a2a3702f7f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:32.394254 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3144ec-ec43-4c7a-ad9f-05a2a3702f7f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:32.399313 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766cdc0-17ec-4cec-abc9-872db9051301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:32.400062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766cdc0-17ec-4cec-abc9-872db9051301 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:32.400354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766cdc0-17ec-4cec-abc9-872db9051301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:32.400635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766cdc0-17ec-4cec-abc9-872db9051301 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:32.401350 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766cdc0-17ec-4cec-abc9-872db9051301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:32.403661 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766cdc0-17ec-4cec-abc9-872db9051301 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:32.431961 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1338/2648] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:14:32 2022] POST /identity/v3/projects => generated 387 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:14:32.436045 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b47219-23e6-4fc5-96ce-30dc16578ebc None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:32.447295 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b47219-23e6-4fc5-96ce-30dc16578ebc None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:32.506993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11257eaf-4361-4897-9433-2939cb5f55ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:32.507684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11257eaf-4361-4897-9433-2939cb5f55ea admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:32.507968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11257eaf-4361-4897-9433-2939cb5f55ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:32.508313 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11257eaf-4361-4897-9433-2939cb5f55ea admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:32.508953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11257eaf-4361-4897-9433-2939cb5f55ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:32.510931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11257eaf-4361-4897-9433-2939cb5f55ea admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:32.533319 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1311/2649] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:14:32 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:14:32.537433 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766cdc0-17ec-4cec-abc9-872db9051301 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:32.548534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766cdc0-17ec-4cec-abc9-872db9051301 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:32.554657 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fe4d6-e73b-4198-acd8-112bd3efa2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:32.555385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fe4d6-e73b-4198-acd8-112bd3efa2ea admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:32.555669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fe4d6-e73b-4198-acd8-112bd3efa2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:32.555943 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950fe4d6-e73b-4198-acd8-112bd3efa2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:32.556681 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fe4d6-e73b-4198-acd8-112bd3efa2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:32.558287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950fe4d6-e73b-4198-acd8-112bd3efa2ea admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:32.571519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1339/2650] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:14:32.576083 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11257eaf-4361-4897-9433-2939cb5f55ea admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:32.587149 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11257eaf-4361-4897-9433-2939cb5f55ea admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:32.592647 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b846ab06-4071-417b-b0ff-ec2fe0c9f2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:32.594221 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846ab06-4071-417b-b0ff-ec2fe0c9f2ca admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:32.594539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846ab06-4071-417b-b0ff-ec2fe0c9f2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:32.594828 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b846ab06-4071-417b-b0ff-ec2fe0c9f2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:32.595582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846ab06-4071-417b-b0ff-ec2fe0c9f2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:32.597201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b846ab06-4071-417b-b0ff-ec2fe0c9f2ca admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:32.608176 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1312/2651] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:14:32.612526 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fe4d6-e73b-4198-acd8-112bd3efa2ea admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:32.623182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950fe4d6-e73b-4198-acd8-112bd3efa2ea admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:32.628979 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab004d3b-5cac-4bd8-bc5f-cd8c66782682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:32.629904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab004d3b-5cac-4bd8-bc5f-cd8c66782682 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:32.630309 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab004d3b-5cac-4bd8-bc5f-cd8c66782682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:32.630620 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab004d3b-5cac-4bd8-bc5f-cd8c66782682 admin admin] PATH_INFO: `/v3/projects/9ac0241d12dc44f091b9f1a32e70e4ba/users/5d0807f2d0ff40b5aa085038378d69c5/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:32.647383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab004d3b-5cac-4bd8-bc5f-cd8c66782682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac0241d12dc44f091b9f1a32e70e4ba, user_id=5d0807f2d0ff40b5aa085038378d69c5, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:32.650076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab004d3b-5cac-4bd8-bc5f-cd8c66782682 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:32.664546 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1340/2652] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:14:32 2022] PUT /identity/v3/projects/9ac0241d12dc44f091b9f1a32e70e4ba/users/5d0807f2d0ff40b5aa085038378d69c5/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:32.676383 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd4e6c-a45c-42d5-aea9-59969ebe8379 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:32.676776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd4e6c-a45c-42d5-aea9-59969ebe8379 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:32.677126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd4e6c-a45c-42d5-aea9-59969ebe8379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:32.691113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:32.707703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-85cd4e6c-a45c-42d5-aea9-59969ebe8379 None None] MFA Rules not processed for user `5d0807f2d0ff40b5aa085038378d69c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:32.708942 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-85cd4e6c-a45c-42d5-aea9-59969ebe8379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:32.776008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1313/2653] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:32.780922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab004d3b-5cac-4bd8-bc5f-cd8c66782682 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:32.819577 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f7e5e-bac7-4ed0-8f6e-710b8364f86d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:32.819871 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f7e5e-bac7-4ed0-8f6e-710b8364f86d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:32.820146 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f7e5e-bac7-4ed0-8f6e-710b8364f86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:32.839149 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-726f7e5e-bac7-4ed0-8f6e-710b8364f86d None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:32.840358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-726f7e5e-bac7-4ed0-8f6e-710b8364f86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:32.849740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab004d3b-5cac-4bd8-bc5f-cd8c66782682 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:32.854690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c8131-d352-4e00-88ff-3b6c494407ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:32.855390 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c8131-d352-4e00-88ff-3b6c494407ad admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:32.855853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c8131-d352-4e00-88ff-3b6c494407ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:32.856134 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c8131-d352-4e00-88ff-3b6c494407ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:32.856837 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c8131-d352-4e00-88ff-3b6c494407ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:32.858869 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c8131-d352-4e00-88ff-3b6c494407ad admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:32.885343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1341/2654] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:14:32 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:14:32.889507 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c8131-d352-4e00-88ff-3b6c494407ad admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:32.902127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1314/2655] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 16:14:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:14:32.916816 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f7e5e-bac7-4ed0-8f6e-710b8364f86d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:32.916816 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-726f7e5e-bac7-4ed0-8f6e-710b8364f86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:32.924665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:32.959028 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c8131-d352-4e00-88ff-3b6c494407ad admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:32.963865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1999f7-9ed2-4a9e-83aa-a64ab41c9042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:32.964697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1999f7-9ed2-4a9e-83aa-a64ab41c9042 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:32.965009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1999f7-9ed2-4a9e-83aa-a64ab41c9042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:32.965281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1999f7-9ed2-4a9e-83aa-a64ab41c9042 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:32.965992 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1999f7-9ed2-4a9e-83aa-a64ab41c9042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:32.967954 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1999f7-9ed2-4a9e-83aa-a64ab41c9042 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:32.991321 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1342/2656] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:14:32 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:14:32.991535 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f7e5e-bac7-4ed0-8f6e-710b8364f86d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:32.993067 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1999f7-9ed2-4a9e-83aa-a64ab41c9042 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:33.003741 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1999f7-9ed2-4a9e-83aa-a64ab41c9042 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:33.009161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddefce9-7b57-44c5-b633-30985cf9ff40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:33.009838 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddefce9-7b57-44c5-b633-30985cf9ff40 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:33.010126 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddefce9-7b57-44c5-b633-30985cf9ff40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:33.010406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddefce9-7b57-44c5-b633-30985cf9ff40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:33.011190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddefce9-7b57-44c5-b633-30985cf9ff40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:33.012878 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddefce9-7b57-44c5-b633-30985cf9ff40 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:33.023696 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1343/2657] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:14:33.028029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddefce9-7b57-44c5-b633-30985cf9ff40 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:33.035618 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=100 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:33.039057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddefce9-7b57-44c5-b633-30985cf9ff40 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:33.044253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe55821-83b3-46bf-944b-cbb7ed9b902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:33.045078 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe55821-83b3-46bf-944b-cbb7ed9b902b admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:33.045364 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe55821-83b3-46bf-944b-cbb7ed9b902b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:33.045645 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe55821-83b3-46bf-944b-cbb7ed9b902b admin admin] PATH_INFO: `/v3/projects/b811c8d1107041cdb1474ea0e311d269/users/91a94c57c0534dd382cc672d778fcbf2/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:33.055142 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba277e2-6152-415e-873c-66f56ba76823 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:33.055807 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba277e2-6152-415e-873c-66f56ba76823 service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:33.056091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba277e2-6152-415e-873c-66f56ba76823 service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:33.056369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba277e2-6152-415e-873c-66f56ba76823 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:33.061355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe55821-83b3-46bf-944b-cbb7ed9b902b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b811c8d1107041cdb1474ea0e311d269, user_id=91a94c57c0534dd382cc672d778fcbf2, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:33.064854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe55821-83b3-46bf-944b-cbb7ed9b902b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:33.081033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1344/2658] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:14:33 2022] PUT /identity/v3/projects/b811c8d1107041cdb1474ea0e311d269/users/91a94c57c0534dd382cc672d778fcbf2/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:33.085223 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe55821-83b3-46bf-944b-cbb7ed9b902b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:33.116929 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba277e2-6152-415e-873c-66f56ba76823 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:33.118552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba277e2-6152-415e-873c-66f56ba76823 service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:33.126955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1315/2659] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:14:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 16:14:33.149565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe55821-83b3-46bf-944b-cbb7ed9b902b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:33.154941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edf24a-dde8-429e-af8a-3fe321db237b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:33.155820 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf24a-dde8-429e-af8a-3fe321db237b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:33.156049 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf24a-dde8-429e-af8a-3fe321db237b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:33.156360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edf24a-dde8-429e-af8a-3fe321db237b admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:33.157112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edf24a-dde8-429e-af8a-3fe321db237b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:33.158934 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edf24a-dde8-429e-af8a-3fe321db237b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:33.175805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1345/2660] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:14:33.177486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba277e2-6152-415e-873c-66f56ba76823 service swift] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:33.195845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba277e2-6152-415e-873c-66f56ba76823 service swift] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:33.209421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43273a-9706-4f28-83a2-47ed4ad43cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:33.211266 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43273a-9706-4f28-83a2-47ed4ad43cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:33.211782 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43273a-9706-4f28-83a2-47ed4ad43cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:33.212163 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43273a-9706-4f28-83a2-47ed4ad43cb0 admin admin] PATH_INFO: `/v3/projects/b811c8d1107041cdb1474ea0e311d269/users/91a94c57c0534dd382cc672d778fcbf2/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:33.215137 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43273a-9706-4f28-83a2-47ed4ad43cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b811c8d1107041cdb1474ea0e311d269, user_id=91a94c57c0534dd382cc672d778fcbf2, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:33.219530 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43273a-9706-4f28-83a2-47ed4ad43cb0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:33.249120 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1316/2661] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:14:33 2022] PUT /identity/v3/projects/b811c8d1107041cdb1474ea0e311d269/users/91a94c57c0534dd382cc672d778fcbf2/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:33.251829 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9274f29-33c3-488d-ac3c-af053a5ffaac None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:33.252121 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9274f29-33c3-488d-ac3c-af053a5ffaac None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:33.252396 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9274f29-33c3-488d-ac3c-af053a5ffaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:33.304166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-a9274f29-33c3-488d-ac3c-af053a5ffaac None None] MFA Rules not processed for user `91a94c57c0534dd382cc672d778fcbf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:33.305421 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a9274f29-33c3-488d-ac3c-af053a5ffaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:33.441444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1346/2662] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:33.452263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43273a-9706-4f28-83a2-47ed4ad43cb0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:33.454344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2c43273a-9706-4f28-83a2-47ed4ad43cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:33.570728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43273a-9706-4f28-83a2-47ed4ad43cb0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:33.574583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c27394-664a-49eb-beb1-64a75ae30c35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:33.575393 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c27394-664a-49eb-beb1-64a75ae30c35 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:33.575711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c27394-664a-49eb-beb1-64a75ae30c35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:33.576061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c27394-664a-49eb-beb1-64a75ae30c35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:33.586348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c27394-664a-49eb-beb1-64a75ae30c35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:33.587997 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c27394-664a-49eb-beb1-64a75ae30c35 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:33.599663 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1317/2663] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:14:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:14:34.274277 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9274f29-33c3-488d-ac3c-af053a5ffaac None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:34.275740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a9274f29-33c3-488d-ac3c-af053a5ffaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:34.282787 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:34.288926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9274f29-33c3-488d-ac3c-af053a5ffaac None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:34.293317 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42abefc-04cf-4783-84d2-b52d793a77cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:34.294127 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42abefc-04cf-4783-84d2-b52d793a77cb service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:34.294635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42abefc-04cf-4783-84d2-b52d793a77cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:34.295128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42abefc-04cf-4783-84d2-b52d793a77cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:34.370359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42abefc-04cf-4783-84d2-b52d793a77cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:34.372091 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42abefc-04cf-4783-84d2-b52d793a77cb service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:34.384359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1347/2664] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:14:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:14:38.658346 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c27394-664a-49eb-beb1-64a75ae30c35 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:38.668409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c27394-664a-49eb-beb1-64a75ae30c35 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:38.674507 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f1eacd-e1d6-4df5-bf4b-dd7f4368da4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:38.675234 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1eacd-e1d6-4df5-bf4b-dd7f4368da4e service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:38.675522 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1eacd-e1d6-4df5-bf4b-dd7f4368da4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:38.675801 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f1eacd-e1d6-4df5-bf4b-dd7f4368da4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:38.745021 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1eacd-e1d6-4df5-bf4b-dd7f4368da4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:38.746607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f1eacd-e1d6-4df5-bf4b-dd7f4368da4e service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:38.757567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1318/2665] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:14:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:14:41.072572 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42abefc-04cf-4783-84d2-b52d793a77cb service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:41.136326 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42abefc-04cf-4783-84d2-b52d793a77cb service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:41.140783 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002046a-b2bb-4e17-a69e-55b12e89770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:41.141680 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002046a-b2bb-4e17-a69e-55b12e89770a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:41.141963 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002046a-b2bb-4e17-a69e-55b12e89770a admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:41.142240 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002046a-b2bb-4e17-a69e-55b12e89770a admin admin] PATH_INFO: `/v3/users/68b5d62e2eb4480e9e560583c84b6d8d` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:41.143467 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002046a-b2bb-4e17-a69e-55b12e89770a admin admin] RBAC: Authorizing `identity:delete_user(user_id=68b5d62e2eb4480e9e560583c84b6d8d)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:41.145753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002046a-b2bb-4e17-a69e-55b12e89770a admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:41.196243 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8002046a-b2bb-4e17-a69e-55b12e89770a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68b5d62e2eb4480e9e560583c84b6d8d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:41.208008 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8002046a-b2bb-4e17-a69e-55b12e89770a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68b5d62e2eb4480e9e560583c84b6d8d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:41.221721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8002046a-b2bb-4e17-a69e-55b12e89770a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68b5d62e2eb4480e9e560583c84b6d8d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:41.222379 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8002046a-b2bb-4e17-a69e-55b12e89770a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68b5d62e2eb4480e9e560583c84b6d8d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:41.230411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-8002046a-b2bb-4e17-a69e-55b12e89770a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68b5d62e2eb4480e9e560583c84b6d8d'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:41.236953 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1348/2666] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:14:41 2022] DELETE /identity/v3/users/68b5d62e2eb4480e9e560583c84b6d8d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:41.241864 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87397d5a-43b5-49ea-a72f-1e0c12eada4e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:41.242402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87397d5a-43b5-49ea-a72f-1e0c12eada4e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:41.242402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87397d5a-43b5-49ea-a72f-1e0c12eada4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:41.261300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-87397d5a-43b5-49ea-a72f-1e0c12eada4e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:41.262549 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-87397d5a-43b5-49ea-a72f-1e0c12eada4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:41.273283 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:41.332921 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1319/2667] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:14:41.343266 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002046a-b2bb-4e17-a69e-55b12e89770a admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:41.345145 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8002046a-b2bb-4e17-a69e-55b12e89770a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:41.369573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:41.409812 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002046a-b2bb-4e17-a69e-55b12e89770a admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:41.413849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd4eb7-66b4-4477-b9cb-24e3753e190c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:41.414582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd4eb7-66b4-4477-b9cb-24e3753e190c service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:41.414888 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd4eb7-66b4-4477-b9cb-24e3753e190c service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:41.415197 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd4eb7-66b4-4477-b9cb-24e3753e190c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:41.425231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd4eb7-66b4-4477-b9cb-24e3753e190c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:41.426743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd4eb7-66b4-4477-b9cb-24e3753e190c service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:41.436591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1349/2668] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:14:41.733761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87397d5a-43b5-49ea-a72f-1e0c12eada4e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:41.735414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-87397d5a-43b5-49ea-a72f-1e0c12eada4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:41.748429 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87397d5a-43b5-49ea-a72f-1e0c12eada4e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:41.754239 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595d421-c82e-478a-b0b0-53ab7e05fbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:41.755175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595d421-c82e-478a-b0b0-53ab7e05fbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:41.755453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595d421-c82e-478a-b0b0-53ab7e05fbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:41.755768 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a595d421-c82e-478a-b0b0-53ab7e05fbee admin admin] PATH_INFO: `/v3/projects/c8a2141887174e81a14731c0f1ef17bd` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:41.757107 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595d421-c82e-478a-b0b0-53ab7e05fbee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a2141887174e81a14731c0f1ef17bd)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:41.759081 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a595d421-c82e-478a-b0b0-53ab7e05fbee admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:41.809023 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a595d421-c82e-478a-b0b0-53ab7e05fbee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a2141887174e81a14731c0f1ef17bd', 'request_id': 'req-a595d421-c82e-478a-b0b0-53ab7e05fbee'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:41.815633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a595d421-c82e-478a-b0b0-53ab7e05fbee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a2141887174e81a14731c0f1ef17bd', 'request_id': 'req-a595d421-c82e-478a-b0b0-53ab7e05fbee'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:41.821689 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a595d421-c82e-478a-b0b0-53ab7e05fbee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a2141887174e81a14731c0f1ef17bd', 'request_id': 'req-a595d421-c82e-478a-b0b0-53ab7e05fbee'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:41.837061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a595d421-c82e-478a-b0b0-53ab7e05fbee admin admin] The token cache is being invalidate because project c8a2141887174e81a14731c0f1ef17bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:14:41.837373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a595d421-c82e-478a-b0b0-53ab7e05fbee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:41.838044 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-a595d421-c82e-478a-b0b0-53ab7e05fbee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:41.839727 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1320/2669] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:14:41 2022] DELETE /identity/v3/projects/c8a2141887174e81a14731c0f1ef17bd => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:41.844346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd4eb7-66b4-4477-b9cb-24e3753e190c service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:41.854809 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd4eb7-66b4-4477-b9cb-24e3753e190c service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:41.911890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66b253-2228-4b32-aabc-60a870525dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:41.912816 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66b253-2228-4b32-aabc-60a870525dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:41.913097 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66b253-2228-4b32-aabc-60a870525dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:41.913366 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66b253-2228-4b32-aabc-60a870525dc5 admin admin] PATH_INFO: `/v3/users/5d0807f2d0ff40b5aa085038378d69c5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:41.914595 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66b253-2228-4b32-aabc-60a870525dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0807f2d0ff40b5aa085038378d69c5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:41.916664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66b253-2228-4b32-aabc-60a870525dc5 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:41.964724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bd66b253-2228-4b32-aabc-60a870525dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0807f2d0ff40b5aa085038378d69c5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:41.976522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bd66b253-2228-4b32-aabc-60a870525dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0807f2d0ff40b5aa085038378d69c5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:41.985205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bd66b253-2228-4b32-aabc-60a870525dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0807f2d0ff40b5aa085038378d69c5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:41.985974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bd66b253-2228-4b32-aabc-60a870525dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0807f2d0ff40b5aa085038378d69c5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:41.993763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-bd66b253-2228-4b32-aabc-60a870525dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0807f2d0ff40b5aa085038378d69c5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:42.000151 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1350/2670] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:14:41 2022] DELETE /identity/v3/users/5d0807f2d0ff40b5aa085038378d69c5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:42.285801 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595d421-c82e-478a-b0b0-53ab7e05fbee admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:42.287465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-a595d421-c82e-478a-b0b0-53ab7e05fbee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:42.303699 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a595d421-c82e-478a-b0b0-53ab7e05fbee admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:42.364859 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a04f1-b99f-43d8-9298-a55402b54782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:42.365738 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a04f1-b99f-43d8-9298-a55402b54782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:42.366017 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a04f1-b99f-43d8-9298-a55402b54782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:42.366291 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a04f1-b99f-43d8-9298-a55402b54782 admin admin] PATH_INFO: `/v3/projects/9ac0241d12dc44f091b9f1a32e70e4ba` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:42.367552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a04f1-b99f-43d8-9298-a55402b54782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac0241d12dc44f091b9f1a32e70e4ba)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:42.369465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a04f1-b99f-43d8-9298-a55402b54782 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:42.414161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:42.422528 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e2a04f1-b99f-43d8-9298-a55402b54782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac0241d12dc44f091b9f1a32e70e4ba', 'request_id': 'req-2e2a04f1-b99f-43d8-9298-a55402b54782'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:42.430088 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e2a04f1-b99f-43d8-9298-a55402b54782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac0241d12dc44f091b9f1a32e70e4ba', 'request_id': 'req-2e2a04f1-b99f-43d8-9298-a55402b54782'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:42.436153 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e2a04f1-b99f-43d8-9298-a55402b54782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac0241d12dc44f091b9f1a32e70e4ba', 'request_id': 'req-2e2a04f1-b99f-43d8-9298-a55402b54782'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:42.449979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e2a04f1-b99f-43d8-9298-a55402b54782 admin admin] The token cache is being invalidate because project 9ac0241d12dc44f091b9f1a32e70e4ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:14:42.450274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e2a04f1-b99f-43d8-9298-a55402b54782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:42.451054 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2e2a04f1-b99f-43d8-9298-a55402b54782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:42.452684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1321/2671] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:14:42 2022] DELETE /identity/v3/projects/9ac0241d12dc44f091b9f1a32e70e4ba => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:42.456852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66b253-2228-4b32-aabc-60a870525dc5 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:42.458349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-bd66b253-2228-4b32-aabc-60a870525dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:42.471974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66b253-2228-4b32-aabc-60a870525dc5 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:42.513812 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:42.533668 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8930aa-36ae-4116-87fe-1020df1d5fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:42.534529 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8930aa-36ae-4116-87fe-1020df1d5fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:42.534852 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8930aa-36ae-4116-87fe-1020df1d5fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:42.535121 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8930aa-36ae-4116-87fe-1020df1d5fdc admin admin] PATH_INFO: `/v3/users/91a94c57c0534dd382cc672d778fcbf2` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:42.536346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8930aa-36ae-4116-87fe-1020df1d5fdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a94c57c0534dd382cc672d778fcbf2)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:42.538258 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8930aa-36ae-4116-87fe-1020df1d5fdc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:42.586605 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5d8930aa-36ae-4116-87fe-1020df1d5fdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a94c57c0534dd382cc672d778fcbf2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:42.599021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5d8930aa-36ae-4116-87fe-1020df1d5fdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a94c57c0534dd382cc672d778fcbf2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:42.608663 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5d8930aa-36ae-4116-87fe-1020df1d5fdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a94c57c0534dd382cc672d778fcbf2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:42.609410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5d8930aa-36ae-4116-87fe-1020df1d5fdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a94c57c0534dd382cc672d778fcbf2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:42.616879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5d8930aa-36ae-4116-87fe-1020df1d5fdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a94c57c0534dd382cc672d778fcbf2'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:42.622952 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1351/2672] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:14:42 2022] DELETE /identity/v3/users/91a94c57c0534dd382cc672d778fcbf2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:42.923062 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a04f1-b99f-43d8-9298-a55402b54782 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:42.924854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2e2a04f1-b99f-43d8-9298-a55402b54782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:42.942023 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a04f1-b99f-43d8-9298-a55402b54782 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:43.002575 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb417cf-41c9-4ba4-a43c-62b9c1b48e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:43.003487 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb417cf-41c9-4ba4-a43c-62b9c1b48e71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:43.003761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb417cf-41c9-4ba4-a43c-62b9c1b48e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:43.004033 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb417cf-41c9-4ba4-a43c-62b9c1b48e71 admin admin] PATH_INFO: `/v3/projects/b811c8d1107041cdb1474ea0e311d269` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:43.005302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb417cf-41c9-4ba4-a43c-62b9c1b48e71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b811c8d1107041cdb1474ea0e311d269)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:43.007277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb417cf-41c9-4ba4-a43c-62b9c1b48e71 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:43.056012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-deb417cf-41c9-4ba4-a43c-62b9c1b48e71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b811c8d1107041cdb1474ea0e311d269', 'request_id': 'req-deb417cf-41c9-4ba4-a43c-62b9c1b48e71'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:43.062730 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-deb417cf-41c9-4ba4-a43c-62b9c1b48e71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b811c8d1107041cdb1474ea0e311d269', 'request_id': 'req-deb417cf-41c9-4ba4-a43c-62b9c1b48e71'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:43.068800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-deb417cf-41c9-4ba4-a43c-62b9c1b48e71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b811c8d1107041cdb1474ea0e311d269', 'request_id': 'req-deb417cf-41c9-4ba4-a43c-62b9c1b48e71'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:43.082701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-deb417cf-41c9-4ba4-a43c-62b9c1b48e71 admin admin] The token cache is being invalidate because project b811c8d1107041cdb1474ea0e311d269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:14:43.083041 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-deb417cf-41c9-4ba4-a43c-62b9c1b48e71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:43.083728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-deb417cf-41c9-4ba4-a43c-62b9c1b48e71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:43.085346 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1322/2673] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:14:42 2022] DELETE /identity/v3/projects/b811c8d1107041cdb1474ea0e311d269 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:43.092693 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4c798-97c7-447f-8e4d-f4075a028401 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:43.092981 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4c798-97c7-447f-8e4d-f4075a028401 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:43.093260 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b4c798-97c7-447f-8e4d-f4075a028401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:43.112314 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d0b4c798-97c7-447f-8e4d-f4075a028401 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:43.113554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d0b4c798-97c7-447f-8e4d-f4075a028401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:43.180073 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1352/2674] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:14:43.190161 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a942bf7-2ecd-446c-86a4-139501374d3f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:43.190468 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a942bf7-2ecd-446c-86a4-139501374d3f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:43.190790 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a942bf7-2ecd-446c-86a4-139501374d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:43.210712 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-7a942bf7-2ecd-446c-86a4-139501374d3f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:43.211971 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7a942bf7-2ecd-446c-86a4-139501374d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:43.221860 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1323/2675] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:43.226088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4c798-97c7-447f-8e4d-f4075a028401 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:43.236171 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b4c798-97c7-447f-8e4d-f4075a028401 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:43.241231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bb451-4b0a-445d-ba18-df2936fee29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:43.241910 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bb451-4b0a-445d-ba18-df2936fee29e admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:43.242196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bb451-4b0a-445d-ba18-df2936fee29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:43.242471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bb451-4b0a-445d-ba18-df2936fee29e admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:43.243300 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bb451-4b0a-445d-ba18-df2936fee29e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:14:43.243609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bb451-4b0a-445d-ba18-df2936fee29e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:43.245213 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bb451-4b0a-445d-ba18-df2936fee29e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:43.259929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1353/2676] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:14:43.264853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a942bf7-2ecd-446c-86a4-139501374d3f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:43.275255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a942bf7-2ecd-446c-86a4-139501374d3f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:43.280463 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33f092-b276-4c3e-9e6b-8320071ed5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:43.281212 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33f092-b276-4c3e-9e6b-8320071ed5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:43.281506 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33f092-b276-4c3e-9e6b-8320071ed5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:43.281779 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33f092-b276-4c3e-9e6b-8320071ed5d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:43.282485 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33f092-b276-4c3e-9e6b-8320071ed5d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:43.284498 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33f092-b276-4c3e-9e6b-8320071ed5d3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:43.315754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1324/2677] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:14:43 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:14:43.320030 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bb451-4b0a-445d-ba18-df2936fee29e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:43.330832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bb451-4b0a-445d-ba18-df2936fee29e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:43.378225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:43.391556 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785de3eb-abbf-426d-9188-3ef18d0a218d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:43.392258 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785de3eb-abbf-426d-9188-3ef18d0a218d admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:43.392894 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785de3eb-abbf-426d-9188-3ef18d0a218d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:43.393427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785de3eb-abbf-426d-9188-3ef18d0a218d admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:43.394146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785de3eb-abbf-426d-9188-3ef18d0a218d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:43.396625 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785de3eb-abbf-426d-9188-3ef18d0a218d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:43.419103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1354/2678] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:14:43 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:14:43.423922 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33f092-b276-4c3e-9e6b-8320071ed5d3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:43.434561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33f092-b276-4c3e-9e6b-8320071ed5d3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:43.439728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a26a8-042a-4d6f-bbfc-11b886ab4b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:43.440414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a26a8-042a-4d6f-bbfc-11b886ab4b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:43.440701 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a26a8-042a-4d6f-bbfc-11b886ab4b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:43.440979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a26a8-042a-4d6f-bbfc-11b886ab4b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:43.441722 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a26a8-042a-4d6f-bbfc-11b886ab4b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:43.443383 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a26a8-042a-4d6f-bbfc-11b886ab4b42 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:43.454789 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1325/2679] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:14:43.459125 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785de3eb-abbf-426d-9188-3ef18d0a218d admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:43.471041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785de3eb-abbf-426d-9188-3ef18d0a218d admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:43.476332 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd39ed-4024-406a-bbf7-98da045b4496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:43.477019 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd39ed-4024-406a-bbf7-98da045b4496 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:43.477305 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd39ed-4024-406a-bbf7-98da045b4496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:43.477717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd39ed-4024-406a-bbf7-98da045b4496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:43.478469 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd39ed-4024-406a-bbf7-98da045b4496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:43.480144 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd39ed-4024-406a-bbf7-98da045b4496 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:43.491288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1355/2680] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:14:43.495806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a26a8-042a-4d6f-bbfc-11b886ab4b42 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:43.506719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a26a8-042a-4d6f-bbfc-11b886ab4b42 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:43.511737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fef6a-304a-405a-b281-83379c775efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:43.512642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fef6a-304a-405a-b281-83379c775efa admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:43.512919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fef6a-304a-405a-b281-83379c775efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:43.513195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fef6a-304a-405a-b281-83379c775efa admin admin] PATH_INFO: `/v3/projects/03c417d408764a50a377dd687f0c5257/users/24c20aa98d5e484c87669750d014e2d5/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:43.530461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fef6a-304a-405a-b281-83379c775efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c417d408764a50a377dd687f0c5257, user_id=24c20aa98d5e484c87669750d014e2d5, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:43.533326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fef6a-304a-405a-b281-83379c775efa admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:43.535642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:43.549858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1326/2681] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:14:43 2022] PUT /identity/v3/projects/03c417d408764a50a377dd687f0c5257/users/24c20aa98d5e484c87669750d014e2d5/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:43.561357 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe591ea-1d3c-45be-959e-b8b1b5a1a5b8 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:43.561678 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe591ea-1d3c-45be-959e-b8b1b5a1a5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:43.561951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe591ea-1d3c-45be-959e-b8b1b5a1a5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:43.590517 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-abe591ea-1d3c-45be-959e-b8b1b5a1a5b8 None None] MFA Rules not processed for user `24c20aa98d5e484c87669750d014e2d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:43.591781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-abe591ea-1d3c-45be-959e-b8b1b5a1a5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:43.659691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1356/2682] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:43.671724 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fef6a-304a-405a-b281-83379c775efa admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:43.673654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-999fef6a-304a-405a-b281-83379c775efa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:43.734573 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fef6a-304a-405a-b281-83379c775efa admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:43.738676 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233892ee-0b94-4c65-ae62-fd740e1dd987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:43.739373 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233892ee-0b94-4c65-ae62-fd740e1dd987 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:43.739646 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233892ee-0b94-4c65-ae62-fd740e1dd987 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:43.739913 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233892ee-0b94-4c65-ae62-fd740e1dd987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:43.749900 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233892ee-0b94-4c65-ae62-fd740e1dd987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:43.751458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233892ee-0b94-4c65-ae62-fd740e1dd987 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:43.761669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1327/2683] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:14:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:14:53.601425 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16671712-3c61-41bd-abc9-d6268c1a53dd None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:53.601975 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16671712-3c61-41bd-abc9-d6268c1a53dd None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:53.601975 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16671712-3c61-41bd-abc9-d6268c1a53dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:53.623252 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-16671712-3c61-41bd-abc9-d6268c1a53dd None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:53.624491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-16671712-3c61-41bd-abc9-d6268c1a53dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:53.683989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1357/2684] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 21 16:14:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:53.697007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233892ee-0b94-4c65-ae62-fd740e1dd987 service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:53.699077 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-233892ee-0b94-4c65-ae62-fd740e1dd987 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:53.775877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233892ee-0b94-4c65-ae62-fd740e1dd987 service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:53.782420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1412427-2b80-4d27-801f-325e5fd04b54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:53.783106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1412427-2b80-4d27-801f-325e5fd04b54 service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:53.783388 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1412427-2b80-4d27-801f-325e5fd04b54 service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:53.783664 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1412427-2b80-4d27-801f-325e5fd04b54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:53.792530 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1412427-2b80-4d27-801f-325e5fd04b54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:53.794142 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1412427-2b80-4d27-801f-325e5fd04b54 service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:53.803070 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1328/2685] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:14:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 16:14:57.428272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16671712-3c61-41bd-abc9-d6268c1a53dd None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:57.495411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16671712-3c61-41bd-abc9-d6268c1a53dd None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:57.500712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca3444-70a6-46df-acac-2a7d251ac549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:57.501582 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca3444-70a6-46df-acac-2a7d251ac549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:57.501864 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca3444-70a6-46df-acac-2a7d251ac549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:57.502135 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca3444-70a6-46df-acac-2a7d251ac549 admin admin] PATH_INFO: `/v3/users/24c20aa98d5e484c87669750d014e2d5` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:57.503408 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca3444-70a6-46df-acac-2a7d251ac549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c20aa98d5e484c87669750d014e2d5)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:57.505355 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ca3444-70a6-46df-acac-2a7d251ac549 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:57.508055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:57.555381 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-93ca3444-70a6-46df-acac-2a7d251ac549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c20aa98d5e484c87669750d014e2d5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:57.567399 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-93ca3444-70a6-46df-acac-2a7d251ac549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c20aa98d5e484c87669750d014e2d5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:57.576089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-93ca3444-70a6-46df-acac-2a7d251ac549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c20aa98d5e484c87669750d014e2d5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:57.576367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-93ca3444-70a6-46df-acac-2a7d251ac549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c20aa98d5e484c87669750d014e2d5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:57.583903 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-93ca3444-70a6-46df-acac-2a7d251ac549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c20aa98d5e484c87669750d014e2d5'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:57.589932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1358/2686] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:14:57 2022] DELETE /identity/v3/users/24c20aa98d5e484c87669750d014e2d5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:57.594694 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859344f-d90f-40bd-be11-7d796a92cc8c None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:57.595228 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859344f-d90f-40bd-be11-7d796a92cc8c None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:57.595324 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859344f-d90f-40bd-be11-7d796a92cc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:57.612826 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3859344f-d90f-40bd-be11-7d796a92cc8c None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:57.614037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3859344f-d90f-40bd-be11-7d796a92cc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:57.677141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1329/2687] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:57.687409 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca3444-70a6-46df-acac-2a7d251ac549 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:57.688934 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-93ca3444-70a6-46df-acac-2a7d251ac549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:57.745749 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca3444-70a6-46df-acac-2a7d251ac549 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:57.749713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecbe9-ee22-433f-b7b6-387021e57fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:57.750361 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecbe9-ee22-433f-b7b6-387021e57fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:57.750641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecbe9-ee22-433f-b7b6-387021e57fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:57.750944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecbe9-ee22-433f-b7b6-387021e57fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:57.759984 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ecbe9-ee22-433f-b7b6-387021e57fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:57.761427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822ecbe9-ee22-433f-b7b6-387021e57fc2 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:57.771266 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1359/2688] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:14:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:14:58.051720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859344f-d90f-40bd-be11-7d796a92cc8c None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:58.053152 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3859344f-d90f-40bd-be11-7d796a92cc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:58.065764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859344f-d90f-40bd-be11-7d796a92cc8c None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:58.070862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdfb3f-f9a4-4faf-92e6-20ec6f735956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:58.071796 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdfb3f-f9a4-4faf-92e6-20ec6f735956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:58.072073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdfb3f-f9a4-4faf-92e6-20ec6f735956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:58.072345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdfb3f-f9a4-4faf-92e6-20ec6f735956 admin admin] PATH_INFO: `/v3/projects/03c417d408764a50a377dd687f0c5257` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:58.073593 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdfb3f-f9a4-4faf-92e6-20ec6f735956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c417d408764a50a377dd687f0c5257)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:58.075560 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdfb3f-f9a4-4faf-92e6-20ec6f735956 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:58.102113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:58.127477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3ccdfb3f-f9a4-4faf-92e6-20ec6f735956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c417d408764a50a377dd687f0c5257', 'request_id': 'req-3ccdfb3f-f9a4-4faf-92e6-20ec6f735956'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:58.134072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3ccdfb3f-f9a4-4faf-92e6-20ec6f735956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c417d408764a50a377dd687f0c5257', 'request_id': 'req-3ccdfb3f-f9a4-4faf-92e6-20ec6f735956'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:58.140341 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3ccdfb3f-f9a4-4faf-92e6-20ec6f735956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c417d408764a50a377dd687f0c5257', 'request_id': 'req-3ccdfb3f-f9a4-4faf-92e6-20ec6f735956'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:58.154322 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3ccdfb3f-f9a4-4faf-92e6-20ec6f735956 admin admin] The token cache is being invalidate because project 03c417d408764a50a377dd687f0c5257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:14:58.154605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3ccdfb3f-f9a4-4faf-92e6-20ec6f735956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:58.155257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-3ccdfb3f-f9a4-4faf-92e6-20ec6f735956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:14:58.156858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1330/2689] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:14:58 2022] DELETE /identity/v3/projects/03c417d408764a50a377dd687f0c5257 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:58.161928 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2386c-c9e2-4fc3-be36-de4ad66395ad None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:58.162220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2386c-c9e2-4fc3-be36-de4ad66395ad None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:58.162500 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2386c-c9e2-4fc3-be36-de4ad66395ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:58.181908 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-06c2386c-c9e2-4fc3-be36-de4ad66395ad None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:58.183403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-06c2386c-c9e2-4fc3-be36-de4ad66395ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:58.249249 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1360/2690] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:58.257880 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a332f9c-440b-45b3-844b-4258964b6c57 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:58.258375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a332f9c-440b-45b3-844b-4258964b6c57 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:58.258746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a332f9c-440b-45b3-844b-4258964b6c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:58.281075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-1a332f9c-440b-45b3-844b-4258964b6c57 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:58.282296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1a332f9c-440b-45b3-844b-4258964b6c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:58.290715 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1331/2691] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:58.295298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2386c-c9e2-4fc3-be36-de4ad66395ad None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:58.305298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c2386c-c9e2-4fc3-be36-de4ad66395ad None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:58.310331 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51970527-661d-4cda-9de2-d8451a165014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:58.311033 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51970527-661d-4cda-9de2-d8451a165014 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:58.311322 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51970527-661d-4cda-9de2-d8451a165014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:58.311722 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51970527-661d-4cda-9de2-d8451a165014 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:58.312466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51970527-661d-4cda-9de2-d8451a165014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:14:58.312778 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51970527-661d-4cda-9de2-d8451a165014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:58.314384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51970527-661d-4cda-9de2-d8451a165014 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:58.326524 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1361/2692] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:14:58.331188 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a332f9c-440b-45b3-844b-4258964b6c57 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:58.341094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a332f9c-440b-45b3-844b-4258964b6c57 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:58.346950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f51be-3394-46f7-876b-d5aaeaceb0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:58.347609 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f51be-3394-46f7-876b-d5aaeaceb0ab admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:58.347891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f51be-3394-46f7-876b-d5aaeaceb0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:58.348144 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f51be-3394-46f7-876b-d5aaeaceb0ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:58.348834 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f51be-3394-46f7-876b-d5aaeaceb0ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:58.350740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f51be-3394-46f7-876b-d5aaeaceb0ab admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:58.377977 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1332/2693] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:14:58 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:14:58.382297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51970527-661d-4cda-9de2-d8451a165014 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:58.392920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51970527-661d-4cda-9de2-d8451a165014 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:58.402270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:58.453914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e485e1-7c16-4541-8e49-e5c9cb1d9874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:58.454601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e485e1-7c16-4541-8e49-e5c9cb1d9874 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:58.454864 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e485e1-7c16-4541-8e49-e5c9cb1d9874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:58.455155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e485e1-7c16-4541-8e49-e5c9cb1d9874 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:58.455890 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e485e1-7c16-4541-8e49-e5c9cb1d9874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:58.457810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e485e1-7c16-4541-8e49-e5c9cb1d9874 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:58.479725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1362/2694] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:14:58 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:14:58.484162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f51be-3394-46f7-876b-d5aaeaceb0ab admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:58.494919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f51be-3394-46f7-876b-d5aaeaceb0ab admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:58.499963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c780123-97a8-4bbf-9def-479d58eaa7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:58.500635 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c780123-97a8-4bbf-9def-479d58eaa7de admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:58.500920 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c780123-97a8-4bbf-9def-479d58eaa7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:58.501194 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c780123-97a8-4bbf-9def-479d58eaa7de admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:58.501927 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c780123-97a8-4bbf-9def-479d58eaa7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:58.503616 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c780123-97a8-4bbf-9def-479d58eaa7de admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:58.515289 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1333/2695] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:14:58.520007 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e485e1-7c16-4541-8e49-e5c9cb1d9874 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:58.530531 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e485e1-7c16-4541-8e49-e5c9cb1d9874 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:58.537306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb03ae-8a9f-441d-82f9-16278f4defb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:58.537986 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb03ae-8a9f-441d-82f9-16278f4defb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:58.538274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb03ae-8a9f-441d-82f9-16278f4defb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:58.538535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb03ae-8a9f-441d-82f9-16278f4defb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:58.539323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb03ae-8a9f-441d-82f9-16278f4defb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:58.540938 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb03ae-8a9f-441d-82f9-16278f4defb7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:58.553960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1363/2696] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:14:58.557898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c780123-97a8-4bbf-9def-479d58eaa7de admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:58.568755 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c780123-97a8-4bbf-9def-479d58eaa7de admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:58.574510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8192461-2f3f-41b0-8f39-24db8318e6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:58.575472 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8192461-2f3f-41b0-8f39-24db8318e6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:58.575751 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8192461-2f3f-41b0-8f39-24db8318e6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:58.576026 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8192461-2f3f-41b0-8f39-24db8318e6a9 admin admin] PATH_INFO: `/v3/projects/cc60eccef31046a1962ab79259bbb1db/users/4c923e34bd6548178c05ff976edf43bc/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:58.600778 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8192461-2f3f-41b0-8f39-24db8318e6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc60eccef31046a1962ab79259bbb1db, user_id=4c923e34bd6548178c05ff976edf43bc, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:58.603697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8192461-2f3f-41b0-8f39-24db8318e6a9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:58.619046 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1334/2697] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:14:58 2022] PUT /identity/v3/projects/cc60eccef31046a1962ab79259bbb1db/users/4c923e34bd6548178c05ff976edf43bc/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:58.631049 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f07227-7fb6-45f6-ada8-152ade600905 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:58.631353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f07227-7fb6-45f6-ada8-152ade600905 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:58.631659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f07227-7fb6-45f6-ada8-152ade600905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:58.660990 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e5f07227-7fb6-45f6-ada8-152ade600905 None None] MFA Rules not processed for user `4c923e34bd6548178c05ff976edf43bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:58.662225 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e5f07227-7fb6-45f6-ada8-152ade600905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:58.735110 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1364/2698] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:58.740187 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8192461-2f3f-41b0-8f39-24db8318e6a9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:58.807983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8192461-2f3f-41b0-8f39-24db8318e6a9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:58.812862 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edca55-02b0-4195-a954-3e6f983f7ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:58.813537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edca55-02b0-4195-a954-3e6f983f7ae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:58.813820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edca55-02b0-4195-a954-3e6f983f7ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:58.814093 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edca55-02b0-4195-a954-3e6f983f7ae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:58.814786 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2edca55-02b0-4195-a954-3e6f983f7ae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:58.816742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2edca55-02b0-4195-a954-3e6f983f7ae9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:58.844151 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1335/2699] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:14:58 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:14:58.848550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f07227-7fb6-45f6-ada8-152ade600905 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:58.859728 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f07227-7fb6-45f6-ada8-152ade600905 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:58.931924 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc806e-5bb5-4277-a32a-f8f513decc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:58.932615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc806e-5bb5-4277-a32a-f8f513decc89 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:58.932901 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc806e-5bb5-4277-a32a-f8f513decc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:58.933179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc806e-5bb5-4277-a32a-f8f513decc89 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:58.933906 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc806e-5bb5-4277-a32a-f8f513decc89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:58.935878 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc806e-5bb5-4277-a32a-f8f513decc89 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:58.958103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1365/2700] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:14:58 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:14:58.962793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edca55-02b0-4195-a954-3e6f983f7ae9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:58.976144 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edca55-02b0-4195-a954-3e6f983f7ae9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:58.981689 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed6f00-14ef-494e-a527-925963a46000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:58.982385 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed6f00-14ef-494e-a527-925963a46000 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:58.982665 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed6f00-14ef-494e-a527-925963a46000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:58.983050 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed6f00-14ef-494e-a527-925963a46000 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:58.983886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed6f00-14ef-494e-a527-925963a46000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:58.986473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed6f00-14ef-494e-a527-925963a46000 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:58.998274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1336/2701] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:14:59.002808 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc806e-5bb5-4277-a32a-f8f513decc89 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:59.013527 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc806e-5bb5-4277-a32a-f8f513decc89 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:59.018296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280cc6d2-91f5-4c70-a06f-88507c68e025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:59.019375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cc6d2-91f5-4c70-a06f-88507c68e025 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:59.019657 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cc6d2-91f5-4c70-a06f-88507c68e025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:59.019935 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280cc6d2-91f5-4c70-a06f-88507c68e025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:59.020669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cc6d2-91f5-4c70-a06f-88507c68e025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:59.022296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280cc6d2-91f5-4c70-a06f-88507c68e025 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:59.024629 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:59.034577 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1366/2702] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:14:59.038806 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed6f00-14ef-494e-a527-925963a46000 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:59.049955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed6f00-14ef-494e-a527-925963a46000 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:59.055073 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7febf9-b79e-44bb-8fb8-0ae403689eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:59.055974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7febf9-b79e-44bb-8fb8-0ae403689eba admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:59.056276 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7febf9-b79e-44bb-8fb8-0ae403689eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:59.056552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7febf9-b79e-44bb-8fb8-0ae403689eba admin admin] PATH_INFO: `/v3/projects/1a7681fd967d438c9bac7711436dfc3c/users/e39e673de18a42ab86cc3ca770007fc8/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:59.072069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7febf9-b79e-44bb-8fb8-0ae403689eba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7681fd967d438c9bac7711436dfc3c, user_id=e39e673de18a42ab86cc3ca770007fc8, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:59.074676 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7febf9-b79e-44bb-8fb8-0ae403689eba admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:59.077809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:59.090645 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1337/2703] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:14:59 2022] PUT /identity/v3/projects/1a7681fd967d438c9bac7711436dfc3c/users/e39e673de18a42ab86cc3ca770007fc8/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:59.101268 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739263d-4c70-419d-9d19-8f0d8db7bfc7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:59.101558 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739263d-4c70-419d-9d19-8f0d8db7bfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:59.101899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739263d-4c70-419d-9d19-8f0d8db7bfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:59.131594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c739263d-4c70-419d-9d19-8f0d8db7bfc7 None None] MFA Rules not processed for user `e39e673de18a42ab86cc3ca770007fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:59.132896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c739263d-4c70-419d-9d19-8f0d8db7bfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:59.207096 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1367/2704] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:59.212007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7febf9-b79e-44bb-8fb8-0ae403689eba admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:59.277923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7febf9-b79e-44bb-8fb8-0ae403689eba admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:59.283068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd43cb-3337-4ed9-bb22-22cd98909a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:59.283743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd43cb-3337-4ed9-bb22-22cd98909a50 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:59.284022 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd43cb-3337-4ed9-bb22-22cd98909a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:59.284293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd43cb-3337-4ed9-bb22-22cd98909a50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:59.285007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd43cb-3337-4ed9-bb22-22cd98909a50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:59.286965 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd43cb-3337-4ed9-bb22-22cd98909a50 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:59.318135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1338/2705] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:14:59 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:14:59.320445 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739263d-4c70-419d-9d19-8f0d8db7bfc7 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:59.331717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739263d-4c70-419d-9d19-8f0d8db7bfc7 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:59.388721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbaaae-deb3-4a0a-8607-e40baf608bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:59.389426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbaaae-deb3-4a0a-8607-e40baf608bee admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:59.389747 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbaaae-deb3-4a0a-8607-e40baf608bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:59.390022 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbaaae-deb3-4a0a-8607-e40baf608bee admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:59.390717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbaaae-deb3-4a0a-8607-e40baf608bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:59.392690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbaaae-deb3-4a0a-8607-e40baf608bee admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:59.415247 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1368/2706] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:14:59 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:14:59.419574 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd43cb-3337-4ed9-bb22-22cd98909a50 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:59.431606 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd43cb-3337-4ed9-bb22-22cd98909a50 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:59.436540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e1b1a-5e73-44cb-b40e-ab2ad7d933d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:59.437219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e1b1a-5e73-44cb-b40e-ab2ad7d933d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:59.437501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e1b1a-5e73-44cb-b40e-ab2ad7d933d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:59.437776 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e1b1a-5e73-44cb-b40e-ab2ad7d933d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:59.438516 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e1b1a-5e73-44cb-b40e-ab2ad7d933d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:59.440178 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e1b1a-5e73-44cb-b40e-ab2ad7d933d1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:59.452386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1339/2707] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:14:59.456718 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbaaae-deb3-4a0a-8607-e40baf608bee admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:59.467850 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbaaae-deb3-4a0a-8607-e40baf608bee admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:59.472797 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c552ca1-bf2c-4322-b9ea-968494848800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:59.473713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c552ca1-bf2c-4322-b9ea-968494848800 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:59.473997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c552ca1-bf2c-4322-b9ea-968494848800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:59.474273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c552ca1-bf2c-4322-b9ea-968494848800 admin admin] PATH_INFO: `/v3/projects/3038f02f79314f90936ad7492ada2905/users/fe74245adcf445fbb034f1ffdafd8277/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:59.492594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c552ca1-bf2c-4322-b9ea-968494848800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3038f02f79314f90936ad7492ada2905, user_id=fe74245adcf445fbb034f1ffdafd8277, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:59.495282 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c552ca1-bf2c-4322-b9ea-968494848800 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:59.509120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1369/2708] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:14:59 2022] PUT /identity/v3/projects/3038f02f79314f90936ad7492ada2905/users/fe74245adcf445fbb034f1ffdafd8277/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:59.513425 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e1b1a-5e73-44cb-b40e-ab2ad7d933d1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:59.524680 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e1b1a-5e73-44cb-b40e-ab2ad7d933d1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:59.588067 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8bb7d-4796-41f7-8e34-3a201dffbffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:59.588839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8bb7d-4796-41f7-8e34-3a201dffbffa admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:59.589193 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8bb7d-4796-41f7-8e34-3a201dffbffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:59.589662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8bb7d-4796-41f7-8e34-3a201dffbffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:59.590567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8bb7d-4796-41f7-8e34-3a201dffbffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:59.592636 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8bb7d-4796-41f7-8e34-3a201dffbffa admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:59.606062 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1340/2709] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:14:59.611333 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c552ca1-bf2c-4322-b9ea-968494848800 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:59.622587 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c552ca1-bf2c-4322-b9ea-968494848800 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:59.627662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900ae5d-adaf-498b-ae79-c64a7ea4d5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:59.628760 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900ae5d-adaf-498b-ae79-c64a7ea4d5e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:59.629084 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900ae5d-adaf-498b-ae79-c64a7ea4d5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:59.629395 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900ae5d-adaf-498b-ae79-c64a7ea4d5e1 admin admin] PATH_INFO: `/v3/projects/3038f02f79314f90936ad7492ada2905/users/fe74245adcf445fbb034f1ffdafd8277/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:59.631565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900ae5d-adaf-498b-ae79-c64a7ea4d5e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3038f02f79314f90936ad7492ada2905, user_id=fe74245adcf445fbb034f1ffdafd8277, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:59.634344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900ae5d-adaf-498b-ae79-c64a7ea4d5e1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:59.645591 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1370/2710] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:14:59 2022] PUT /identity/v3/projects/3038f02f79314f90936ad7492ada2905/users/fe74245adcf445fbb034f1ffdafd8277/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:14:59.657527 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15ffb4-6149-4054-9638-e8aff0f5c41f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:59.657817 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15ffb4-6149-4054-9638-e8aff0f5c41f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:59.658095 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15ffb4-6149-4054-9638-e8aff0f5c41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:59.686205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-fd15ffb4-6149-4054-9638-e8aff0f5c41f None None] MFA Rules not processed for user `fe74245adcf445fbb034f1ffdafd8277`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:14:59.687477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fd15ffb4-6149-4054-9638-e8aff0f5c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:59.738164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:59.760053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1341/2711] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:14:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:14:59.772442 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900ae5d-adaf-498b-ae79-c64a7ea4d5e1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:14:59.774452 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3900ae5d-adaf-498b-ae79-c64a7ea4d5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:14:59.822105 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:14:59.838710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900ae5d-adaf-498b-ae79-c64a7ea4d5e1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:14:59.842578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b13b7-49a5-43a2-bf0b-97bdcc89a656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:14:59.843296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b13b7-49a5-43a2-bf0b-97bdcc89a656 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:14:59.843578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b13b7-49a5-43a2-bf0b-97bdcc89a656 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:14:59.843851 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b13b7-49a5-43a2-bf0b-97bdcc89a656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:14:59.902213 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b13b7-49a5-43a2-bf0b-97bdcc89a656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:14:59.903955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b13b7-49a5-43a2-bf0b-97bdcc89a656 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:14:59.914402 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1371/2712] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:14:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:15:01.428350 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15ffb4-6149-4054-9638-e8aff0f5c41f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:01.430041 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fd15ffb4-6149-4054-9638-e8aff0f5c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:01.444299 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15ffb4-6149-4054-9638-e8aff0f5c41f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:01.448878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d48262-c649-4ca4-ba55-6e908f04499b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:01.449474 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d48262-c649-4ca4-ba55-6e908f04499b service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:01.449757 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d48262-c649-4ca4-ba55-6e908f04499b service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:01.450028 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d48262-c649-4ca4-ba55-6e908f04499b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:01.509113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d48262-c649-4ca4-ba55-6e908f04499b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:01.510578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d48262-c649-4ca4-ba55-6e908f04499b service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:01.520246 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1342/2713] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:15:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:15:02.051734 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b13b7-49a5-43a2-bf0b-97bdcc89a656 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:02.061155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b13b7-49a5-43a2-bf0b-97bdcc89a656 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:02.064986 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0e838-e584-442b-af8a-998f11d2923d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:02.065690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0e838-e584-442b-af8a-998f11d2923d service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:02.065973 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0e838-e584-442b-af8a-998f11d2923d service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:02.066246 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0e838-e584-442b-af8a-998f11d2923d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:02.075603 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0e838-e584-442b-af8a-998f11d2923d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:02.077078 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0e838-e584-442b-af8a-998f11d2923d service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:02.086578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1372/2714] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:15:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:15:05.955477 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d48262-c649-4ca4-ba55-6e908f04499b service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:06.019704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d48262-c649-4ca4-ba55-6e908f04499b service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:06.024787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601cb9c-02b9-4450-978b-23860aaf3c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:06.025692 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601cb9c-02b9-4450-978b-23860aaf3c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:06.025975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601cb9c-02b9-4450-978b-23860aaf3c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:06.026249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601cb9c-02b9-4450-978b-23860aaf3c46 admin admin] PATH_INFO: `/v3/users/4c923e34bd6548178c05ff976edf43bc` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:06.027462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601cb9c-02b9-4450-978b-23860aaf3c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c923e34bd6548178c05ff976edf43bc)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:06.029412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601cb9c-02b9-4450-978b-23860aaf3c46 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:06.084978 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9601cb9c-02b9-4450-978b-23860aaf3c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c923e34bd6548178c05ff976edf43bc'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:06.100134 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9601cb9c-02b9-4450-978b-23860aaf3c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c923e34bd6548178c05ff976edf43bc'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:06.110217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9601cb9c-02b9-4450-978b-23860aaf3c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c923e34bd6548178c05ff976edf43bc'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:06.110908 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9601cb9c-02b9-4450-978b-23860aaf3c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c923e34bd6548178c05ff976edf43bc'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:06.111553 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9601cb9c-02b9-4450-978b-23860aaf3c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c923e34bd6548178c05ff976edf43bc'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:06.129623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1343/2715] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:15:05 2022] DELETE /identity/v3/users/4c923e34bd6548178c05ff976edf43bc => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:15:06.135569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc2f55-b9a3-4c60-a7a1-781944889bd9 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:06.136090 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc2f55-b9a3-4c60-a7a1-781944889bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:06.136478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc2f55-b9a3-4c60-a7a1-781944889bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:06.156704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-decc2f55-b9a3-4c60-a7a1-781944889bd9 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:15:06.157952 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-decc2f55-b9a3-4c60-a7a1-781944889bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:06.232995 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1373/2716] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:15:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:15:06.243297 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601cb9c-02b9-4450-978b-23860aaf3c46 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:06.245056 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-9601cb9c-02b9-4450-978b-23860aaf3c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:06.256154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:15:06.314855 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601cb9c-02b9-4450-978b-23860aaf3c46 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:06.318951 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ed5a8-c96a-4637-a7d5-0652bf3fddc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:06.319607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ed5a8-c96a-4637-a7d5-0652bf3fddc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:06.319886 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ed5a8-c96a-4637-a7d5-0652bf3fddc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:06.320164 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ed5a8-c96a-4637-a7d5-0652bf3fddc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:06.331357 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ed5a8-c96a-4637-a7d5-0652bf3fddc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:06.332809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ed5a8-c96a-4637-a7d5-0652bf3fddc5 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:06.343310 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1344/2717] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:15:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:15:06.630424 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc2f55-b9a3-4c60-a7a1-781944889bd9 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:06.631987 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-decc2f55-b9a3-4c60-a7a1-781944889bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:06.646361 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc2f55-b9a3-4c60-a7a1-781944889bd9 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:06.654502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:06.656096 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:06.656096 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:06.656408 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92 admin admin] PATH_INFO: `/v3/projects/cc60eccef31046a1962ab79259bbb1db` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:06.657658 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc60eccef31046a1962ab79259bbb1db)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:06.659692 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:06.716620 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc60eccef31046a1962ab79259bbb1db', 'request_id': 'req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:06.727535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc60eccef31046a1962ab79259bbb1db', 'request_id': 'req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:06.735490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc60eccef31046a1962ab79259bbb1db', 'request_id': 'req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:06.748548 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92 admin admin] The token cache is being invalidate because project cc60eccef31046a1962ab79259bbb1db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:15:06.748878 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:06.749569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:06.751300 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1374/2718] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:15:06 2022] DELETE /identity/v3/projects/cc60eccef31046a1962ab79259bbb1db => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:15:06.755741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ed5a8-c96a-4637-a7d5-0652bf3fddc5 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:06.766617 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ed5a8-c96a-4637-a7d5-0652bf3fddc5 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:06.832174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd3d04-494b-4c3f-b6cc-46d0fe382c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:06.833174 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd3d04-494b-4c3f-b6cc-46d0fe382c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:06.833443 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd3d04-494b-4c3f-b6cc-46d0fe382c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:06.833728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdd3d04-494b-4c3f-b6cc-46d0fe382c08 admin admin] PATH_INFO: `/v3/users/e39e673de18a42ab86cc3ca770007fc8` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:06.835088 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd3d04-494b-4c3f-b6cc-46d0fe382c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39e673de18a42ab86cc3ca770007fc8)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:06.837372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdd3d04-494b-4c3f-b6cc-46d0fe382c08 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:06.901412 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dfdd3d04-494b-4c3f-b6cc-46d0fe382c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39e673de18a42ab86cc3ca770007fc8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:06.909816 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dfdd3d04-494b-4c3f-b6cc-46d0fe382c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39e673de18a42ab86cc3ca770007fc8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:06.920395 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dfdd3d04-494b-4c3f-b6cc-46d0fe382c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39e673de18a42ab86cc3ca770007fc8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:06.921162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dfdd3d04-494b-4c3f-b6cc-46d0fe382c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39e673de18a42ab86cc3ca770007fc8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:06.921899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dfdd3d04-494b-4c3f-b6cc-46d0fe382c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39e673de18a42ab86cc3ca770007fc8'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:06.941230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1345/2719] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:15:06 2022] DELETE /identity/v3/users/e39e673de18a42ab86cc3ca770007fc8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:15:07.251383 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:07.252854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:07.268261 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc7b33-5dd8-4a80-8f27-83acfaafaa92 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:07.269771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:15:07.344513 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb5767-087e-497e-a22b-52f4025b643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:07.345402 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb5767-087e-497e-a22b-52f4025b643f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:07.345706 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb5767-087e-497e-a22b-52f4025b643f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:07.345982 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb5767-087e-497e-a22b-52f4025b643f admin admin] PATH_INFO: `/v3/projects/1a7681fd967d438c9bac7711436dfc3c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:07.347224 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb5767-087e-497e-a22b-52f4025b643f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7681fd967d438c9bac7711436dfc3c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:07.349229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb5767-087e-497e-a22b-52f4025b643f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:07.399932 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-50eb5767-087e-497e-a22b-52f4025b643f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7681fd967d438c9bac7711436dfc3c', 'request_id': 'req-50eb5767-087e-497e-a22b-52f4025b643f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:07.408315 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-50eb5767-087e-497e-a22b-52f4025b643f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7681fd967d438c9bac7711436dfc3c', 'request_id': 'req-50eb5767-087e-497e-a22b-52f4025b643f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:07.416000 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-50eb5767-087e-497e-a22b-52f4025b643f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7681fd967d438c9bac7711436dfc3c', 'request_id': 'req-50eb5767-087e-497e-a22b-52f4025b643f'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:07.430010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-50eb5767-087e-497e-a22b-52f4025b643f admin admin] The token cache is being invalidate because project 1a7681fd967d438c9bac7711436dfc3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:15:07.432101 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-50eb5767-087e-497e-a22b-52f4025b643f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:07.433404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-50eb5767-087e-497e-a22b-52f4025b643f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:07.435553 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1375/2720] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:15:07 2022] DELETE /identity/v3/projects/1a7681fd967d438c9bac7711436dfc3c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:15:07.440292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd3d04-494b-4c3f-b6cc-46d0fe382c08 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:07.441805 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-dfdd3d04-494b-4c3f-b6cc-46d0fe382c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:07.455418 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdd3d04-494b-4c3f-b6cc-46d0fe382c08 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:07.488797 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:15:07.523537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b3f8c-60d2-428d-a605-ae727bb9539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:07.524427 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b3f8c-60d2-428d-a605-ae727bb9539a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:07.524708 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b3f8c-60d2-428d-a605-ae727bb9539a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:07.524982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b3f8c-60d2-428d-a605-ae727bb9539a admin admin] PATH_INFO: `/v3/users/fe74245adcf445fbb034f1ffdafd8277` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:07.526217 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b3f8c-60d2-428d-a605-ae727bb9539a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe74245adcf445fbb034f1ffdafd8277)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:07.528201 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b3f8c-60d2-428d-a605-ae727bb9539a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:07.582273 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b16b3f8c-60d2-428d-a605-ae727bb9539a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe74245adcf445fbb034f1ffdafd8277'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:07.592488 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b16b3f8c-60d2-428d-a605-ae727bb9539a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe74245adcf445fbb034f1ffdafd8277'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:07.601494 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b16b3f8c-60d2-428d-a605-ae727bb9539a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe74245adcf445fbb034f1ffdafd8277'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:07.602096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b16b3f8c-60d2-428d-a605-ae727bb9539a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe74245adcf445fbb034f1ffdafd8277'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:07.602703 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b16b3f8c-60d2-428d-a605-ae727bb9539a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe74245adcf445fbb034f1ffdafd8277'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:07.624420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1346/2721] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:15:07 2022] DELETE /identity/v3/users/fe74245adcf445fbb034f1ffdafd8277 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:15:08.172694 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb5767-087e-497e-a22b-52f4025b643f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:08.174267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-50eb5767-087e-497e-a22b-52f4025b643f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:08.188085 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb5767-087e-497e-a22b-52f4025b643f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:08.252868 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55f80a-a321-4ce1-89e2-338c6a14cac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:08.253872 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55f80a-a321-4ce1-89e2-338c6a14cac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:08.254105 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55f80a-a321-4ce1-89e2-338c6a14cac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:08.254375 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55f80a-a321-4ce1-89e2-338c6a14cac8 admin admin] PATH_INFO: `/v3/projects/3038f02f79314f90936ad7492ada2905` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:08.255737 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55f80a-a321-4ce1-89e2-338c6a14cac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3038f02f79314f90936ad7492ada2905)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:08.257689 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55f80a-a321-4ce1-89e2-338c6a14cac8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:08.302612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:15:08.313950 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ea55f80a-a321-4ce1-89e2-338c6a14cac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3038f02f79314f90936ad7492ada2905', 'request_id': 'req-ea55f80a-a321-4ce1-89e2-338c6a14cac8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:08.322170 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ea55f80a-a321-4ce1-89e2-338c6a14cac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3038f02f79314f90936ad7492ada2905', 'request_id': 'req-ea55f80a-a321-4ce1-89e2-338c6a14cac8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:08.330445 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ea55f80a-a321-4ce1-89e2-338c6a14cac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3038f02f79314f90936ad7492ada2905', 'request_id': 'req-ea55f80a-a321-4ce1-89e2-338c6a14cac8'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:08.342246 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ea55f80a-a321-4ce1-89e2-338c6a14cac8 admin admin] The token cache is being invalidate because project 3038f02f79314f90936ad7492ada2905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:15:08.342537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ea55f80a-a321-4ce1-89e2-338c6a14cac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:08.343266 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-ea55f80a-a321-4ce1-89e2-338c6a14cac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:15:08.344892 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1376/2722] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:15:08 2022] DELETE /identity/v3/projects/3038f02f79314f90936ad7492ada2905 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:15:08.350148 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598dcb5-92a4-4737-b56f-9d4f8204825b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:08.350438 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598dcb5-92a4-4737-b56f-9d4f8204825b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:08.350717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598dcb5-92a4-4737-b56f-9d4f8204825b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:08.370916 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6598dcb5-92a4-4737-b56f-9d4f8204825b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:15:08.372158 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6598dcb5-92a4-4737-b56f-9d4f8204825b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:08.446718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1347/2723] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:15:08.456062 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f576779-8839-4eec-a88d-32783cf55115 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:08.456349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f576779-8839-4eec-a88d-32783cf55115 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:08.456626 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f576779-8839-4eec-a88d-32783cf55115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:08.478353 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2f576779-8839-4eec-a88d-32783cf55115 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:15:08.479785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2f576779-8839-4eec-a88d-32783cf55115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:08.488806 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1377/2724] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:15:08.493718 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598dcb5-92a4-4737-b56f-9d4f8204825b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:08.504116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598dcb5-92a4-4737-b56f-9d4f8204825b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:08.509293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5eb8d0-226c-4eaa-9f82-0ff3ddd0080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:08.509968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5eb8d0-226c-4eaa-9f82-0ff3ddd0080a admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:08.510254 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5eb8d0-226c-4eaa-9f82-0ff3ddd0080a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:08.510525 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5eb8d0-226c-4eaa-9f82-0ff3ddd0080a admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:08.511311 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5eb8d0-226c-4eaa-9f82-0ff3ddd0080a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:15:08.511622 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5eb8d0-226c-4eaa-9f82-0ff3ddd0080a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:08.513284 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5eb8d0-226c-4eaa-9f82-0ff3ddd0080a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:08.526226 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1348/2725] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:15:08.532258 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f576779-8839-4eec-a88d-32783cf55115 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:08.549803 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f576779-8839-4eec-a88d-32783cf55115 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:08.557441 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87095379-58cc-42d5-8851-afe644aeacb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:08.558483 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87095379-58cc-42d5-8851-afe644aeacb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:08.559036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87095379-58cc-42d5-8851-afe644aeacb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:08.559532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87095379-58cc-42d5-8851-afe644aeacb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:08.560813 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87095379-58cc-42d5-8851-afe644aeacb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:08.564437 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87095379-58cc-42d5-8851-afe644aeacb1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:08.602606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1378/2726] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:15:08 2022] POST /identity/v3/projects => generated 379 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:15:08.607890 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5eb8d0-226c-4eaa-9f82-0ff3ddd0080a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:08.621513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5eb8d0-226c-4eaa-9f82-0ff3ddd0080a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:08.662868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:15:08.689139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e9cec-563b-4cb6-8491-bd97d60469ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:08.689820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e9cec-563b-4cb6-8491-bd97d60469ea admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:08.690095 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e9cec-563b-4cb6-8491-bd97d60469ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:08.690365 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e9cec-563b-4cb6-8491-bd97d60469ea admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:08.691090 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e9cec-563b-4cb6-8491-bd97d60469ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:08.693007 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2e9cec-563b-4cb6-8491-bd97d60469ea admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:08.715011 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1349/2727] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:15:08 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:15:08.719931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87095379-58cc-42d5-8851-afe644aeacb1 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:08.730344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87095379-58cc-42d5-8851-afe644aeacb1 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:08.735385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845724b9-2f8a-4b04-9431-423a33d3fccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:08.736069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845724b9-2f8a-4b04-9431-423a33d3fccf admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:08.736339 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845724b9-2f8a-4b04-9431-423a33d3fccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:08.736612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845724b9-2f8a-4b04-9431-423a33d3fccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:08.737346 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845724b9-2f8a-4b04-9431-423a33d3fccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:08.738972 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845724b9-2f8a-4b04-9431-423a33d3fccf admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:08.750407 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1379/2728] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:15:08.754683 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e9cec-563b-4cb6-8491-bd97d60469ea admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:08.770018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e9cec-563b-4cb6-8491-bd97d60469ea admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:08.777762 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a67ce-32a1-4772-8bc2-9dace9f883f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:08.778467 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a67ce-32a1-4772-8bc2-9dace9f883f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:08.778955 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a67ce-32a1-4772-8bc2-9dace9f883f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:08.779370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a67ce-32a1-4772-8bc2-9dace9f883f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:08.780261 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a67ce-32a1-4772-8bc2-9dace9f883f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:08.781889 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a67ce-32a1-4772-8bc2-9dace9f883f9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:08.793004 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1350/2729] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:15:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:15:08.797389 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845724b9-2f8a-4b04-9431-423a33d3fccf admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:08.807964 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845724b9-2f8a-4b04-9431-423a33d3fccf admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:08.812859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9f1c0-a752-41bd-96ae-b1eb5dd74c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:08.813771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9f1c0-a752-41bd-96ae-b1eb5dd74c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:08.814052 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9f1c0-a752-41bd-96ae-b1eb5dd74c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:08.814330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9f1c0-a752-41bd-96ae-b1eb5dd74c80 admin admin] PATH_INFO: `/v3/projects/026c1a182b44423ab41b012cd623096f/users/32713a1249804e3290bbeeccb43011dc/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:08.830635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9f1c0-a752-41bd-96ae-b1eb5dd74c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=026c1a182b44423ab41b012cd623096f, user_id=32713a1249804e3290bbeeccb43011dc, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:08.833362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9f1c0-a752-41bd-96ae-b1eb5dd74c80 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:08.853138 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1380/2730] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:15:08 2022] PUT /identity/v3/projects/026c1a182b44423ab41b012cd623096f/users/32713a1249804e3290bbeeccb43011dc/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:15:08.858619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03362f-14c8-420b-8d16-145b92b4f85e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:08.858947 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03362f-14c8-420b-8d16-145b92b4f85e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:08.859243 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03362f-14c8-420b-8d16-145b92b4f85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:08.878658 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ce03362f-14c8-420b-8d16-145b92b4f85e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:15:08.879909 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ce03362f-14c8-420b-8d16-145b92b4f85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:08.948252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1351/2731] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:15:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:15:08.958846 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9f1c0-a752-41bd-96ae-b1eb5dd74c80 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:08.961070 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-84e9f1c0-a752-41bd-96ae-b1eb5dd74c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:09.027862 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9f1c0-a752-41bd-96ae-b1eb5dd74c80 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:09.031857 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c79aa-c83d-4487-a58f-5d622ee72763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:09.032535 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c79aa-c83d-4487-a58f-5d622ee72763 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:09.032854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c79aa-c83d-4487-a58f-5d622ee72763 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:09.033156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c79aa-c83d-4487-a58f-5d622ee72763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:09.043620 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c79aa-c83d-4487-a58f-5d622ee72763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:09.045210 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c79aa-c83d-4487-a58f-5d622ee72763 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:09.056003 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1381/2732] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:15:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:15:09.712547 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb182cf0-1950-4a0f-bb79-b85bda6e86c1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:09.713096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb182cf0-1950-4a0f-bb79-b85bda6e86c1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:09.713096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb182cf0-1950-4a0f-bb79-b85bda6e86c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:09.740462 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-cb182cf0-1950-4a0f-bb79-b85bda6e86c1 None None] MFA Rules not processed for user `32713a1249804e3290bbeeccb43011dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:15:09.741871 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-cb182cf0-1950-4a0f-bb79-b85bda6e86c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:09.824878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1352/2733] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:15:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:15:09.836658 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c79aa-c83d-4487-a58f-5d622ee72763 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:09.838162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-309c79aa-c83d-4487-a58f-5d622ee72763 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:09.901013 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c79aa-c83d-4487-a58f-5d622ee72763 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:09.905443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e42f7-516b-4b1c-9ea5-660fbb8a1010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:09.906234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e42f7-516b-4b1c-9ea5-660fbb8a1010 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:09.906550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e42f7-516b-4b1c-9ea5-660fbb8a1010 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:09.906879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e42f7-516b-4b1c-9ea5-660fbb8a1010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:09.917715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e42f7-516b-4b1c-9ea5-660fbb8a1010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:09.919230 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e42f7-516b-4b1c-9ea5-660fbb8a1010 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:09.928995 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1382/2734] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:15:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:15:11.369946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86fd30-5aec-443a-b9b3-db55b3b74de9 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:11.370578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86fd30-5aec-443a-b9b3-db55b3b74de9 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:11.370578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86fd30-5aec-443a-b9b3-db55b3b74de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:11.392190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5f86fd30-5aec-443a-b9b3-db55b3b74de9 None None] MFA Rules not processed for user `32713a1249804e3290bbeeccb43011dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:15:11.393800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f86fd30-5aec-443a-b9b3-db55b3b74de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:11.401658 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1353/2735] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:15:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:15:19.924735 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:15:21.384764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:15:46.268615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdefa7-a679-43ad-93a2-29d11af11086 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:46.269219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdefa7-a679-43ad-93a2-29d11af11086 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:46.269219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdefa7-a679-43ad-93a2-29d11af11086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:46.289066 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-91cdefa7-a679-43ad-93a2-29d11af11086 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:15:46.290290 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-91cdefa7-a679-43ad-93a2-29d11af11086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:46.299561 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1383/2736] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 16:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:15:46.338428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86fd30-5aec-443a-b9b3-db55b3b74de9 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:46.340129 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5f86fd30-5aec-443a-b9b3-db55b3b74de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:46.418423 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86fd30-5aec-443a-b9b3-db55b3b74de9 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:46.432675 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d9ec3-a4a0-402c-9d3b-77499073b02c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:46.433334 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d9ec3-a4a0-402c-9d3b-77499073b02c service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:46.433621 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d9ec3-a4a0-402c-9d3b-77499073b02c service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:46.433894 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d9ec3-a4a0-402c-9d3b-77499073b02c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:46.443256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d9ec3-a4a0-402c-9d3b-77499073b02c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:46.444868 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433d9ec3-a4a0-402c-9d3b-77499073b02c service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:46.454741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1354/2737] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:15:50.387805 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774b54e-e607-49e1-836f-23330ab8b8f0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:50.388384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774b54e-e607-49e1-836f-23330ab8b8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:50.388384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774b54e-e607-49e1-836f-23330ab8b8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:50.409399 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f774b54e-e607-49e1-836f-23330ab8b8f0 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:15:50.410665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f774b54e-e607-49e1-836f-23330ab8b8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:50.420525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1384/2738] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 16:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:15:50.456899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d9ec3-a4a0-402c-9d3b-77499073b02c service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:50.459690 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-433d9ec3-a4a0-402c-9d3b-77499073b02c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:50.480018 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d9ec3-a4a0-402c-9d3b-77499073b02c service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:50.486974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c038b-7aa0-4053-9226-d554052c7a69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:50.487615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c038b-7aa0-4053-9226-d554052c7a69 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:50.487896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c038b-7aa0-4053-9226-d554052c7a69 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:50.488187 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c038b-7aa0-4053-9226-d554052c7a69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:50.497075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c038b-7aa0-4053-9226-d554052c7a69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:50.498653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c038b-7aa0-4053-9226-d554052c7a69 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:50.508592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1355/2739] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:15:54.689861 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f86c-3bff-4a21-8e84-cabf53a0d1c7 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:54.690627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f86c-3bff-4a21-8e84-cabf53a0d1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:54.690627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f86c-3bff-4a21-8e84-cabf53a0d1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:54.713209 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-91d1f86c-3bff-4a21-8e84-cabf53a0d1c7 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:15:54.714255 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-91d1f86c-3bff-4a21-8e84-cabf53a0d1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:54.724117 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1385/2740] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 16:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:15:54.747077 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c038b-7aa0-4053-9226-d554052c7a69 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:54.758988 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c038b-7aa0-4053-9226-d554052c7a69 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:54.765705 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85989d-3027-4c26-a9e1-180ad148e2fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:54.766359 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85989d-3027-4c26-a9e1-180ad148e2fd service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:54.766641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85989d-3027-4c26-a9e1-180ad148e2fd service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:54.767035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85989d-3027-4c26-a9e1-180ad148e2fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:54.779894 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85989d-3027-4c26-a9e1-180ad148e2fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:54.781507 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c85989d-3027-4c26-a9e1-180ad148e2fd service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:54.793668 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1356/2741] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:15:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:15:57.772547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad201-4ae5-4127-b8f2-87928a56cfb0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:57.773076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad201-4ae5-4127-b8f2-87928a56cfb0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:57.773076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad201-4ae5-4127-b8f2-87928a56cfb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:57.796429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-85cad201-4ae5-4127-b8f2-87928a56cfb0 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:15:57.797653 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-85cad201-4ae5-4127-b8f2-87928a56cfb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:15:57.807182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1386/2742] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 16:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:15:57.829653 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85989d-3027-4c26-a9e1-180ad148e2fd service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:15:57.842158 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85989d-3027-4c26-a9e1-180ad148e2fd service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:15:57.848961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0dd43-66d2-4ad6-9a0c-f85efc0439ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:15:57.849603 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0dd43-66d2-4ad6-9a0c-f85efc0439ed service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:15:57.849879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0dd43-66d2-4ad6-9a0c-f85efc0439ed service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:15:57.850148 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0dd43-66d2-4ad6-9a0c-f85efc0439ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:15:57.859066 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0dd43-66d2-4ad6-9a0c-f85efc0439ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:15:57.860641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf0dd43-66d2-4ad6-9a0c-f85efc0439ed service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:15:57.870139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1357/2743] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:16:00.327005 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cad201-4ae5-4127-b8f2-87928a56cfb0 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:16:00.340182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cad201-4ae5-4127-b8f2-87928a56cfb0 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:16:00.345011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2057a-b7f8-4566-9081-f0b5568e846d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:16:00.345898 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2057a-b7f8-4566-9081-f0b5568e846d service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:00.346277 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2057a-b7f8-4566-9081-f0b5568e846d service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:00.346710 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2057a-b7f8-4566-9081-f0b5568e846d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:00.349812 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-55e2057a-b7f8-4566-9081-f0b5568e846d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:16:00.371374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2057a-b7f8-4566-9081-f0b5568e846d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:16:00.373095 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2057a-b7f8-4566-9081-f0b5568e846d service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:16:00.392477 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1387/2744] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:16:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:16:01.972817 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cde805-794a-47c8-a1f8-54b7803593a1 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:01.973380 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cde805-794a-47c8-a1f8-54b7803593a1 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:01.973380 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cde805-794a-47c8-a1f8-54b7803593a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:01.993499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-95cde805-794a-47c8-a1f8-54b7803593a1 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:16:01.994768 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-95cde805-794a-47c8-a1f8-54b7803593a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:16:02.003398 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1358/2745] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 16:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:16:02.024769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2057a-b7f8-4566-9081-f0b5568e846d service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:16:02.036152 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2057a-b7f8-4566-9081-f0b5568e846d service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:16:02.042566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d721498-d655-4186-9802-2d252950efaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:16:02.043250 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d721498-d655-4186-9802-2d252950efaf service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:02.043560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d721498-d655-4186-9802-2d252950efaf service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:02.043829 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d721498-d655-4186-9802-2d252950efaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:02.053065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d721498-d655-4186-9802-2d252950efaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:16:02.054922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d721498-d655-4186-9802-2d252950efaf service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:16:02.064956 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1388/2746] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:16:04.270032 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cde805-794a-47c8-a1f8-54b7803593a1 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:16:04.272413 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-95cde805-794a-47c8-a1f8-54b7803593a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:16:04.290618 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cde805-794a-47c8-a1f8-54b7803593a1 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:16:04.295464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9cbab-4a9a-4214-bd40-49326937bebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:16:04.296119 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9cbab-4a9a-4214-bd40-49326937bebb service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:04.296400 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9cbab-4a9a-4214-bd40-49326937bebb service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:04.296672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9cbab-4a9a-4214-bd40-49326937bebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:04.298837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ece9cbab-4a9a-4214-bd40-49326937bebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:16:04.313592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9cbab-4a9a-4214-bd40-49326937bebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:16:04.315061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece9cbab-4a9a-4214-bd40-49326937bebb service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:16:04.327436 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1359/2747] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:16:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:16:07.221311 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3946e99-e7e2-4ce0-8350-b593caedc30a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:07.221896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3946e99-e7e2-4ce0-8350-b593caedc30a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:07.221896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3946e99-e7e2-4ce0-8350-b593caedc30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:07.241143 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f3946e99-e7e2-4ce0-8350-b593caedc30a None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:16:07.242385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f3946e99-e7e2-4ce0-8350-b593caedc30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:16:07.250480 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1389/2748] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 16:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:16:07.272865 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9cbab-4a9a-4214-bd40-49326937bebb service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:16:07.285420 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9cbab-4a9a-4214-bd40-49326937bebb service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:16:07.291675 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fedde-4a39-40c5-9424-712900703937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:16:07.292338 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fedde-4a39-40c5-9424-712900703937 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:07.292619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fedde-4a39-40c5-9424-712900703937 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:07.292898 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fedde-4a39-40c5-9424-712900703937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:07.303086 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fedde-4a39-40c5-9424-712900703937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:16:07.304514 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fedde-4a39-40c5-9424-712900703937 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:16:07.314615 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1360/2749] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:16:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:16:08.807203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc57708-d50b-4428-86b6-6f5ef2b16093 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:08.807728 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc57708-d50b-4428-86b6-6f5ef2b16093 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:08.807848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc57708-d50b-4428-86b6-6f5ef2b16093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:08.826685 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9cc57708-d50b-4428-86b6-6f5ef2b16093 None None] MFA Rules not processed for user `dd0f22fa4ee8472f89eb3de52d066cfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:16:08.827949 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9cc57708-d50b-4428-86b6-6f5ef2b16093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:16:08.886426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1390/2750] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:16:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:16:17.310111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=67 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:16:18.879144 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=52 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:16:25.021534 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfcfeb-9cd8-48bd-a369-db1b14c33d4d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:25.022080 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfcfeb-9cd8-48bd-a369-db1b14c33d4d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:25.022080 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfcfeb-9cd8-48bd-a369-db1b14c33d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:25.046345 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4fbfcfeb-9cd8-48bd-a369-db1b14c33d4d None None] MFA Rules not processed for user `32713a1249804e3290bbeeccb43011dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:16:25.047614 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4fbfcfeb-9cd8-48bd-a369-db1b14c33d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:16:25.056353 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1361/2751] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:16:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:16:27.885479 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc57708-d50b-4428-86b6-6f5ef2b16093 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:16:27.903278 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc57708-d50b-4428-86b6-6f5ef2b16093 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:16:27.912016 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7a55d-313a-4915-82bf-2be4d9450e59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:16:27.913089 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7a55d-313a-4915-82bf-2be4d9450e59 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:27.914234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7a55d-313a-4915-82bf-2be4d9450e59 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:27.914712 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7a55d-313a-4915-82bf-2be4d9450e59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:27.917533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-20c7a55d-313a-4915-82bf-2be4d9450e59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:16:27.941158 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7a55d-313a-4915-82bf-2be4d9450e59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:16:27.942772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c7a55d-313a-4915-82bf-2be4d9450e59 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:16:27.955374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1391/2752] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:16:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:16:34.121194 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfcfeb-9cd8-48bd-a369-db1b14c33d4d None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:16:34.131834 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfcfeb-9cd8-48bd-a369-db1b14c33d4d None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:16:34.135800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0e844-888e-4a62-8410-0028df79dc1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:16:34.136455 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0e844-888e-4a62-8410-0028df79dc1f service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:34.136737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0e844-888e-4a62-8410-0028df79dc1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:34.137015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0e844-888e-4a62-8410-0028df79dc1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:34.139339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-89f0e844-888e-4a62-8410-0028df79dc1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:16:34.149754 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0e844-888e-4a62-8410-0028df79dc1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:16:34.151249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0e844-888e-4a62-8410-0028df79dc1f service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:16:34.159950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1362/2753] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:16:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:16:37.950131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:16:39.150330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5449bac-a766-4f58-a071-75b1d7f32af0 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:39.150974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5449bac-a766-4f58-a071-75b1d7f32af0 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:39.150974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5449bac-a766-4f58-a071-75b1d7f32af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:39.170836 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-e5449bac-a766-4f58-a071-75b1d7f32af0 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:16:39.172105 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-e5449bac-a766-4f58-a071-75b1d7f32af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:16:39.181241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1392/2754] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 16:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:16:39.220851 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0e844-888e-4a62-8410-0028df79dc1f service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:16:39.235820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0e844-888e-4a62-8410-0028df79dc1f service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:16:39.242766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f904999-a93a-48cd-83a7-354a2f79d502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:16:39.243569 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f904999-a93a-48cd-83a7-354a2f79d502 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:39.243855 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f904999-a93a-48cd-83a7-354a2f79d502 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:39.244130 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f904999-a93a-48cd-83a7-354a2f79d502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:39.254100 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f904999-a93a-48cd-83a7-354a2f79d502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:16:39.255766 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f904999-a93a-48cd-83a7-354a2f79d502 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:16:39.266603 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1363/2755] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:16:43.477282 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51ae51-d073-494d-a632-ed20d54d8e6c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:43.477772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51ae51-d073-494d-a632-ed20d54d8e6c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:43.477772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51ae51-d073-494d-a632-ed20d54d8e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:43.497566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8a51ae51-d073-494d-a632-ed20d54d8e6c None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:16:43.498851 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8a51ae51-d073-494d-a632-ed20d54d8e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:16:43.508525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1393/2756] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 16:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:16:43.536684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f904999-a93a-48cd-83a7-354a2f79d502 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:16:43.548899 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f904999-a93a-48cd-83a7-354a2f79d502 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:16:43.555114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f246918-119a-4281-a61e-50365503e849 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:16:43.555764 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f246918-119a-4281-a61e-50365503e849 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:43.556056 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f246918-119a-4281-a61e-50365503e849 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:43.556333 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f246918-119a-4281-a61e-50365503e849 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:43.565156 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f246918-119a-4281-a61e-50365503e849 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:16:43.566749 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f246918-119a-4281-a61e-50365503e849 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:16:43.576814 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1364/2757] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:16:47.537087 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b875-4bfe-430a-9b5e-6b7f8547f28d None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:47.537721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b875-4bfe-430a-9b5e-6b7f8547f28d None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:47.537721 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b875-4bfe-430a-9b5e-6b7f8547f28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:47.557807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-5110b875-4bfe-430a-9b5e-6b7f8547f28d None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:16:47.559058 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5110b875-4bfe-430a-9b5e-6b7f8547f28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:16:47.568533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1394/2758] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 16:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:16:47.593627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f246918-119a-4281-a61e-50365503e849 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:16:47.600379 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=22 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:16:47.607355 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f246918-119a-4281-a61e-50365503e849 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:16:47.614233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813f4ac-af02-4055-bac2-0368b59afcf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:16:47.614921 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813f4ac-af02-4055-bac2-0368b59afcf9 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:47.615204 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813f4ac-af02-4055-bac2-0368b59afcf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:47.615482 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813f4ac-af02-4055-bac2-0368b59afcf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:47.625305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813f4ac-af02-4055-bac2-0368b59afcf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:16:47.626949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813f4ac-af02-4055-bac2-0368b59afcf9 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:16:47.636600 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1365/2759] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:16:51.790940 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68ceaa-47cc-4c2a-b652-556b236ca8a3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:51.791518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68ceaa-47cc-4c2a-b652-556b236ca8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:51.791518 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68ceaa-47cc-4c2a-b652-556b236ca8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:51.811173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-ff68ceaa-47cc-4c2a-b652-556b236ca8a3 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:16:51.812389 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-ff68ceaa-47cc-4c2a-b652-556b236ca8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:16:51.821880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1395/2760] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 16:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:16:51.854932 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813f4ac-af02-4055-bac2-0368b59afcf9 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:16:51.867343 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813f4ac-af02-4055-bac2-0368b59afcf9 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:16:51.874987 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf365d2-5c2b-4acb-8316-dc751f566d6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:16:51.875633 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf365d2-5c2b-4acb-8316-dc751f566d6e service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:51.875912 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf365d2-5c2b-4acb-8316-dc751f566d6e service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:51.876186 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf365d2-5c2b-4acb-8316-dc751f566d6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:51.885795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf365d2-5c2b-4acb-8316-dc751f566d6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:16:51.887448 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf365d2-5c2b-4acb-8316-dc751f566d6e service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:16:51.897928 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1366/2761] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:16:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:16:55.945486 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0430c9-9c76-49c7-85d2-8ac1d34d3a2a None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:55.946373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0430c9-9c76-49c7-85d2-8ac1d34d3a2a None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:55.946373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0430c9-9c76-49c7-85d2-8ac1d34d3a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:55.972466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-7e0430c9-9c76-49c7-85d2-8ac1d34d3a2a None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:16:55.973689 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-7e0430c9-9c76-49c7-85d2-8ac1d34d3a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:16:55.982911 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1396/2762] 10.222.0.45 () {58 vars in 1016 bytes} [Thu Jul 21 16:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:16:56.013765 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf365d2-5c2b-4acb-8316-dc751f566d6e service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:16:56.030749 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf365d2-5c2b-4acb-8316-dc751f566d6e service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:16:56.038015 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e03f8-42e9-44ab-b732-d57ef0d16fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:16:56.038590 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e03f8-42e9-44ab-b732-d57ef0d16fc0 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:16:56.038902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e03f8-42e9-44ab-b732-d57ef0d16fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:16:56.039166 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e03f8-42e9-44ab-b732-d57ef0d16fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:16:56.048396 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e03f8-42e9-44ab-b732-d57ef0d16fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:16:56.049993 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e03f8-42e9-44ab-b732-d57ef0d16fc0 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:16:56.060409 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1367/2763] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:17:05.967126 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=15 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:17:06.055642 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=17 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:17:11.143010 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0430c9-9c76-49c7-85d2-8ac1d34d3a2a None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:11.157654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0430c9-9c76-49c7-85d2-8ac1d34d3a2a None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:11.165177 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b40fe-4db3-400e-8c64-a5bc45d24346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:11.165858 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b40fe-4db3-400e-8c64-a5bc45d24346 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:11.166137 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b40fe-4db3-400e-8c64-a5bc45d24346 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:11.166414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b40fe-4db3-400e-8c64-a5bc45d24346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:11.168253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5e0b40fe-4db3-400e-8c64-a5bc45d24346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:17:11.182612 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b40fe-4db3-400e-8c64-a5bc45d24346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:11.184330 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0b40fe-4db3-400e-8c64-a5bc45d24346 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:11.196527 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1397/2764] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:17:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:17:21.191059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:17:32.562265 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e03f8-42e9-44ab-b732-d57ef0d16fc0 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:32.563908 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6f9e03f8-42e9-44ab-b732-d57ef0d16fc0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:17:32.620895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b40fe-4db3-400e-8c64-a5bc45d24346 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:32.632896 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0b40fe-4db3-400e-8c64-a5bc45d24346 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:32.637999 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf9825-445a-4490-9f75-9720461d331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:32.638946 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf9825-445a-4490-9f75-9720461d331d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:32.639235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf9825-445a-4490-9f75-9720461d331d admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:32.639519 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf9825-445a-4490-9f75-9720461d331d admin admin] PATH_INFO: `/v3/users/32713a1249804e3290bbeeccb43011dc` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:32.640774 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf9825-445a-4490-9f75-9720461d331d admin admin] RBAC: Authorizing `identity:delete_user(user_id=32713a1249804e3290bbeeccb43011dc)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:32.642725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf9825-445a-4490-9f75-9720461d331d admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:32.652256 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e03f8-42e9-44ab-b732-d57ef0d16fc0 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:32.658096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d525e-61ed-466f-a7b6-c2604bdaef84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:32.658863 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d525e-61ed-466f-a7b6-c2604bdaef84 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:32.659224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d525e-61ed-466f-a7b6-c2604bdaef84 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:32.659552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d525e-61ed-466f-a7b6-c2604bdaef84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:32.661383 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-291d525e-61ed-466f-a7b6-c2604bdaef84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:17:32.673673 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d525e-61ed-466f-a7b6-c2604bdaef84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:32.675357 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d525e-61ed-466f-a7b6-c2604bdaef84 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:32.685863 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1368/2765] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:17:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:17:32.691271 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0acf9825-445a-4490-9f75-9720461d331d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32713a1249804e3290bbeeccb43011dc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:17:32.704063 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0acf9825-445a-4490-9f75-9720461d331d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32713a1249804e3290bbeeccb43011dc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:17:32.712601 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0acf9825-445a-4490-9f75-9720461d331d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32713a1249804e3290bbeeccb43011dc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:17:32.713204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0acf9825-445a-4490-9f75-9720461d331d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32713a1249804e3290bbeeccb43011dc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:17:32.721177 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-0acf9825-445a-4490-9f75-9720461d331d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32713a1249804e3290bbeeccb43011dc'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:17:32.727431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1398/2766] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:17:32 2022] DELETE /identity/v3/users/32713a1249804e3290bbeeccb43011dc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:17:32.908714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d525e-61ed-466f-a7b6-c2604bdaef84 service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:32.920845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d525e-61ed-466f-a7b6-c2604bdaef84 service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:32.992251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a5868-fd84-4e5b-a83d-f7512109ba81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:32.993403 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a5868-fd84-4e5b-a83d-f7512109ba81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:32.993873 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a5868-fd84-4e5b-a83d-f7512109ba81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:32.994275 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a5868-fd84-4e5b-a83d-f7512109ba81 admin admin] PATH_INFO: `/v3/projects/026c1a182b44423ab41b012cd623096f` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:32.995781 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a5868-fd84-4e5b-a83d-f7512109ba81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=026c1a182b44423ab41b012cd623096f)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:32.997924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3a5868-fd84-4e5b-a83d-f7512109ba81 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:33.049853 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9f3a5868-fd84-4e5b-a83d-f7512109ba81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026c1a182b44423ab41b012cd623096f', 'request_id': 'req-9f3a5868-fd84-4e5b-a83d-f7512109ba81'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:17:33.056603 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9f3a5868-fd84-4e5b-a83d-f7512109ba81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026c1a182b44423ab41b012cd623096f', 'request_id': 'req-9f3a5868-fd84-4e5b-a83d-f7512109ba81'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:17:33.062976 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9f3a5868-fd84-4e5b-a83d-f7512109ba81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026c1a182b44423ab41b012cd623096f', 'request_id': 'req-9f3a5868-fd84-4e5b-a83d-f7512109ba81'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:17:33.076302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9f3a5868-fd84-4e5b-a83d-f7512109ba81 admin admin] The token cache is being invalidate because project 026c1a182b44423ab41b012cd623096f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:17:33.076719 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9f3a5868-fd84-4e5b-a83d-f7512109ba81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:17:33.077440 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-9f3a5868-fd84-4e5b-a83d-f7512109ba81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:17:33.079369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1369/2767] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:17:32 2022] DELETE /identity/v3/projects/026c1a182b44423ab41b012cd623096f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:17:33.085356 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da5c00-3614-4085-b56c-9a6b47861c24 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:33.085611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da5c00-3614-4085-b56c-9a6b47861c24 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:33.086018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da5c00-3614-4085-b56c-9a6b47861c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:33.106321 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-73da5c00-3614-4085-b56c-9a6b47861c24 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:17:33.107738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-73da5c00-3614-4085-b56c-9a6b47861c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:17:33.171169 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1399/2768] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:17:33.179772 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a476226-73e9-4440-a5f4-9725d760f0b5 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:33.180075 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a476226-73e9-4440-a5f4-9725d760f0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:33.180305 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a476226-73e9-4440-a5f4-9725d760f0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:33.201230 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-5a476226-73e9-4440-a5f4-9725d760f0b5 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:17:33.202507 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5a476226-73e9-4440-a5f4-9725d760f0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:17:33.211923 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1370/2769] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:17:33.216568 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da5c00-3614-4085-b56c-9a6b47861c24 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:33.226678 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da5c00-3614-4085-b56c-9a6b47861c24 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:33.231980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875e6bf-1b97-4bd0-adb1-cde4bca27596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:33.232665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875e6bf-1b97-4bd0-adb1-cde4bca27596 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:33.232945 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875e6bf-1b97-4bd0-adb1-cde4bca27596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:33.233220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9875e6bf-1b97-4bd0-adb1-cde4bca27596 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:33.233958 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875e6bf-1b97-4bd0-adb1-cde4bca27596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:17:33.234270 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875e6bf-1b97-4bd0-adb1-cde4bca27596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:33.235933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9875e6bf-1b97-4bd0-adb1-cde4bca27596 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:33.248533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1400/2770] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:17:33.253103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a476226-73e9-4440-a5f4-9725d760f0b5 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:33.263102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a476226-73e9-4440-a5f4-9725d760f0b5 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:33.268026 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874de48-0278-4885-8bf2-76d63ac329a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:33.268685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874de48-0278-4885-8bf2-76d63ac329a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:33.268963 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874de48-0278-4885-8bf2-76d63ac329a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:33.269236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874de48-0278-4885-8bf2-76d63ac329a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:33.269921 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874de48-0278-4885-8bf2-76d63ac329a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:33.271879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874de48-0278-4885-8bf2-76d63ac329a1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:33.282266 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:17:33.310625 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1371/2771] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:17:33 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:17:33.315034 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875e6bf-1b97-4bd0-adb1-cde4bca27596 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:33.326801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9875e6bf-1b97-4bd0-adb1-cde4bca27596 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:33.383572 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0ec20-07b2-4da5-a7aa-4b885a9319f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:33.384253 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0ec20-07b2-4da5-a7aa-4b885a9319f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:33.384544 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0ec20-07b2-4da5-a7aa-4b885a9319f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:33.384833 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0ec20-07b2-4da5-a7aa-4b885a9319f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:33.385538 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0ec20-07b2-4da5-a7aa-4b885a9319f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:33.387496 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0ec20-07b2-4da5-a7aa-4b885a9319f6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:33.394251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:17:33.411373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1401/2772] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:17:33 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:17:33.415939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874de48-0278-4885-8bf2-76d63ac329a1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:33.427206 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874de48-0278-4885-8bf2-76d63ac329a1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:33.433096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd99fe-d9ce-41c5-be9d-4912fce2bb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:33.433792 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd99fe-d9ce-41c5-be9d-4912fce2bb81 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:33.434096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd99fe-d9ce-41c5-be9d-4912fce2bb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:33.434366 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd99fe-d9ce-41c5-be9d-4912fce2bb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:33.435274 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd99fe-d9ce-41c5-be9d-4912fce2bb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:33.436896 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd99fe-d9ce-41c5-be9d-4912fce2bb81 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:33.447613 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1372/2773] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:17:33.451785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0ec20-07b2-4da5-a7aa-4b885a9319f6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:33.462552 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0ec20-07b2-4da5-a7aa-4b885a9319f6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:33.468222 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c0b5d8-781a-40b4-b9ec-12a52ec2c781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:33.468898 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0b5d8-781a-40b4-b9ec-12a52ec2c781 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:33.469179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0b5d8-781a-40b4-b9ec-12a52ec2c781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:33.469460 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c0b5d8-781a-40b4-b9ec-12a52ec2c781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:33.470235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0b5d8-781a-40b4-b9ec-12a52ec2c781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:33.471891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c0b5d8-781a-40b4-b9ec-12a52ec2c781 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:33.482609 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1402/2774] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:17:33.487055 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd99fe-d9ce-41c5-be9d-4912fce2bb81 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:33.498660 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd99fe-d9ce-41c5-be9d-4912fce2bb81 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:33.503786 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fce315-24ce-4ab1-97fa-589635d65bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:33.504714 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fce315-24ce-4ab1-97fa-589635d65bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:33.505220 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fce315-24ce-4ab1-97fa-589635d65bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:33.505463 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fce315-24ce-4ab1-97fa-589635d65bf6 admin admin] PATH_INFO: `/v3/projects/bd614b1e286d40438bb52608aca6a408/users/2c9a75b70d6e40168a8716b2b9cd2da9/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:33.521381 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fce315-24ce-4ab1-97fa-589635d65bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd614b1e286d40438bb52608aca6a408, user_id=2c9a75b70d6e40168a8716b2b9cd2da9, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:33.524091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fce315-24ce-4ab1-97fa-589635d65bf6 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:33.537756 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1373/2775] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:17:33 2022] PUT /identity/v3/projects/bd614b1e286d40438bb52608aca6a408/users/2c9a75b70d6e40168a8716b2b9cd2da9/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:17:33.542988 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56e815-65ce-4f06-8965-e1b074e6f57f None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:33.543286 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56e815-65ce-4f06-8965-e1b074e6f57f None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:33.543569 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b56e815-65ce-4f06-8965-e1b074e6f57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:33.562234 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-0b56e815-65ce-4f06-8965-e1b074e6f57f None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:17:33.563504 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-0b56e815-65ce-4f06-8965-e1b074e6f57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:17:33.626888 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1403/2776] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:17:33.637097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fce315-24ce-4ab1-97fa-589635d65bf6 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:33.639139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f4fce315-24ce-4ab1-97fa-589635d65bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:17:33.707903 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fce315-24ce-4ab1-97fa-589635d65bf6 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:33.712858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68066ff2-21b5-4f2e-b574-f88365e25f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:33.713492 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68066ff2-21b5-4f2e-b574-f88365e25f72 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:33.713771 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68066ff2-21b5-4f2e-b574-f88365e25f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:33.714043 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68066ff2-21b5-4f2e-b574-f88365e25f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:33.724616 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68066ff2-21b5-4f2e-b574-f88365e25f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:33.726454 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68066ff2-21b5-4f2e-b574-f88365e25f72 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:33.738444 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1374/2777] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:17:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:17:38.331792 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2070c98-bb60-4ead-a0a0-e76ce9fbfad4 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:38.332898 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2070c98-bb60-4ead-a0a0-e76ce9fbfad4 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:38.333209 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2070c98-bb60-4ead-a0a0-e76ce9fbfad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:38.363784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-b2070c98-bb60-4ead-a0a0-e76ce9fbfad4 None None] MFA Rules not processed for user `2c9a75b70d6e40168a8716b2b9cd2da9`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:17:38.365018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-b2070c98-bb60-4ead-a0a0-e76ce9fbfad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:17:38.443266 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1404/2778] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:17:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:17:38.448001 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68066ff2-21b5-4f2e-b574-f88365e25f72 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:38.458122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68066ff2-21b5-4f2e-b574-f88365e25f72 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:38.463122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99977f-87e7-4753-98aa-8bb289a553c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:38.463787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99977f-87e7-4753-98aa-8bb289a553c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:38.464061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99977f-87e7-4753-98aa-8bb289a553c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:38.464336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99977f-87e7-4753-98aa-8bb289a553c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:38.465037 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99977f-87e7-4753-98aa-8bb289a553c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:38.466975 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99977f-87e7-4753-98aa-8bb289a553c1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:38.497977 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1375/2779] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:17:38 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:17:38.500138 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2070c98-bb60-4ead-a0a0-e76ce9fbfad4 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:38.511584 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2070c98-bb60-4ead-a0a0-e76ce9fbfad4 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:38.572922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb096398-cb44-433b-9337-44ff74246920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:38.573624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb096398-cb44-433b-9337-44ff74246920 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:38.573927 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb096398-cb44-433b-9337-44ff74246920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:38.574206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb096398-cb44-433b-9337-44ff74246920 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:38.575050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb096398-cb44-433b-9337-44ff74246920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:38.576987 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb096398-cb44-433b-9337-44ff74246920 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:38.592928 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:17:38.600984 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1405/2780] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:17:38 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:17:38.605035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99977f-87e7-4753-98aa-8bb289a553c1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:38.616245 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99977f-87e7-4753-98aa-8bb289a553c1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:38.621278 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b711c-d649-4f4c-866a-14bcd98013ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:38.621982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b711c-d649-4f4c-866a-14bcd98013ca admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:38.622268 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b711c-d649-4f4c-866a-14bcd98013ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:38.622541 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b711c-d649-4f4c-866a-14bcd98013ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:38.623335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b711c-d649-4f4c-866a-14bcd98013ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:38.625072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6b711c-d649-4f4c-866a-14bcd98013ca admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:38.637471 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1376/2781] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:17:38.641179 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb096398-cb44-433b-9337-44ff74246920 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:38.652349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb096398-cb44-433b-9337-44ff74246920 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:38.658416 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa37d3b-29a8-4195-b27f-78b0eaf9c086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:38.659366 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa37d3b-29a8-4195-b27f-78b0eaf9c086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:38.659650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa37d3b-29a8-4195-b27f-78b0eaf9c086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:38.659898 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa37d3b-29a8-4195-b27f-78b0eaf9c086 admin admin] PATH_INFO: `/v3/projects/ee6c2dc67e8b4cac8f48c95264bc74a6/users/b05cb6011fdb41209ebc97bd598fd50e/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:38.677241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa37d3b-29a8-4195-b27f-78b0eaf9c086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6c2dc67e8b4cac8f48c95264bc74a6, user_id=b05cb6011fdb41209ebc97bd598fd50e, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:38.679960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa37d3b-29a8-4195-b27f-78b0eaf9c086 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:38.695444 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1406/2782] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:17:38 2022] PUT /identity/v3/projects/ee6c2dc67e8b4cac8f48c95264bc74a6/users/b05cb6011fdb41209ebc97bd598fd50e/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:17:38.699820 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b711c-d649-4f4c-866a-14bcd98013ca admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:38.711182 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b711c-d649-4f4c-866a-14bcd98013ca admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:38.774486 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654ff9f-5937-44a6-b461-937ade05d070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:38.775265 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654ff9f-5937-44a6-b461-937ade05d070 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:38.775551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654ff9f-5937-44a6-b461-937ade05d070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:38.775826 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654ff9f-5937-44a6-b461-937ade05d070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:38.776801 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654ff9f-5937-44a6-b461-937ade05d070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:38.778544 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7654ff9f-5937-44a6-b461-937ade05d070 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:38.790124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1377/2783] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:17:38.794690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa37d3b-29a8-4195-b27f-78b0eaf9c086 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:38.806048 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa37d3b-29a8-4195-b27f-78b0eaf9c086 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:38.812019 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8724c0-dd11-4359-b6f3-293078cb1a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:38.813740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8724c0-dd11-4359-b6f3-293078cb1a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:38.813740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8724c0-dd11-4359-b6f3-293078cb1a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:38.813740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8724c0-dd11-4359-b6f3-293078cb1a0c admin admin] PATH_INFO: `/v3/projects/ee6c2dc67e8b4cac8f48c95264bc74a6/users/b05cb6011fdb41209ebc97bd598fd50e/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:38.813740 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8724c0-dd11-4359-b6f3-293078cb1a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6c2dc67e8b4cac8f48c95264bc74a6, user_id=b05cb6011fdb41209ebc97bd598fd50e, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:38.818235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8724c0-dd11-4359-b6f3-293078cb1a0c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:38.830980 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1407/2784] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:17:38 2022] PUT /identity/v3/projects/ee6c2dc67e8b4cac8f48c95264bc74a6/users/b05cb6011fdb41209ebc97bd598fd50e/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:17:43.296893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d0e04-2b78-4228-a8cf-e8214f887069 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:43.297416 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d0e04-2b78-4228-a8cf-e8214f887069 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:43.297514 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d0e04-2b78-4228-a8cf-e8214f887069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:43.332595 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:17:43.336120 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-3b8d0e04-2b78-4228-a8cf-e8214f887069 None None] MFA Rules not processed for user `b05cb6011fdb41209ebc97bd598fd50e`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:17:43.338616 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3b8d0e04-2b78-4228-a8cf-e8214f887069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:17:43.422361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1378/2785] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:17:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:17:43.440162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8724c0-dd11-4359-b6f3-293078cb1a0c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:43.441993 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5d8724c0-dd11-4359-b6f3-293078cb1a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:17:43.561954 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8724c0-dd11-4359-b6f3-293078cb1a0c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:43.568381 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b76ddb-3242-482a-81f6-993d6d4bc8e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:43.569360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b76ddb-3242-482a-81f6-993d6d4bc8e5 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:43.569870 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b76ddb-3242-482a-81f6-993d6d4bc8e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:43.570342 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b76ddb-3242-482a-81f6-993d6d4bc8e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:43.646029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b76ddb-3242-482a-81f6-993d6d4bc8e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:43.649090 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b76ddb-3242-482a-81f6-993d6d4bc8e5 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:43.663986 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1408/2786] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:17:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:17:44.701124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211961d2-7c72-4818-b2a7-45223591ab69 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:44.701578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211961d2-7c72-4818-b2a7-45223591ab69 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:44.701578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211961d2-7c72-4818-b2a7-45223591ab69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:44.720792 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-211961d2-7c72-4818-b2a7-45223591ab69 None None] MFA Rules not processed for user `2c9a75b70d6e40168a8716b2b9cd2da9`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:17:44.722040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-211961d2-7c72-4818-b2a7-45223591ab69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:17:44.730318 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1379/2787] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:17:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:17:50.545547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b76ddb-3242-482a-81f6-993d6d4bc8e5 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:17:50.547258 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f9b76ddb-3242-482a-81f6-993d6d4bc8e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:17:50.562810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b76ddb-3242-482a-81f6-993d6d4bc8e5 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:17:50.569324 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b45a60-5be0-491f-be01-fffb195f97e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:17:50.570000 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b45a60-5be0-491f-be01-fffb195f97e4 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:17:50.570287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b45a60-5be0-491f-be01-fffb195f97e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:17:50.570565 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b45a60-5be0-491f-be01-fffb195f97e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:17:50.572534 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a1b45a60-5be0-491f-be01-fffb195f97e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:17:50.639487 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:17:50.642649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b45a60-5be0-491f-be01-fffb195f97e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:17:50.644693 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b45a60-5be0-491f-be01-fffb195f97e4 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:17:50.656408 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1409/2788] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:17:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:17:54.716505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=31 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:18:00.657023 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:18:05.626863 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211961d2-7c72-4818-b2a7-45223591ab69 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:18:05.628415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-211961d2-7c72-4818-b2a7-45223591ab69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:18:05.696209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211961d2-7c72-4818-b2a7-45223591ab69 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:18:05.700623 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03ad60-1efc-4371-b4dd-7b797ffaed9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:18:05.701417 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03ad60-1efc-4371-b4dd-7b797ffaed9b service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:05.701932 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03ad60-1efc-4371-b4dd-7b797ffaed9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:05.702292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03ad60-1efc-4371-b4dd-7b797ffaed9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:05.704541 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-7c03ad60-1efc-4371-b4dd-7b797ffaed9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:18:05.716941 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03ad60-1efc-4371-b4dd-7b797ffaed9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:18:05.718657 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c03ad60-1efc-4371-b4dd-7b797ffaed9b service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:18:05.728499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1380/2789] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:18:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:18:06.487887 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b45a60-5be0-491f-be01-fffb195f97e4 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:18:06.489844 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a1b45a60-5be0-491f-be01-fffb195f97e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:18:06.602446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b45a60-5be0-491f-be01-fffb195f97e4 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:18:06.611615 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2ed5a-6d34-45ec-8003-5bc25c4bd380 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:18:06.612699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2ed5a-6d34-45ec-8003-5bc25c4bd380 service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:06.613203 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2ed5a-6d34-45ec-8003-5bc25c4bd380 service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:06.613690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2ed5a-6d34-45ec-8003-5bc25c4bd380 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:06.616702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3ee2ed5a-6d34-45ec-8003-5bc25c4bd380 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:18:06.637173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2ed5a-6d34-45ec-8003-5bc25c4bd380 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:18:06.639567 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2ed5a-6d34-45ec-8003-5bc25c4bd380 service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:18:06.655926 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1410/2790] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:18:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:18:14.552905 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03ad60-1efc-4371-b4dd-7b797ffaed9b service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:18:14.574109 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03ad60-1efc-4371-b4dd-7b797ffaed9b service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:18:14.583990 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d89331-6f3a-47a3-bb0c-a68f8dd65f69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:18:14.584945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d89331-6f3a-47a3-bb0c-a68f8dd65f69 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:14.585392 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d89331-6f3a-47a3-bb0c-a68f8dd65f69 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:14.585787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d89331-6f3a-47a3-bb0c-a68f8dd65f69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:14.589583 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-35d89331-6f3a-47a3-bb0c-a68f8dd65f69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:18:14.608370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d89331-6f3a-47a3-bb0c-a68f8dd65f69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:18:14.611742 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d89331-6f3a-47a3-bb0c-a68f8dd65f69 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:18:14.631339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1381/2791] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:18:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:18:16.650457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=32 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:18:17.388490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694c4d7-611d-41ac-b5a6-c02ade89ae30 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:17.389126 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694c4d7-611d-41ac-b5a6-c02ade89ae30 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:17.389533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694c4d7-611d-41ac-b5a6-c02ade89ae30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:17.450399 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f694c4d7-611d-41ac-b5a6-c02ade89ae30 None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:18:17.452106 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f694c4d7-611d-41ac-b5a6-c02ade89ae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:18:17.541845 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1411/2792] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 16:18:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:18:17.599081 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d89331-6f3a-47a3-bb0c-a68f8dd65f69 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:18:17.601068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-35d89331-6f3a-47a3-bb0c-a68f8dd65f69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:18:17.717919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d89331-6f3a-47a3-bb0c-a68f8dd65f69 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:18:17.727185 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf69c4d-afe5-4bfd-864a-c12519e04216 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:18:17.727959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf69c4d-afe5-4bfd-864a-c12519e04216 service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:17.728337 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf69c4d-afe5-4bfd-864a-c12519e04216 service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:17.728841 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf69c4d-afe5-4bfd-864a-c12519e04216 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:17.742031 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf69c4d-afe5-4bfd-864a-c12519e04216 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:18:17.744839 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf69c4d-afe5-4bfd-864a-c12519e04216 service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:18:17.757361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1382/2793] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:18:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 16:18:20.291784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694c4d7-611d-41ac-b5a6-c02ade89ae30 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:18:20.314558 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694c4d7-611d-41ac-b5a6-c02ade89ae30 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:18:20.321317 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57677aa2-4bad-4b33-a17f-1b889bb18a0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:18:20.322550 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57677aa2-4bad-4b33-a17f-1b889bb18a0a service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:20.323338 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57677aa2-4bad-4b33-a17f-1b889bb18a0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:20.323616 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57677aa2-4bad-4b33-a17f-1b889bb18a0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:20.339001 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57677aa2-4bad-4b33-a17f-1b889bb18a0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:18:20.342238 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57677aa2-4bad-4b33-a17f-1b889bb18a0a service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:18:20.365190 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1412/2794] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:18:20 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:18:27.752321 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=73 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:18:30.353581 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=46 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:18:35.867008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975a2ac-1e89-43b4-8bff-49f72f3e26f0 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:35.867858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975a2ac-1e89-43b4-8bff-49f72f3e26f0 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:35.868068 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975a2ac-1e89-43b4-8bff-49f72f3e26f0 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:35.869844 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1383/2795] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 16:18:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:18:35.877009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a92998-cc9a-4250-a54c-8da0ec3305e3 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:35.877627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a92998-cc9a-4250-a54c-8da0ec3305e3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:35.877627 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a92998-cc9a-4250-a54c-8da0ec3305e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:35.928731 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-13a92998-cc9a-4250-a54c-8da0ec3305e3 None None] MFA Rules not processed for user `e9a1ec1f6bb7467dbd63ad1da36d48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:18:35.931120 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-13a92998-cc9a-4250-a54c-8da0ec3305e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:18:35.961106 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1413/2796] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 16:18:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:18:35.988867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975a2ac-1e89-43b4-8bff-49f72f3e26f0 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:18:35.990751 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-f975a2ac-1e89-43b4-8bff-49f72f3e26f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:18:36.127382 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975a2ac-1e89-43b4-8bff-49f72f3e26f0 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:18:36.131310 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64379e4-e176-41ce-a933-d5471c32b416 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3418c0b46c404c8ca445cce9db632d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:18:36.132014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64379e4-e176-41ce-a933-d5471c32b416 service glance] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:36.132288 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64379e4-e176-41ce-a933-d5471c32b416 service glance] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:36.132561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64379e4-e176-41ce-a933-d5471c32b416 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:36.144565 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64379e4-e176-41ce-a933-d5471c32b416 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:18:36.146058 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64379e4-e176-41ce-a933-d5471c32b416 service glance] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:18:36.159009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1384/2797] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:18:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:18:36.238129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88613c07-7376-474b-bf3b-80ae79a783a3 None None] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:36.238492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88613c07-7376-474b-bf3b-80ae79a783a3 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:36.238753 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88613c07-7376-474b-bf3b-80ae79a783a3 None None] PATH_INFO: `/` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:36.240166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1414/2798] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 16:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:18:36.245967 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad272d16-590c-4181-9e6c-30b6099d9ccd None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:36.246253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad272d16-590c-4181-9e6c-30b6099d9ccd None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:36.246519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad272d16-590c-4181-9e6c-30b6099d9ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:36.305143 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ad272d16-590c-4181-9e6c-30b6099d9ccd None None] MFA Rules not processed for user `1b46a82ffe92437fb8205bd186a8b05e`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:18:36.306690 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ad272d16-590c-4181-9e6c-30b6099d9ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:18:36.314685 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1385/2799] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 16:18:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:18:36.329699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88613c07-7376-474b-bf3b-80ae79a783a3 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:18:36.342613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88613c07-7376-474b-bf3b-80ae79a783a3 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:18:36.346427 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c94ca-59e4-40e8-9536-7f06e7a2e0e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:18:36.347162 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c94ca-59e4-40e8-9536-7f06e7a2e0e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:36.347463 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c94ca-59e4-40e8-9536-7f06e7a2e0e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:36.347742 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c94ca-59e4-40e8-9536-7f06e7a2e0e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:36.359593 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c94ca-59e4-40e8-9536-7f06e7a2e0e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:18:36.362490 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c94ca-59e4-40e8-9536-7f06e7a2e0e9 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:18:36.378379 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1415/2800] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:18:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:18:36.556342 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35583c52-fc4a-485d-a0d1-2615ad83eee6 None None] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:36.556981 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35583c52-fc4a-485d-a0d1-2615ad83eee6 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:36.557473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35583c52-fc4a-485d-a0d1-2615ad83eee6 None None] PATH_INFO: `/` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:36.560589 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1386/2801] 10.222.0.64 () {54 vars in 921 bytes} [Thu Jul 21 16:18:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 16:18:36.570141 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c07426-c857-456f-b36f-636144e69c83 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:36.570664 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c07426-c857-456f-b36f-636144e69c83 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:36.571257 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c07426-c857-456f-b36f-636144e69c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:36.604133 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-f8c07426-c857-456f-b36f-636144e69c83 None None] MFA Rules not processed for user `e9a1ec1f6bb7467dbd63ad1da36d48a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:18:36.606344 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f8c07426-c857-456f-b36f-636144e69c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:18:36.623758 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1416/2802] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Jul 21 16:18:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:18:36.642124 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35583c52-fc4a-485d-a0d1-2615ad83eee6 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:18:36.655459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35583c52-fc4a-485d-a0d1-2615ad83eee6 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:18:36.660673 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eeb37-3bd8-4ab1-8527-3b33d8407ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:18:36.661556 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eeb37-3bd8-4ab1-8527-3b33d8407ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:36.661937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eeb37-3bd8-4ab1-8527-3b33d8407ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:36.662364 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0eeb37-3bd8-4ab1-8527-3b33d8407ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:36.677986 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0eeb37-3bd8-4ab1-8527-3b33d8407ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:18:36.680106 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0eeb37-3bd8-4ab1-8527-3b33d8407ab4 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:18:36.700643 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1387/2803] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:18:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:18:39.020360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a6fe5-85f0-462c-a287-3edcda3b72f5 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:39.021263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a6fe5-85f0-462c-a287-3edcda3b72f5 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:39.021263 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a6fe5-85f0-462c-a287-3edcda3b72f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:39.042500 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-c21a6fe5-85f0-462c-a287-3edcda3b72f5 None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:18:39.044349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c21a6fe5-85f0-462c-a287-3edcda3b72f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:18:39.052940 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1417/2804] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Jul 21 16:18:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:18:39.066439 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eeb37-3bd8-4ab1-8527-3b33d8407ab4 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:18:39.079342 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0eeb37-3bd8-4ab1-8527-3b33d8407ab4 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:18:39.084824 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40980a6f-b6ae-4880-928c-60df69fcf9fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:18:39.085501 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40980a6f-b6ae-4880-928c-60df69fcf9fc service swift] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:39.085784 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40980a6f-b6ae-4880-928c-60df69fcf9fc service swift] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:39.086060 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40980a6f-b6ae-4880-928c-60df69fcf9fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:39.096078 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40980a6f-b6ae-4880-928c-60df69fcf9fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:18:39.097746 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40980a6f-b6ae-4880-928c-60df69fcf9fc service swift] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:18:39.108091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1388/2805] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:18:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 16:18:49.036323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=21 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:18:49.104014 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=56 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:18:54.154724 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a6fe5-85f0-462c-a287-3edcda3b72f5 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:18:54.156533 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c21a6fe5-85f0-462c-a287-3edcda3b72f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:18:54.174080 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a6fe5-85f0-462c-a287-3edcda3b72f5 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:18:54.180720 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef5795-37d1-4c24-8f4b-0179a5c13fdc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:18:54.181502 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef5795-37d1-4c24-8f4b-0179a5c13fdc service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:54.181788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef5795-37d1-4c24-8f4b-0179a5c13fdc service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:54.182065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef5795-37d1-4c24-8f4b-0179a5c13fdc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:54.184235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-16ef5795-37d1-4c24-8f4b-0179a5c13fdc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:18:54.198404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef5795-37d1-4c24-8f4b-0179a5c13fdc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:18:54.199528 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef5795-37d1-4c24-8f4b-0179a5c13fdc service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:18:54.211092 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1418/2806] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:18:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:18:58.945979 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d28898-b8b6-4509-8b04-44ef061a9354 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:58.946588 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d28898-b8b6-4509-8b04-44ef061a9354 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:58.946938 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d28898-b8b6-4509-8b04-44ef061a9354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:58.979367 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-42d28898-b8b6-4509-8b04-44ef061a9354 None None] MFA Rules not processed for user `8d1d0d0f2d544d41a86f1e0dda8d110c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:18:58.981598 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-42d28898-b8b6-4509-8b04-44ef061a9354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:18:58.994332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1389/2807] 10.222.0.64 () {58 vars in 967 bytes} [Thu Jul 21 16:18:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:18:59.009884 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef5795-37d1-4c24-8f4b-0179a5c13fdc service placement] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:18:59.027690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef5795-37d1-4c24-8f4b-0179a5c13fdc service placement] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:18:59.034108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e983c5-5dfc-4fc9-9eb5-23adf0f327fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dcee349bdb2640609cc71fb1c65794f1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:18:59.034806 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e983c5-5dfc-4fc9-9eb5-23adf0f327fb service swift] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:18:59.035191 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e983c5-5dfc-4fc9-9eb5-23adf0f327fb service swift] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:18:59.035471 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e983c5-5dfc-4fc9-9eb5-23adf0f327fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:18:59.046069 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e983c5-5dfc-4fc9-9eb5-23adf0f327fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:18:59.048088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e983c5-5dfc-4fc9-9eb5-23adf0f327fb service swift] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:18:59.058358 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1419/2808] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Jul 21 16:18:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 16:19:08.971114 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:19:09.053904 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=12 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:20:04.075438 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d28898-b8b6-4509-8b04-44ef061a9354 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:20:04.087651 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d28898-b8b6-4509-8b04-44ef061a9354 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:20:04.092320 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569794a-a450-46f4-b872-53cc93822039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:20:04.093082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569794a-a450-46f4-b872-53cc93822039 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:04.093476 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569794a-a450-46f4-b872-53cc93822039 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:04.093854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569794a-a450-46f4-b872-53cc93822039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:04.096098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1569794a-a450-46f4-b872-53cc93822039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:20:04.170112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569794a-a450-46f4-b872-53cc93822039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:20:04.171931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569794a-a450-46f4-b872-53cc93822039 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:20:04.184659 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1390/2809] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:20:08.229899 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e983c5-5dfc-4fc9-9eb5-23adf0f327fb service swift] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:20:08.245483 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e983c5-5dfc-4fc9-9eb5-23adf0f327fb service swift] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:20:08.251539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733d1eb-4bf5-4c60-be73-dbb027f1de74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:20:08.252339 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733d1eb-4bf5-4c60-be73-dbb027f1de74 service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:08.252752 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733d1eb-4bf5-4c60-be73-dbb027f1de74 service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:08.253139 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733d1eb-4bf5-4c60-be73-dbb027f1de74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:08.255575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a733d1eb-4bf5-4c60-be73-dbb027f1de74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:20:08.271713 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733d1eb-4bf5-4c60-be73-dbb027f1de74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:20:08.273479 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733d1eb-4bf5-4c60-be73-dbb027f1de74 service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:20:08.287717 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1420/2810] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:20:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:20:08.305561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569794a-a450-46f4-b872-53cc93822039 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:20:08.308293 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1569794a-a450-46f4-b872-53cc93822039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:20:08.326215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569794a-a450-46f4-b872-53cc93822039 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:20:08.333440 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a638d0-cf73-40e8-b283-08ad14d8afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:20:08.334622 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a638d0-cf73-40e8-b283-08ad14d8afa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:08.335159 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a638d0-cf73-40e8-b283-08ad14d8afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:08.335525 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a638d0-cf73-40e8-b283-08ad14d8afa1 admin admin] PATH_INFO: `/v3/users/dd0f22fa4ee8472f89eb3de52d066cfd` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:08.337061 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a638d0-cf73-40e8-b283-08ad14d8afa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd0f22fa4ee8472f89eb3de52d066cfd)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:20:08.339482 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a638d0-cf73-40e8-b283-08ad14d8afa1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:20:08.405240 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-38a638d0-cf73-40e8-b283-08ad14d8afa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd0f22fa4ee8472f89eb3de52d066cfd'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:20:08.414180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-38a638d0-cf73-40e8-b283-08ad14d8afa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd0f22fa4ee8472f89eb3de52d066cfd'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:20:08.423570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-38a638d0-cf73-40e8-b283-08ad14d8afa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd0f22fa4ee8472f89eb3de52d066cfd'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:20:08.424232 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-38a638d0-cf73-40e8-b283-08ad14d8afa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd0f22fa4ee8472f89eb3de52d066cfd'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:20:08.424858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-38a638d0-cf73-40e8-b283-08ad14d8afa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd0f22fa4ee8472f89eb3de52d066cfd'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:20:08.446371 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1391/2811] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:20:08 2022] DELETE /identity/v3/users/dd0f22fa4ee8472f89eb3de52d066cfd => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:20:08.655384 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733d1eb-4bf5-4c60-be73-dbb027f1de74 service placement] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:20:08.674055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733d1eb-4bf5-4c60-be73-dbb027f1de74 service placement] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:20:08.751831 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b5f54-ca49-4282-ba26-bf16706ce700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:20:08.752902 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b5f54-ca49-4282-ba26-bf16706ce700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:08.753297 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b5f54-ca49-4282-ba26-bf16706ce700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:08.753680 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b5f54-ca49-4282-ba26-bf16706ce700 admin admin] PATH_INFO: `/v3/projects/09f00bf2b35846eb8d91a5464d348d0c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:08.757186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b5f54-ca49-4282-ba26-bf16706ce700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f00bf2b35846eb8d91a5464d348d0c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:20:08.758602 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b5f54-ca49-4282-ba26-bf16706ce700 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:20:08.816660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e45b5f54-ca49-4282-ba26-bf16706ce700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f00bf2b35846eb8d91a5464d348d0c', 'request_id': 'req-e45b5f54-ca49-4282-ba26-bf16706ce700'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:20:08.826300 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e45b5f54-ca49-4282-ba26-bf16706ce700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f00bf2b35846eb8d91a5464d348d0c', 'request_id': 'req-e45b5f54-ca49-4282-ba26-bf16706ce700'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:20:08.834928 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e45b5f54-ca49-4282-ba26-bf16706ce700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f00bf2b35846eb8d91a5464d348d0c', 'request_id': 'req-e45b5f54-ca49-4282-ba26-bf16706ce700'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:20:08.848998 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e45b5f54-ca49-4282-ba26-bf16706ce700 admin admin] The token cache is being invalidate because project 09f00bf2b35846eb8d91a5464d348d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:20:08.849295 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e45b5f54-ca49-4282-ba26-bf16706ce700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:20:08.849891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-e45b5f54-ca49-4282-ba26-bf16706ce700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:20:08.851671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1421/2812] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:20:08 2022] DELETE /identity/v3/projects/09f00bf2b35846eb8d91a5464d348d0c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:20:08.861542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f469ce-89c6-4b89-a6af-9c868c7d3687 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:08.862009 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f469ce-89c6-4b89-a6af-9c868c7d3687 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:08.862495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f469ce-89c6-4b89-a6af-9c868c7d3687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:08.892206 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-04f469ce-89c6-4b89-a6af-9c868c7d3687 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:20:08.893629 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-04f469ce-89c6-4b89-a6af-9c868c7d3687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:20:08.972302 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1392/2813] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:20:08.980482 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7c1df-21f2-47ec-8653-9519f68c8434 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:08.980929 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7c1df-21f2-47ec-8653-9519f68c8434 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:08.981307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7c1df-21f2-47ec-8653-9519f68c8434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:09.003065 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-70a7c1df-21f2-47ec-8653-9519f68c8434 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:20:09.004547 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-70a7c1df-21f2-47ec-8653-9519f68c8434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:20:09.013450 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1422/2814] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:20:09.018622 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f469ce-89c6-4b89-a6af-9c868c7d3687 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:20:09.030334 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f469ce-89c6-4b89-a6af-9c868c7d3687 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:20:09.035855 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1d832-650b-400f-95b9-4ec58105f758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:20:09.036654 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d832-650b-400f-95b9-4ec58105f758 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:09.037034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d832-650b-400f-95b9-4ec58105f758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:09.037456 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1d832-650b-400f-95b9-4ec58105f758 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:09.038189 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1d832-650b-400f-95b9-4ec58105f758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:20:09.038567 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1d832-650b-400f-95b9-4ec58105f758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:20:09.040632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1d832-650b-400f-95b9-4ec58105f758 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:20:09.042787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:20:09.058682 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1393/2815] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:20:09.064655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7c1df-21f2-47ec-8653-9519f68c8434 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:20:09.076595 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7c1df-21f2-47ec-8653-9519f68c8434 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:20:09.083071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603daa69-8492-49a9-944b-ecdb2b3844dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:20:09.083807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603daa69-8492-49a9-944b-ecdb2b3844dc admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:09.084093 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603daa69-8492-49a9-944b-ecdb2b3844dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:09.084373 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603daa69-8492-49a9-944b-ecdb2b3844dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:09.085115 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603daa69-8492-49a9-944b-ecdb2b3844dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:20:09.087132 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603daa69-8492-49a9-944b-ecdb2b3844dc admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:20:09.120292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1423/2816] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:20:09 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:20:09.125397 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1d832-650b-400f-95b9-4ec58105f758 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:20:09.137786 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1d832-650b-400f-95b9-4ec58105f758 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:20:09.213257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b5d23-f510-4cd9-b723-f7596c07ec5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:20:09.214177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b5d23-f510-4cd9-b723-f7596c07ec5d admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:09.214497 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b5d23-f510-4cd9-b723-f7596c07ec5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:09.214831 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b5d23-f510-4cd9-b723-f7596c07ec5d admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:09.215814 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b5d23-f510-4cd9-b723-f7596c07ec5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:20:09.218188 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b5d23-f510-4cd9-b723-f7596c07ec5d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:20:09.242706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1394/2817] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:20:09 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:20:09.247690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603daa69-8492-49a9-944b-ecdb2b3844dc admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:20:09.260004 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603daa69-8492-49a9-944b-ecdb2b3844dc admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:20:09.265768 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286ec30-57b1-4b9c-b9f0-b7412b877718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:20:09.266597 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286ec30-57b1-4b9c-b9f0-b7412b877718 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:09.266976 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286ec30-57b1-4b9c-b9f0-b7412b877718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:09.267312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286ec30-57b1-4b9c-b9f0-b7412b877718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:09.268121 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286ec30-57b1-4b9c-b9f0-b7412b877718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:20:09.270060 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286ec30-57b1-4b9c-b9f0-b7412b877718 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:20:09.282859 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1424/2818] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:20:09.289712 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b5d23-f510-4cd9-b723-f7596c07ec5d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:20:09.308599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b5d23-f510-4cd9-b723-f7596c07ec5d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:20:09.316953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2719d7-6f0d-42a6-8fe2-7b62bf92092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:20:09.318122 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2719d7-6f0d-42a6-8fe2-7b62bf92092d admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:09.318619 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2719d7-6f0d-42a6-8fe2-7b62bf92092d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:09.319162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2719d7-6f0d-42a6-8fe2-7b62bf92092d admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:09.320555 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2719d7-6f0d-42a6-8fe2-7b62bf92092d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:20:09.323889 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2719d7-6f0d-42a6-8fe2-7b62bf92092d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:20:09.344195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1395/2819] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:20:09.349121 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286ec30-57b1-4b9c-b9f0-b7412b877718 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:20:09.360923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286ec30-57b1-4b9c-b9f0-b7412b877718 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:20:09.367067 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8348e-04ce-4f7c-9522-83da1903b815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:20:09.368031 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8348e-04ce-4f7c-9522-83da1903b815 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:09.368315 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8348e-04ce-4f7c-9522-83da1903b815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:09.368594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8348e-04ce-4f7c-9522-83da1903b815 admin admin] PATH_INFO: `/v3/projects/4d634b143d2540879d26c3be866c8070/users/16e65f702950465b8732af6fc828e8bf/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:09.388046 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8348e-04ce-4f7c-9522-83da1903b815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d634b143d2540879d26c3be866c8070, user_id=16e65f702950465b8732af6fc828e8bf, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:20:09.391258 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8348e-04ce-4f7c-9522-83da1903b815 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:20:09.409169 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1425/2820] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:20:09 2022] PUT /identity/v3/projects/4d634b143d2540879d26c3be866c8070/users/16e65f702950465b8732af6fc828e8bf/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:20:09.415419 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3483f0-14ca-47de-928a-32506c372535 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:09.415774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3483f0-14ca-47de-928a-32506c372535 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:09.416126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3483f0-14ca-47de-928a-32506c372535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:09.437398 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-8d3483f0-14ca-47de-928a-32506c372535 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:20:09.438665 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-8d3483f0-14ca-47de-928a-32506c372535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:20:09.526229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1396/2821] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:20:09.537395 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8348e-04ce-4f7c-9522-83da1903b815 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:20:09.539691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d3d8348e-04ce-4f7c-9522-83da1903b815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:20:09.558402 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:20:09.621883 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8348e-04ce-4f7c-9522-83da1903b815 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:20:09.626343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39f240-550a-428a-9194-e8b60bf3e0b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:20:09.627082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f240-550a-428a-9194-e8b60bf3e0b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:09.627421 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f240-550a-428a-9194-e8b60bf3e0b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:09.627725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39f240-550a-428a-9194-e8b60bf3e0b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:09.638881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39f240-550a-428a-9194-e8b60bf3e0b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:20:09.640269 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39f240-550a-428a-9194-e8b60bf3e0b1 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:20:09.651312 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1426/2822] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:20:15.302414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378374a-2f67-4dff-a26a-940c19dcf38d None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:15.303206 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378374a-2f67-4dff-a26a-940c19dcf38d None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:15.303370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378374a-2f67-4dff-a26a-940c19dcf38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:15.344735 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-2378374a-2f67-4dff-a26a-940c19dcf38d None None] MFA Rules not processed for user `16e65f702950465b8732af6fc828e8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:20:15.346177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2378374a-2f67-4dff-a26a-940c19dcf38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:20:15.457236 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1397/2823] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:20:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:20:15.481094 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39f240-550a-428a-9194-e8b60bf3e0b1 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:20:15.483354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3a39f240-550a-428a-9194-e8b60bf3e0b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:20:15.599359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39f240-550a-428a-9194-e8b60bf3e0b1 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:20:15.612512 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c41fa-06ed-4094-96b3-362c748c40d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:20:15.614466 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c41fa-06ed-4094-96b3-362c748c40d3 service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:15.615292 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c41fa-06ed-4094-96b3-362c748c40d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:15.615603 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c41fa-06ed-4094-96b3-362c748c40d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:15.631376 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c41fa-06ed-4094-96b3-362c748c40d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:20:15.634251 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c41fa-06ed-4094-96b3-362c748c40d3 service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:20:15.660180 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1427/2824] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:20:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:20:17.513187 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79e40f-1457-42b6-8c8a-710955a46490 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:20:17.513837 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79e40f-1457-42b6-8c8a-710955a46490 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:20:17.513972 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79e40f-1457-42b6-8c8a-710955a46490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:20:17.520578 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:20:17.536802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-ef79e40f-1457-42b6-8c8a-710955a46490 None None] MFA Rules not processed for user `16e65f702950465b8732af6fc828e8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:20:17.539010 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-ef79e40f-1457-42b6-8c8a-710955a46490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:20:17.551948 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1398/2825] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:20:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:20:25.644604 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=54 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:20:27.538921 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:21:02.877406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c41fa-06ed-4094-96b3-362c748c40d3 service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:21:02.879112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f77c41fa-06ed-4094-96b3-362c748c40d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:21:02.893103 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c41fa-06ed-4094-96b3-362c748c40d3 service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:21:02.897715 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58834b-e95f-4e0e-b273-15c0034a77d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:21:02.898400 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58834b-e95f-4e0e-b273-15c0034a77d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:21:02.898698 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58834b-e95f-4e0e-b273-15c0034a77d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:21:02.899017 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58834b-e95f-4e0e-b273-15c0034a77d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:21:02.901287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-6d58834b-e95f-4e0e-b273-15c0034a77d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:21:02.916928 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58834b-e95f-4e0e-b273-15c0034a77d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:21:02.918524 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58834b-e95f-4e0e-b273-15c0034a77d8 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:21:02.933166 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1428/2826] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:21:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:21:04.156552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79e40f-1457-42b6-8c8a-710955a46490 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:21:04.167925 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79e40f-1457-42b6-8c8a-710955a46490 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:21:04.171953 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f962797-269a-4241-9fb0-4e8d908e5a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:21:04.172652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f962797-269a-4241-9fb0-4e8d908e5a38 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:21:04.172939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f962797-269a-4241-9fb0-4e8d908e5a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:21:04.173380 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f962797-269a-4241-9fb0-4e8d908e5a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:21:04.175571 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-1f962797-269a-4241-9fb0-4e8d908e5a38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:21:04.191386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f962797-269a-4241-9fb0-4e8d908e5a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:21:04.193852 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f962797-269a-4241-9fb0-4e8d908e5a38 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:21:04.208827 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1399/2827] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:21:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:21:12.926771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:21:14.202520 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=6 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:21:38.334671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58834b-e95f-4e0e-b273-15c0034a77d8 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:21:38.345206 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58834b-e95f-4e0e-b273-15c0034a77d8 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:21:38.350398 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3ce4e-481f-4872-b439-b2a520fa24ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:21:38.351107 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3ce4e-481f-4872-b439-b2a520fa24ee service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:21:38.351410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3ce4e-481f-4872-b439-b2a520fa24ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:21:38.351701 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3ce4e-481f-4872-b439-b2a520fa24ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:21:38.353947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-84a3ce4e-481f-4872-b439-b2a520fa24ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:21:38.366945 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3ce4e-481f-4872-b439-b2a520fa24ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:21:38.368443 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3ce4e-481f-4872-b439-b2a520fa24ee service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:21:38.378238 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1429/2828] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:21:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:21:48.373802 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:23:11.703961 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f962797-269a-4241-9fb0-4e8d908e5a38 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:23:11.719684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f962797-269a-4241-9fb0-4e8d908e5a38 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:23:11.726844 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59d99b-2841-4760-af5e-3f764edffe4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:23:11.728141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59d99b-2841-4760-af5e-3f764edffe4a service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:23:11.728641 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59d99b-2841-4760-af5e-3f764edffe4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:23:11.729142 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59d99b-2841-4760-af5e-3f764edffe4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:23:11.732541 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3d59d99b-2841-4760-af5e-3f764edffe4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:23:11.845812 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59d99b-2841-4760-af5e-3f764edffe4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:23:11.847344 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59d99b-2841-4760-af5e-3f764edffe4a service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:23:11.859103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1400/2829] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:23:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:23:12.862992 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3ce4e-481f-4872-b439-b2a520fa24ee service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:23:12.864718 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-84a3ce4e-481f-4872-b439-b2a520fa24ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:23:12.889194 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3ce4e-481f-4872-b439-b2a520fa24ee service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:23:12.894697 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24d3af-f687-4c6a-aa97-518ccdbf3b4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:23:12.895488 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24d3af-f687-4c6a-aa97-518ccdbf3b4a service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:23:12.895778 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24d3af-f687-4c6a-aa97-518ccdbf3b4a service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:23:12.896104 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24d3af-f687-4c6a-aa97-518ccdbf3b4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:23:12.899691 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cf24d3af-f687-4c6a-aa97-518ccdbf3b4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:23:12.922920 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24d3af-f687-4c6a-aa97-518ccdbf3b4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:23:12.926521 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24d3af-f687-4c6a-aa97-518ccdbf3b4a service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:23:12.951041 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1430/2830] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:23:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:23:16.983550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59d99b-2841-4760-af5e-3f764edffe4a service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:23:16.993939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59d99b-2841-4760-af5e-3f764edffe4a service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:23:16.997949 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ae754-b711-4205-82ce-0f65d52f86c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:23:16.998632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ae754-b711-4205-82ce-0f65d52f86c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:23:16.998954 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ae754-b711-4205-82ce-0f65d52f86c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:23:16.999224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ae754-b711-4205-82ce-0f65d52f86c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:23:17.001493 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-337ae754-b711-4205-82ce-0f65d52f86c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:23:17.014983 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ae754-b711-4205-82ce-0f65d52f86c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:23:17.016472 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ae754-b711-4205-82ce-0f65d52f86c1 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:23:17.028178 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1401/2831] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:23:22.939196 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:23:25.746888 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24d3af-f687-4c6a-aa97-518ccdbf3b4a service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:23:25.746888 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-cf24d3af-f687-4c6a-aa97-518ccdbf3b4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:23:25.767272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24d3af-f687-4c6a-aa97-518ccdbf3b4a service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:23:25.773412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d2b08-51a4-423c-aa2b-8317dd47a380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:23:25.774406 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d2b08-51a4-423c-aa2b-8317dd47a380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:23:25.774699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d2b08-51a4-423c-aa2b-8317dd47a380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:23:25.775176 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d2b08-51a4-423c-aa2b-8317dd47a380 admin admin] PATH_INFO: `/v3/users/2c9a75b70d6e40168a8716b2b9cd2da9` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:23:25.782431 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d2b08-51a4-423c-aa2b-8317dd47a380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c9a75b70d6e40168a8716b2b9cd2da9)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:23:25.786210 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d2b08-51a4-423c-aa2b-8317dd47a380 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:23:25.844562 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d80d2b08-51a4-423c-aa2b-8317dd47a380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c9a75b70d6e40168a8716b2b9cd2da9'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:25.858284 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d80d2b08-51a4-423c-aa2b-8317dd47a380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c9a75b70d6e40168a8716b2b9cd2da9'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:25.867906 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d80d2b08-51a4-423c-aa2b-8317dd47a380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c9a75b70d6e40168a8716b2b9cd2da9'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:25.868610 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d80d2b08-51a4-423c-aa2b-8317dd47a380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c9a75b70d6e40168a8716b2b9cd2da9'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:25.877132 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-d80d2b08-51a4-423c-aa2b-8317dd47a380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c9a75b70d6e40168a8716b2b9cd2da9'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:25.884606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1431/2832] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:23:25 2022] DELETE /identity/v3/users/2c9a75b70d6e40168a8716b2b9cd2da9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:23:26.097431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ae754-b711-4205-82ce-0f65d52f86c1 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:23:26.120529 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ae754-b711-4205-82ce-0f65d52f86c1 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:23:26.226513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:23:26.227496 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:23:26.227802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:23:26.228128 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0 admin admin] PATH_INFO: `/v3/projects/bd614b1e286d40438bb52608aca6a408` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:23:26.229750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd614b1e286d40438bb52608aca6a408)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:23:26.231830 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:23:26.293190 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd614b1e286d40438bb52608aca6a408', 'request_id': 'req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:26.302099 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd614b1e286d40438bb52608aca6a408', 'request_id': 'req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:26.311196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd614b1e286d40438bb52608aca6a408', 'request_id': 'req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:26.333375 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0 admin admin] The token cache is being invalidate because project bd614b1e286d40438bb52608aca6a408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:23:26.333821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:26.334669 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:26.336875 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1402/2833] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:23:26 2022] DELETE /identity/v3/projects/bd614b1e286d40438bb52608aca6a408 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:23:26.342947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d2b08-51a4-423c-aa2b-8317dd47a380 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:23:26.344728 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d80d2b08-51a4-423c-aa2b-8317dd47a380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:23:26.362459 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d2b08-51a4-423c-aa2b-8317dd47a380 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:23:26.455681 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f998e-8800-4f0b-b7cc-79eadfb2a201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:23:26.457267 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f998e-8800-4f0b-b7cc-79eadfb2a201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:23:26.457760 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f998e-8800-4f0b-b7cc-79eadfb2a201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:23:26.458294 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f998e-8800-4f0b-b7cc-79eadfb2a201 admin admin] PATH_INFO: `/v3/users/b05cb6011fdb41209ebc97bd598fd50e` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:23:26.460734 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f998e-8800-4f0b-b7cc-79eadfb2a201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05cb6011fdb41209ebc97bd598fd50e)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:23:26.466856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f998e-8800-4f0b-b7cc-79eadfb2a201 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:23:26.543227 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c26f998e-8800-4f0b-b7cc-79eadfb2a201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05cb6011fdb41209ebc97bd598fd50e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:26.558523 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c26f998e-8800-4f0b-b7cc-79eadfb2a201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05cb6011fdb41209ebc97bd598fd50e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:26.568865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c26f998e-8800-4f0b-b7cc-79eadfb2a201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05cb6011fdb41209ebc97bd598fd50e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:26.569567 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c26f998e-8800-4f0b-b7cc-79eadfb2a201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05cb6011fdb41209ebc97bd598fd50e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:26.572921 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:23:26.582513 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-c26f998e-8800-4f0b-b7cc-79eadfb2a201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05cb6011fdb41209ebc97bd598fd50e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:26.591399 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1432/2834] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:23:26 2022] DELETE /identity/v3/users/b05cb6011fdb41209ebc97bd598fd50e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:23:26.853202 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:23:26.856405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:23:26.879135 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b820e7-4539-4cb0-ac2b-0f56eefce1b0 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:23:26.899546 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:23:26.958959 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfcfbea-368f-4547-8210-3b2c532a7fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:23:26.959950 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcfbea-368f-4547-8210-3b2c532a7fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:23:26.960292 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcfbea-368f-4547-8210-3b2c532a7fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:23:26.960673 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfcfbea-368f-4547-8210-3b2c532a7fec admin admin] PATH_INFO: `/v3/projects/ee6c2dc67e8b4cac8f48c95264bc74a6` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:23:26.962204 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcfbea-368f-4547-8210-3b2c532a7fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6c2dc67e8b4cac8f48c95264bc74a6)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:23:26.964535 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfcfbea-368f-4547-8210-3b2c532a7fec admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:23:27.019111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2dfcfbea-368f-4547-8210-3b2c532a7fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6c2dc67e8b4cac8f48c95264bc74a6', 'request_id': 'req-2dfcfbea-368f-4547-8210-3b2c532a7fec'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:27.027004 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2dfcfbea-368f-4547-8210-3b2c532a7fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6c2dc67e8b4cac8f48c95264bc74a6', 'request_id': 'req-2dfcfbea-368f-4547-8210-3b2c532a7fec'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:27.035605 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2dfcfbea-368f-4547-8210-3b2c532a7fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6c2dc67e8b4cac8f48c95264bc74a6', 'request_id': 'req-2dfcfbea-368f-4547-8210-3b2c532a7fec'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:27.052587 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2dfcfbea-368f-4547-8210-3b2c532a7fec admin admin] The token cache is being invalidate because project ee6c2dc67e8b4cac8f48c95264bc74a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:23:27.053006 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2dfcfbea-368f-4547-8210-3b2c532a7fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:27.053877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-2dfcfbea-368f-4547-8210-3b2c532a7fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:23:27.055931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1403/2835] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:23:26 2022] DELETE /identity/v3/projects/ee6c2dc67e8b4cac8f48c95264bc74a6 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:23:36.586597 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:23:37.048925 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=44,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:24:44.922049 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f998e-8800-4f0b-b7cc-79eadfb2a201 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:24:44.923613 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-c26f998e-8800-4f0b-b7cc-79eadfb2a201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:24:45.125226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f998e-8800-4f0b-b7cc-79eadfb2a201 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:24:45.225246 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfafc0-2ea9-4b05-806c-e25eb46dfe31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:24:45.226186 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfafc0-2ea9-4b05-806c-e25eb46dfe31 service placement] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:24:45.226554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfafc0-2ea9-4b05-806c-e25eb46dfe31 service placement] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:24:45.226942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfafc0-2ea9-4b05-806c-e25eb46dfe31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:24:45.229201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-10cfafc0-2ea9-4b05-806c-e25eb46dfe31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:24:45.243772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfafc0-2ea9-4b05-806c-e25eb46dfe31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:24:45.246178 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfafc0-2ea9-4b05-806c-e25eb46dfe31 service placement] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:24:45.264172 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1433/2836] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:24:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:24:48.672749 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824dc52-23f9-4f8d-ac56-96c50f2f8d24 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:24:48.673372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824dc52-23f9-4f8d-ac56-96c50f2f8d24 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:24:48.673372 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824dc52-23f9-4f8d-ac56-96c50f2f8d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:24:48.692793 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-4824dc52-23f9-4f8d-ac56-96c50f2f8d24 None None] MFA Rules not processed for user `16e65f702950465b8732af6fc828e8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:24:48.694102 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4824dc52-23f9-4f8d-ac56-96c50f2f8d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:24:48.760077 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1404/2837] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:24:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:24:49.163594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfafc0-2ea9-4b05-806c-e25eb46dfe31 service placement] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:24:49.165970 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-10cfafc0-2ea9-4b05-806c-e25eb46dfe31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:24:49.215889 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=100 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:24:49.281385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfafc0-2ea9-4b05-806c-e25eb46dfe31 service placement] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:24:49.285741 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2d501-3aac-4cd7-b82d-4bc91f64d7d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:24:49.286429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d501-3aac-4cd7-b82d-4bc91f64d7d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:24:49.286739 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d501-3aac-4cd7-b82d-4bc91f64d7d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:24:49.287112 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a2d501-3aac-4cd7-b82d-4bc91f64d7d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:24:49.289233 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-92a2d501-3aac-4cd7-b82d-4bc91f64d7d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:24:49.301155 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2d501-3aac-4cd7-b82d-4bc91f64d7d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:24:49.302653 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a2d501-3aac-4cd7-b82d-4bc91f64d7d1 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:24:49.313113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1434/2838] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:24:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:24:49.735717 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824dc52-23f9-4f8d-ac56-96c50f2f8d24 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:24:49.737858 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4824dc52-23f9-4f8d-ac56-96c50f2f8d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:24:49.754867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824dc52-23f9-4f8d-ac56-96c50f2f8d24 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:24:49.762383 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3b63d-1eff-4fa0-9e83-90aaf23c3b3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:24:49.763836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3b63d-1eff-4fa0-9e83-90aaf23c3b3e service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:24:49.764348 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3b63d-1eff-4fa0-9e83-90aaf23c3b3e service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:24:49.764815 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3b63d-1eff-4fa0-9e83-90aaf23c3b3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:24:49.770674 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-29d3b63d-1eff-4fa0-9e83-90aaf23c3b3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:24:49.785602 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3b63d-1eff-4fa0-9e83-90aaf23c3b3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:24:49.787424 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d3b63d-1eff-4fa0-9e83-90aaf23c3b3e service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:24:49.799712 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1405/2839] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:24:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:24:58.741927 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2d501-3aac-4cd7-b82d-4bc91f64d7d1 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:24:58.744283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-92a2d501-3aac-4cd7-b82d-4bc91f64d7d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:24:58.908779 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a2d501-3aac-4cd7-b82d-4bc91f64d7d1 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:24:58.918280 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c9cf3-a055-4c79-9b9f-b7690f530e8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:24:58.919511 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c9cf3-a055-4c79-9b9f-b7690f530e8f service nova] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:24:58.920018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c9cf3-a055-4c79-9b9f-b7690f530e8f service nova] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:24:58.920485 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c9cf3-a055-4c79-9b9f-b7690f530e8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:24:58.923655 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9d7c9cf3-a055-4c79-9b9f-b7690f530e8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:24:58.946632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c9cf3-a055-4c79-9b9f-b7690f530e8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:24:58.949618 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c9cf3-a055-4c79-9b9f-b7690f530e8f service nova] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:24:58.970278 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1435/2840] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:24:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:24:59.794405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=31 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:25:08.961641 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=70 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:18.517537 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3b63d-1eff-4fa0-9e83-90aaf23c3b3e service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:18.538184 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3b63d-1eff-4fa0-9e83-90aaf23c3b3e service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:18.545262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2eb72-e7b3-49f7-9098-5a3c945ad688 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9a1ec1f6bb7467dbd63ad1da36d48a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:18.546340 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2eb72-e7b3-49f7-9098-5a3c945ad688 service nova] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:18.546809 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2eb72-e7b3-49f7-9098-5a3c945ad688 service nova] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:18.547219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2eb72-e7b3-49f7-9098-5a3c945ad688 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:18.549510 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-52d2eb72-e7b3-49f7-9098-5a3c945ad688 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:18.561155 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2eb72-e7b3-49f7-9098-5a3c945ad688 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:18.562915 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d2eb72-e7b3-49f7-9098-5a3c945ad688 service nova] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:18.573306 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1406/2841] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:26:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:26:20.023241 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c9cf3-a055-4c79-9b9f-b7690f530e8f service nova] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:20.024765 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9d7c9cf3-a055-4c79-9b9f-b7690f530e8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:20.116923 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c9cf3-a055-4c79-9b9f-b7690f530e8f service nova] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:20.121216 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a1f70-f976-4cb2-b721-a000a6302b33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:20.121879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a1f70-f976-4cb2-b721-a000a6302b33 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:20.122173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a1f70-f976-4cb2-b721-a000a6302b33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:20.122451 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0a1f70-f976-4cb2-b721-a000a6302b33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:20.124403 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3f0a1f70-f976-4cb2-b721-a000a6302b33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:20.138771 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a1f70-f976-4cb2-b721-a000a6302b33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:20.140244 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0a1f70-f976-4cb2-b721-a000a6302b33 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:20.151536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1436/2842] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:26:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:26:24.152740 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2eb72-e7b3-49f7-9098-5a3c945ad688 service nova] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:24.155162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-52d2eb72-e7b3-49f7-9098-5a3c945ad688 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:24.171180 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2eb72-e7b3-49f7-9098-5a3c945ad688 service nova] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:24.175569 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580924b2-2819-4c9e-91dd-7a112dcb420b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:24.176249 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580924b2-2819-4c9e-91dd-7a112dcb420b service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:24.176523 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580924b2-2819-4c9e-91dd-7a112dcb420b service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:24.176791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580924b2-2819-4c9e-91dd-7a112dcb420b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:24.178741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-580924b2-2819-4c9e-91dd-7a112dcb420b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:24.193543 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580924b2-2819-4c9e-91dd-7a112dcb420b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:24.196608 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580924b2-2819-4c9e-91dd-7a112dcb420b service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:24.210996 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1407/2843] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:26:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:26:30.146673 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=35 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:34.204735 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=12 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:39.205462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a1f70-f976-4cb2-b721-a000a6302b33 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:39.207005 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-3f0a1f70-f976-4cb2-b721-a000a6302b33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:39.219628 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0a1f70-f976-4cb2-b721-a000a6302b33 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:39.224248 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca7216-e825-467b-9bbd-b7694de660a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:39.224933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca7216-e825-467b-9bbd-b7694de660a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:39.225215 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca7216-e825-467b-9bbd-b7694de660a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:39.225492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca7216-e825-467b-9bbd-b7694de660a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:39.227458 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1eca7216-e825-467b-9bbd-b7694de660a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:39.332873 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca7216-e825-467b-9bbd-b7694de660a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:39.334478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca7216-e825-467b-9bbd-b7694de660a0 service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:39.354638 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1437/2844] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:26:42.696244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580924b2-2819-4c9e-91dd-7a112dcb420b service cinder] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:42.709468 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580924b2-2819-4c9e-91dd-7a112dcb420b service cinder] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:42.714893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6313f-9f03-49a5-9d49-9199b8d5e2e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:42.715568 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6313f-9f03-49a5-9d49-9199b8d5e2e5 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:42.715850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6313f-9f03-49a5-9d49-9199b8d5e2e5 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:42.716127 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6313f-9f03-49a5-9d49-9199b8d5e2e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:42.718036 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-2ac6313f-9f03-49a5-9d49-9199b8d5e2e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:42.730365 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6313f-9f03-49a5-9d49-9199b8d5e2e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:42.732002 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac6313f-9f03-49a5-9d49-9199b8d5e2e5 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:42.744945 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1408/2845] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:26:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:26:42.752091 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca7216-e825-467b-9bbd-b7694de660a0 service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:42.753723 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1eca7216-e825-467b-9bbd-b7694de660a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:42.766189 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca7216-e825-467b-9bbd-b7694de660a0 service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:42.771385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107480a-0b6e-4ea0-97ec-5c5efc46bec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:42.772284 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107480a-0b6e-4ea0-97ec-5c5efc46bec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:42.772570 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107480a-0b6e-4ea0-97ec-5c5efc46bec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:42.772867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107480a-0b6e-4ea0-97ec-5c5efc46bec2 admin admin] PATH_INFO: `/v3/users/16e65f702950465b8732af6fc828e8bf` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:42.774129 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107480a-0b6e-4ea0-97ec-5c5efc46bec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e65f702950465b8732af6fc828e8bf)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:42.776102 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107480a-0b6e-4ea0-97ec-5c5efc46bec2 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:42.825140 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7107480a-0b6e-4ea0-97ec-5c5efc46bec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e65f702950465b8732af6fc828e8bf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:42.837785 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7107480a-0b6e-4ea0-97ec-5c5efc46bec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e65f702950465b8732af6fc828e8bf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:42.847148 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7107480a-0b6e-4ea0-97ec-5c5efc46bec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e65f702950465b8732af6fc828e8bf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:42.847834 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7107480a-0b6e-4ea0-97ec-5c5efc46bec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e65f702950465b8732af6fc828e8bf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:42.856008 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-7107480a-0b6e-4ea0-97ec-5c5efc46bec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e65f702950465b8732af6fc828e8bf'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:42.863090 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1438/2846] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:26:42 2022] DELETE /identity/v3/users/16e65f702950465b8732af6fc828e8bf => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:43.068845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6313f-9f03-49a5-9d49-9199b8d5e2e5 service placement] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:43.080748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6313f-9f03-49a5-9d49-9199b8d5e2e5 service placement] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:43.144697 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc605422-e2a9-49fb-9590-aaeaee613a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:43.145652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc605422-e2a9-49fb-9590-aaeaee613a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:43.145931 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc605422-e2a9-49fb-9590-aaeaee613a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:43.146205 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc605422-e2a9-49fb-9590-aaeaee613a84 admin admin] PATH_INFO: `/v3/projects/4d634b143d2540879d26c3be866c8070` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:43.147540 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc605422-e2a9-49fb-9590-aaeaee613a84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d634b143d2540879d26c3be866c8070)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:43.149581 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc605422-e2a9-49fb-9590-aaeaee613a84 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:43.205995 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc605422-e2a9-49fb-9590-aaeaee613a84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d634b143d2540879d26c3be866c8070', 'request_id': 'req-dc605422-e2a9-49fb-9590-aaeaee613a84'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:43.213097 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc605422-e2a9-49fb-9590-aaeaee613a84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d634b143d2540879d26c3be866c8070', 'request_id': 'req-dc605422-e2a9-49fb-9590-aaeaee613a84'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:43.219632 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc605422-e2a9-49fb-9590-aaeaee613a84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d634b143d2540879d26c3be866c8070', 'request_id': 'req-dc605422-e2a9-49fb-9590-aaeaee613a84'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:43.233924 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc605422-e2a9-49fb-9590-aaeaee613a84 admin admin] The token cache is being invalidate because project 4d634b143d2540879d26c3be866c8070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:26:43.234209 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc605422-e2a9-49fb-9590-aaeaee613a84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:43.234869 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-dc605422-e2a9-49fb-9590-aaeaee613a84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:43.236452 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1409/2847] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:26:43 2022] DELETE /identity/v3/projects/4d634b143d2540879d26c3be866c8070 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:43.243598 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a92c8-bd19-4bb1-ab77-f1c407479dd6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:43.244185 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a92c8-bd19-4bb1-ab77-f1c407479dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:43.244517 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082a92c8-bd19-4bb1-ab77-f1c407479dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:43.306240 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:43.309702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-082a92c8-bd19-4bb1-ab77-f1c407479dd6 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:26:43.312014 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-082a92c8-bd19-4bb1-ab77-f1c407479dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:43.378999 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1439/2848] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:26:43.387335 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20da90-04a6-4a38-a998-ef6dfef28f4e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:43.387607 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20da90-04a6-4a38-a998-ef6dfef28f4e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:43.387910 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da20da90-04a6-4a38-a998-ef6dfef28f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:43.408706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-da20da90-04a6-4a38-a998-ef6dfef28f4e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:26:43.410215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-da20da90-04a6-4a38-a998-ef6dfef28f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:43.419554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1410/2849] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:26:43.424174 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a92c8-bd19-4bb1-ab77-f1c407479dd6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:43.434411 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082a92c8-bd19-4bb1-ab77-f1c407479dd6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:43.439462 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec05c2-1b87-4d38-8e79-1095ff184738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:43.440131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec05c2-1b87-4d38-8e79-1095ff184738 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:43.440453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec05c2-1b87-4d38-8e79-1095ff184738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:43.440875 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec05c2-1b87-4d38-8e79-1095ff184738 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:43.441683 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec05c2-1b87-4d38-8e79-1095ff184738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:26:43.441989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec05c2-1b87-4d38-8e79-1095ff184738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:43.443660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec05c2-1b87-4d38-8e79-1095ff184738 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:43.456761 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1440/2850] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:26:43.461832 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20da90-04a6-4a38-a998-ef6dfef28f4e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:43.471787 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da20da90-04a6-4a38-a998-ef6dfef28f4e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:43.477552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874b1d8-75f6-419f-9a95-f7e248ce46b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:43.478177 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874b1d8-75f6-419f-9a95-f7e248ce46b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:43.478484 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874b1d8-75f6-419f-9a95-f7e248ce46b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:43.478759 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874b1d8-75f6-419f-9a95-f7e248ce46b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:43.479515 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874b1d8-75f6-419f-9a95-f7e248ce46b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:43.481480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874b1d8-75f6-419f-9a95-f7e248ce46b1 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:43.510601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1411/2851] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:26:43 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:26:43.514909 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec05c2-1b87-4d38-8e79-1095ff184738 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:43.525705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec05c2-1b87-4d38-8e79-1095ff184738 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:43.588914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daad683-de40-4fb8-8845-373f5bf30e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:43.589634 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daad683-de40-4fb8-8845-373f5bf30e7e admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:43.589913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daad683-de40-4fb8-8845-373f5bf30e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:43.590187 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daad683-de40-4fb8-8845-373f5bf30e7e admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:43.590942 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daad683-de40-4fb8-8845-373f5bf30e7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:43.592891 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daad683-de40-4fb8-8845-373f5bf30e7e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:43.614306 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1441/2852] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:26:43 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:26:43.618631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874b1d8-75f6-419f-9a95-f7e248ce46b1 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:43.630453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874b1d8-75f6-419f-9a95-f7e248ce46b1 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:43.635601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1be8a-f417-44c1-b640-047efb8a5443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:43.636277 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1be8a-f417-44c1-b640-047efb8a5443 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:43.636554 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1be8a-f417-44c1-b640-047efb8a5443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:43.636799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1be8a-f417-44c1-b640-047efb8a5443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:43.637577 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1be8a-f417-44c1-b640-047efb8a5443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:43.639219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1be8a-f417-44c1-b640-047efb8a5443 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:43.652550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1412/2853] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:26:43.656274 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daad683-de40-4fb8-8845-373f5bf30e7e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:43.666806 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daad683-de40-4fb8-8845-373f5bf30e7e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:43.671693 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631a07d-431f-4541-ba05-c3b12b4f00e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:43.672367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631a07d-431f-4541-ba05-c3b12b4f00e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:43.672648 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631a07d-431f-4541-ba05-c3b12b4f00e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:43.672918 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631a07d-431f-4541-ba05-c3b12b4f00e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:43.673654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631a07d-431f-4541-ba05-c3b12b4f00e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:43.675316 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631a07d-431f-4541-ba05-c3b12b4f00e0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:43.687769 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1442/2854] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:26:43.692224 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1be8a-f417-44c1-b640-047efb8a5443 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:43.703807 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1be8a-f417-44c1-b640-047efb8a5443 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:43.709266 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da42b32-b1d6-4a70-b84f-d69a04d727f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:43.710094 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da42b32-b1d6-4a70-b84f-d69a04d727f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:43.710370 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da42b32-b1d6-4a70-b84f-d69a04d727f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:43.710621 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da42b32-b1d6-4a70-b84f-d69a04d727f9 admin admin] PATH_INFO: `/v3/projects/ec0fb43a13ef4693973f227aa6205e4a/users/a76beca4550a43b78bdcb7f7ecdebb86/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:43.726695 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da42b32-b1d6-4a70-b84f-d69a04d727f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0fb43a13ef4693973f227aa6205e4a, user_id=a76beca4550a43b78bdcb7f7ecdebb86, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:43.729480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da42b32-b1d6-4a70-b84f-d69a04d727f9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:43.745027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1413/2855] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:26:43 2022] PUT /identity/v3/projects/ec0fb43a13ef4693973f227aa6205e4a/users/a76beca4550a43b78bdcb7f7ecdebb86/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:43.756633 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4860-8702-41e6-a78e-5c580a25556e None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:43.757219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4860-8702-41e6-a78e-5c580a25556e None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:43.757219 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df4860-8702-41e6-a78e-5c580a25556e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:43.786043 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-17df4860-8702-41e6-a78e-5c580a25556e None None] MFA Rules not processed for user `a76beca4550a43b78bdcb7f7ecdebb86`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:26:43.787296 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-17df4860-8702-41e6-a78e-5c580a25556e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:43.861642 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1443/2856] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:26:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:26:43.866788 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da42b32-b1d6-4a70-b84f-d69a04d727f9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:43.884546 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:43.952798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da42b32-b1d6-4a70-b84f-d69a04d727f9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:43.958257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666adff-df20-432a-9712-63b540fdf05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:43.958968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666adff-df20-432a-9712-63b540fdf05e admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:43.959253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666adff-df20-432a-9712-63b540fdf05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:43.959587 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a666adff-df20-432a-9712-63b540fdf05e admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:43.960235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666adff-df20-432a-9712-63b540fdf05e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:43.962162 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a666adff-df20-432a-9712-63b540fdf05e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:43.994312 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1414/2857] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:26:43 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:26:43.998689 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df4860-8702-41e6-a78e-5c580a25556e None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:44.004576 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:44.012111 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df4860-8702-41e6-a78e-5c580a25556e None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:44.070681 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d133bed-3f9f-4e24-a2c2-713e2530396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:44.071410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d133bed-3f9f-4e24-a2c2-713e2530396c admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:44.071690 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d133bed-3f9f-4e24-a2c2-713e2530396c admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:44.071931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d133bed-3f9f-4e24-a2c2-713e2530396c admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:44.072676 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d133bed-3f9f-4e24-a2c2-713e2530396c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:44.074606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d133bed-3f9f-4e24-a2c2-713e2530396c admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:44.097662 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1444/2858] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:26:43 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:26:44.102495 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666adff-df20-432a-9712-63b540fdf05e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:44.113417 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a666adff-df20-432a-9712-63b540fdf05e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:44.118696 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd57a4-ea3d-4738-8013-e37ea8852bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:44.119447 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd57a4-ea3d-4738-8013-e37ea8852bde admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:44.119711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd57a4-ea3d-4738-8013-e37ea8852bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:44.119991 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd57a4-ea3d-4738-8013-e37ea8852bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:44.120727 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd57a4-ea3d-4738-8013-e37ea8852bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:44.122351 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd57a4-ea3d-4738-8013-e37ea8852bde admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:44.134080 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1415/2859] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:26:44.138508 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d133bed-3f9f-4e24-a2c2-713e2530396c admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:44.149678 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d133bed-3f9f-4e24-a2c2-713e2530396c admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:44.155781 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199607d3-fd69-43cb-ae40-bb1173612efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:44.156704 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199607d3-fd69-43cb-ae40-bb1173612efb admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:44.156986 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199607d3-fd69-43cb-ae40-bb1173612efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:44.157301 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199607d3-fd69-43cb-ae40-bb1173612efb admin admin] PATH_INFO: `/v3/projects/3a7c24f54ff446f88448f3519f872834/users/4514d89d0b8e48c39361a4a52fff4911/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:44.173543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199607d3-fd69-43cb-ae40-bb1173612efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7c24f54ff446f88448f3519f872834, user_id=4514d89d0b8e48c39361a4a52fff4911, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:44.176337 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199607d3-fd69-43cb-ae40-bb1173612efb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:44.194284 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1445/2860] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:26:44 2022] PUT /identity/v3/projects/3a7c24f54ff446f88448f3519f872834/users/4514d89d0b8e48c39361a4a52fff4911/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 16:26:44.202725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd57a4-ea3d-4738-8013-e37ea8852bde admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:44.217101 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd57a4-ea3d-4738-8013-e37ea8852bde admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:44.282072 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daac9f1-e61b-449d-8515-795785786da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:44.282770 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daac9f1-e61b-449d-8515-795785786da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:44.283091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daac9f1-e61b-449d-8515-795785786da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:44.283364 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daac9f1-e61b-449d-8515-795785786da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:44.284109 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daac9f1-e61b-449d-8515-795785786da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:44.286268 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daac9f1-e61b-449d-8515-795785786da0 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:44.297743 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1416/2861] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:26:44.302415 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199607d3-fd69-43cb-ae40-bb1173612efb admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:44.313323 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199607d3-fd69-43cb-ae40-bb1173612efb admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:44.318343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21285d21-87db-44e2-95d2-e1f744a6fbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:44.319313 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21285d21-87db-44e2-95d2-e1f744a6fbdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:44.319602 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21285d21-87db-44e2-95d2-e1f744a6fbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:44.319877 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21285d21-87db-44e2-95d2-e1f744a6fbdb admin admin] PATH_INFO: `/v3/projects/3a7c24f54ff446f88448f3519f872834/users/4514d89d0b8e48c39361a4a52fff4911/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:44.321967 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21285d21-87db-44e2-95d2-e1f744a6fbdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7c24f54ff446f88448f3519f872834, user_id=4514d89d0b8e48c39361a4a52fff4911, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:44.324763 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21285d21-87db-44e2-95d2-e1f744a6fbdb admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:44.336602 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1446/2862] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:26:44 2022] PUT /identity/v3/projects/3a7c24f54ff446f88448f3519f872834/users/4514d89d0b8e48c39361a4a52fff4911/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:44.402458 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a070fb-268f-46cb-a89e-450b7919f16f None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:44.402728 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a070fb-268f-46cb-a89e-450b7919f16f None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:44.403034 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a070fb-268f-46cb-a89e-450b7919f16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:44.431798 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-b7a070fb-268f-46cb-a89e-450b7919f16f None None] MFA Rules not processed for user `4514d89d0b8e48c39361a4a52fff4911`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:26:44.433561 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b7a070fb-268f-46cb-a89e-450b7919f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:44.511505 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1417/2863] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:26:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:26:44.522743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21285d21-87db-44e2-95d2-e1f744a6fbdb admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:44.524656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-21285d21-87db-44e2-95d2-e1f744a6fbdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:44.590009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21285d21-87db-44e2-95d2-e1f744a6fbdb admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:44.594026 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914e348-ec31-4d5f-9ed3-e897f5604795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:44.594705 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914e348-ec31-4d5f-9ed3-e897f5604795 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:44.595023 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914e348-ec31-4d5f-9ed3-e897f5604795 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:44.595304 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e914e348-ec31-4d5f-9ed3-e897f5604795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:44.605585 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914e348-ec31-4d5f-9ed3-e897f5604795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:44.607076 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e914e348-ec31-4d5f-9ed3-e897f5604795 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:44.618587 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1447/2864] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:26:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:26:44.667340 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a070fb-268f-46cb-a89e-450b7919f16f None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:44.668845 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b7a070fb-268f-46cb-a89e-450b7919f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:44.681434 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a070fb-268f-46cb-a89e-450b7919f16f None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:44.687287 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7900b6-9d10-44fd-864a-a50060a266e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:44.687990 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7900b6-9d10-44fd-864a-a50060a266e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:44.688267 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7900b6-9d10-44fd-864a-a50060a266e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:44.688545 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7900b6-9d10-44fd-864a-a50060a266e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:44.694433 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:44.759704 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7900b6-9d10-44fd-864a-a50060a266e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:44.761178 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7900b6-9d10-44fd-864a-a50060a266e5 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:44.771686 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1418/2865] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:26:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:26:48.227751 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914e348-ec31-4d5f-9ed3-e897f5604795 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:48.297530 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:48.302598 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e914e348-ec31-4d5f-9ed3-e897f5604795 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:48.309152 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599c099-1756-4849-a184-f0daf527b29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:48.310161 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599c099-1756-4849-a184-f0daf527b29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:48.310682 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599c099-1756-4849-a184-f0daf527b29f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:48.311074 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599c099-1756-4849-a184-f0daf527b29f admin admin] PATH_INFO: `/v3/users/a76beca4550a43b78bdcb7f7ecdebb86` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:48.312372 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599c099-1756-4849-a184-f0daf527b29f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a76beca4550a43b78bdcb7f7ecdebb86)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:48.314449 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599c099-1756-4849-a184-f0daf527b29f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:48.369960 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f599c099-1756-4849-a184-f0daf527b29f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a76beca4550a43b78bdcb7f7ecdebb86'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:48.385287 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f599c099-1756-4849-a184-f0daf527b29f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a76beca4550a43b78bdcb7f7ecdebb86'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:48.400184 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f599c099-1756-4849-a184-f0daf527b29f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a76beca4550a43b78bdcb7f7ecdebb86'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:48.400846 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f599c099-1756-4849-a184-f0daf527b29f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a76beca4550a43b78bdcb7f7ecdebb86'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:48.411182 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-f599c099-1756-4849-a184-f0daf527b29f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a76beca4550a43b78bdcb7f7ecdebb86'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:48.418590 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1448/2866] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:26:48 2022] DELETE /identity/v3/users/a76beca4550a43b78bdcb7f7ecdebb86 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:48.423446 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ac4f3-5027-4a73-a44a-5e26a20b558e None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:48.424040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ac4f3-5027-4a73-a44a-5e26a20b558e None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:48.424040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ac4f3-5027-4a73-a44a-5e26a20b558e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:48.442227 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-400ac4f3-5027-4a73-a44a-5e26a20b558e None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:26:48.443592 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-400ac4f3-5027-4a73-a44a-5e26a20b558e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:48.507850 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1419/2867] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:26:48.518131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599c099-1756-4849-a184-f0daf527b29f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:48.519784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-f599c099-1756-4849-a184-f0daf527b29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:48.585727 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599c099-1756-4849-a184-f0daf527b29f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:48.589453 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb522c-1b92-408a-a06d-cb2723e47fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:48.590114 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb522c-1b92-408a-a06d-cb2723e47fcd service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:48.590395 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb522c-1b92-408a-a06d-cb2723e47fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:48.590669 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb522c-1b92-408a-a06d-cb2723e47fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:48.601050 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb522c-1b92-408a-a06d-cb2723e47fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:48.602520 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb522c-1b92-408a-a06d-cb2723e47fcd service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:48.613894 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1449/2868] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:26:48.940358 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ac4f3-5027-4a73-a44a-5e26a20b558e None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:48.942113 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-400ac4f3-5027-4a73-a44a-5e26a20b558e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:48.960836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ac4f3-5027-4a73-a44a-5e26a20b558e None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:48.966244 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233d9a3-99ff-4cf9-9292-34d74977e6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:48.967300 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233d9a3-99ff-4cf9-9292-34d74977e6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:48.967666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233d9a3-99ff-4cf9-9292-34d74977e6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:48.968006 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233d9a3-99ff-4cf9-9292-34d74977e6ba admin admin] PATH_INFO: `/v3/projects/ec0fb43a13ef4693973f227aa6205e4a` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:48.969459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233d9a3-99ff-4cf9-9292-34d74977e6ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec0fb43a13ef4693973f227aa6205e4a)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:48.971472 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233d9a3-99ff-4cf9-9292-34d74977e6ba admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:49.029439 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b233d9a3-99ff-4cf9-9292-34d74977e6ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec0fb43a13ef4693973f227aa6205e4a', 'request_id': 'req-b233d9a3-99ff-4cf9-9292-34d74977e6ba'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:49.036154 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b233d9a3-99ff-4cf9-9292-34d74977e6ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec0fb43a13ef4693973f227aa6205e4a', 'request_id': 'req-b233d9a3-99ff-4cf9-9292-34d74977e6ba'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:49.042848 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b233d9a3-99ff-4cf9-9292-34d74977e6ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec0fb43a13ef4693973f227aa6205e4a', 'request_id': 'req-b233d9a3-99ff-4cf9-9292-34d74977e6ba'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:49.059934 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b233d9a3-99ff-4cf9-9292-34d74977e6ba admin admin] The token cache is being invalidate because project ec0fb43a13ef4693973f227aa6205e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:26:49.060257 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b233d9a3-99ff-4cf9-9292-34d74977e6ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:49.060974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-b233d9a3-99ff-4cf9-9292-34d74977e6ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:49.062684 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1420/2869] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:26:48 2022] DELETE /identity/v3/projects/ec0fb43a13ef4693973f227aa6205e4a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:49.067074 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb522c-1b92-408a-a06d-cb2723e47fcd service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:49.077571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb522c-1b92-408a-a06d-cb2723e47fcd service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:49.140788 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af123b0d-3dc5-4ee5-9ba6-4fbe1b40999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:49.141594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af123b0d-3dc5-4ee5-9ba6-4fbe1b40999b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:49.141881 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af123b0d-3dc5-4ee5-9ba6-4fbe1b40999b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:49.142159 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af123b0d-3dc5-4ee5-9ba6-4fbe1b40999b admin admin] PATH_INFO: `/v3/users/4514d89d0b8e48c39361a4a52fff4911` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:49.143461 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af123b0d-3dc5-4ee5-9ba6-4fbe1b40999b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4514d89d0b8e48c39361a4a52fff4911)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:49.145584 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af123b0d-3dc5-4ee5-9ba6-4fbe1b40999b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:49.170807 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:49.198999 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-af123b0d-3dc5-4ee5-9ba6-4fbe1b40999b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4514d89d0b8e48c39361a4a52fff4911'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:49.211871 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-af123b0d-3dc5-4ee5-9ba6-4fbe1b40999b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4514d89d0b8e48c39361a4a52fff4911'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:49.220864 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-af123b0d-3dc5-4ee5-9ba6-4fbe1b40999b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4514d89d0b8e48c39361a4a52fff4911'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:49.221606 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-af123b0d-3dc5-4ee5-9ba6-4fbe1b40999b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4514d89d0b8e48c39361a4a52fff4911'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:49.229656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-af123b0d-3dc5-4ee5-9ba6-4fbe1b40999b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4514d89d0b8e48c39361a4a52fff4911'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:49.235946 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1450/2870] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:26:49 2022] DELETE /identity/v3/users/4514d89d0b8e48c39361a4a52fff4911 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:49.556235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233d9a3-99ff-4cf9-9292-34d74977e6ba admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:49.558480 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-b233d9a3-99ff-4cf9-9292-34d74977e6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:49.579520 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233d9a3-99ff-4cf9-9292-34d74977e6ba admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:49.622103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:49.656513 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7381d-b0cf-4cfb-a3fd-19cd6777c01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:49.657328 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7381d-b0cf-4cfb-a3fd-19cd6777c01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:49.657611 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7381d-b0cf-4cfb-a3fd-19cd6777c01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:49.657888 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7381d-b0cf-4cfb-a3fd-19cd6777c01a admin admin] PATH_INFO: `/v3/projects/3a7c24f54ff446f88448f3519f872834` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:49.659219 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7381d-b0cf-4cfb-a3fd-19cd6777c01a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a7c24f54ff446f88448f3519f872834)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:49.661259 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7381d-b0cf-4cfb-a3fd-19cd6777c01a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:49.714702 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-62b7381d-b0cf-4cfb-a3fd-19cd6777c01a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7c24f54ff446f88448f3519f872834', 'request_id': 'req-62b7381d-b0cf-4cfb-a3fd-19cd6777c01a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:49.722126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-62b7381d-b0cf-4cfb-a3fd-19cd6777c01a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7c24f54ff446f88448f3519f872834', 'request_id': 'req-62b7381d-b0cf-4cfb-a3fd-19cd6777c01a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:49.729551 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-62b7381d-b0cf-4cfb-a3fd-19cd6777c01a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7c24f54ff446f88448f3519f872834', 'request_id': 'req-62b7381d-b0cf-4cfb-a3fd-19cd6777c01a'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:49.745715 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-62b7381d-b0cf-4cfb-a3fd-19cd6777c01a admin admin] The token cache is being invalidate because project 3a7c24f54ff446f88448f3519f872834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:26:49.746017 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-62b7381d-b0cf-4cfb-a3fd-19cd6777c01a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:49.746711 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-62b7381d-b0cf-4cfb-a3fd-19cd6777c01a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:49.748763 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1421/2871] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:26:49 2022] DELETE /identity/v3/projects/3a7c24f54ff446f88448f3519f872834 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:49.753922 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a44b2-3bce-4610-9120-938914539d6c None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:49.754687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a44b2-3bce-4610-9120-938914539d6c None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:49.755215 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a44b2-3bce-4610-9120-938914539d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:49.777220 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-572a44b2-3bce-4610-9120-938914539d6c None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:26:49.778617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-572a44b2-3bce-4610-9120-938914539d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:49.849644 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1451/2872] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:26:49.857520 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee69a3b-45a1-4355-891a-0a12badc997b None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:49.857854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee69a3b-45a1-4355-891a-0a12badc997b None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:49.858085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee69a3b-45a1-4355-891a-0a12badc997b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:49.887473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-bee69a3b-45a1-4355-891a-0a12badc997b None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:26:49.888741 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bee69a3b-45a1-4355-891a-0a12badc997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:49.896952 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1422/2873] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:26:49.901422 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a44b2-3bce-4610-9120-938914539d6c None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:49.911849 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a44b2-3bce-4610-9120-938914539d6c None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:49.917113 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b09efe-1828-432e-9881-f8728ddb0576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:49.917958 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b09efe-1828-432e-9881-f8728ddb0576 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:49.918272 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b09efe-1828-432e-9881-f8728ddb0576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:49.918667 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b09efe-1828-432e-9881-f8728ddb0576 admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:49.919652 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b09efe-1828-432e-9881-f8728ddb0576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:26:49.919994 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b09efe-1828-432e-9881-f8728ddb0576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:49.921738 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b09efe-1828-432e-9881-f8728ddb0576 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:49.935553 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1452/2874] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:26:49.940210 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee69a3b-45a1-4355-891a-0a12badc997b None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:49.951063 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee69a3b-45a1-4355-891a-0a12badc997b None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:49.956430 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285ee20-bc29-4898-8a35-9b414a9a49a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:49.957112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285ee20-bc29-4898-8a35-9b414a9a49a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:49.957417 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285ee20-bc29-4898-8a35-9b414a9a49a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:49.957694 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285ee20-bc29-4898-8a35-9b414a9a49a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:49.958406 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285ee20-bc29-4898-8a35-9b414a9a49a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:49.960464 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285ee20-bc29-4898-8a35-9b414a9a49a8 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:49.992363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1423/2875] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:26:49 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:26:49.996993 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b09efe-1828-432e-9881-f8728ddb0576 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:50.008407 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b09efe-1828-432e-9881-f8728ddb0576 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:50.071105 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818d441-82d3-4051-8486-4c8d2515b593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:50.071801 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818d441-82d3-4051-8486-4c8d2515b593 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:50.072082 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818d441-82d3-4051-8486-4c8d2515b593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:50.072359 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4818d441-82d3-4051-8486-4c8d2515b593 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:50.073064 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818d441-82d3-4051-8486-4c8d2515b593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:50.075029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4818d441-82d3-4051-8486-4c8d2515b593 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:50.101554 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1453/2876] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:26:49 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:26:50.106171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285ee20-bc29-4898-8a35-9b414a9a49a8 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:50.117919 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285ee20-bc29-4898-8a35-9b414a9a49a8 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:50.123476 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ed7cb-ebd3-4cad-acb9-a842d6499d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:50.124258 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed7cb-ebd3-4cad-acb9-a842d6499d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:50.124590 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed7cb-ebd3-4cad-acb9-a842d6499d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:50.124918 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed7cb-ebd3-4cad-acb9-a842d6499d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:50.125737 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ed7cb-ebd3-4cad-acb9-a842d6499d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:50.127538 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ed7cb-ebd3-4cad-acb9-a842d6499d4b admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:50.145092 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1424/2877] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:26:50.149543 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818d441-82d3-4051-8486-4c8d2515b593 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:50.160381 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4818d441-82d3-4051-8486-4c8d2515b593 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:50.165853 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3d6ea-565d-4c72-9282-a3c8b7d22a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:50.166455 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3d6ea-565d-4c72-9282-a3c8b7d22a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:50.166744 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3d6ea-565d-4c72-9282-a3c8b7d22a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:50.167059 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3d6ea-565d-4c72-9282-a3c8b7d22a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:50.167814 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3d6ea-565d-4c72-9282-a3c8b7d22a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:50.169460 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3d6ea-565d-4c72-9282-a3c8b7d22a93 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:50.181611 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1454/2878] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:26:50.186242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ed7cb-ebd3-4cad-acb9-a842d6499d4b admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:50.197861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ed7cb-ebd3-4cad-acb9-a842d6499d4b admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:50.202465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848aff0-ee5d-4192-ad62-000b429feb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:50.203835 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848aff0-ee5d-4192-ad62-000b429feb14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:50.204111 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848aff0-ee5d-4192-ad62-000b429feb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:50.204388 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4848aff0-ee5d-4192-ad62-000b429feb14 admin admin] PATH_INFO: `/v3/projects/d70a5f0c3c274d37952e811f4aa51f5b/users/4ce7d61054064d298e1f43617e61912b/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:50.224932 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848aff0-ee5d-4192-ad62-000b429feb14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70a5f0c3c274d37952e811f4aa51f5b, user_id=4ce7d61054064d298e1f43617e61912b, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:50.227672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4848aff0-ee5d-4192-ad62-000b429feb14 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:50.242539 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1425/2879] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:26:50 2022] PUT /identity/v3/projects/d70a5f0c3c274d37952e811f4aa51f5b/users/4ce7d61054064d298e1f43617e61912b/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:50.254659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19f67f-45e8-4375-91f5-97b7a7647971 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:50.254659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19f67f-45e8-4375-91f5-97b7a7647971 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:50.254659 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19f67f-45e8-4375-91f5-97b7a7647971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:50.262291 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:50.288081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8d19f67f-45e8-4375-91f5-97b7a7647971 None None] MFA Rules not processed for user `4ce7d61054064d298e1f43617e61912b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:26:50.289343 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8d19f67f-45e8-4375-91f5-97b7a7647971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:50.361446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1455/2880] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:26:50 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:26:50.366843 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848aff0-ee5d-4192-ad62-000b429feb14 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:50.430662 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:50.435273 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4848aff0-ee5d-4192-ad62-000b429feb14 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:50.442652 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2a5eb-48dd-4380-b30d-1021e1ca9916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:50.443795 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2a5eb-48dd-4380-b30d-1021e1ca9916 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:50.444310 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2a5eb-48dd-4380-b30d-1021e1ca9916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:50.444755 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2a5eb-48dd-4380-b30d-1021e1ca9916 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:50.445672 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2a5eb-48dd-4380-b30d-1021e1ca9916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:50.449195 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2a5eb-48dd-4380-b30d-1021e1ca9916 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:50.479666 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1426/2881] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:26:50 2022] POST /identity/v3/projects => generated 367 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:26:50.485279 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19f67f-45e8-4375-91f5-97b7a7647971 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:50.497340 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19f67f-45e8-4375-91f5-97b7a7647971 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:50.557933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e64ab-64a3-4bdc-b47b-7c255821502f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:50.558702 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e64ab-64a3-4bdc-b47b-7c255821502f admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:50.559029 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e64ab-64a3-4bdc-b47b-7c255821502f admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:50.559305 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602e64ab-64a3-4bdc-b47b-7c255821502f admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:50.560018 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e64ab-64a3-4bdc-b47b-7c255821502f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:50.561967 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602e64ab-64a3-4bdc-b47b-7c255821502f admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:50.584952 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1456/2882] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:26:50 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:26:50.590856 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2a5eb-48dd-4380-b30d-1021e1ca9916 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:50.604529 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2a5eb-48dd-4380-b30d-1021e1ca9916 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:50.609833 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bb4e5-90f2-4665-89f8-b01f967531b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:50.610519 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bb4e5-90f2-4665-89f8-b01f967531b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:50.610802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bb4e5-90f2-4665-89f8-b01f967531b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:50.611104 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bb4e5-90f2-4665-89f8-b01f967531b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:50.611846 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bb4e5-90f2-4665-89f8-b01f967531b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:50.613461 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bb4e5-90f2-4665-89f8-b01f967531b2 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:50.624451 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1427/2883] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:26:50.628757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e64ab-64a3-4bdc-b47b-7c255821502f admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:50.639081 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602e64ab-64a3-4bdc-b47b-7c255821502f admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:50.643944 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e147a-f80c-4ccf-8395-b5e799664dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:50.644840 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e147a-f80c-4ccf-8395-b5e799664dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:50.645213 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e147a-f80c-4ccf-8395-b5e799664dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:50.645486 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e147a-f80c-4ccf-8395-b5e799664dd3 admin admin] PATH_INFO: `/v3/projects/5e7e47d09cd44dae943cc7da20bb19b9/users/66794d8f1572415d9e6347b36787731c/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:50.661656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e147a-f80c-4ccf-8395-b5e799664dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e7e47d09cd44dae943cc7da20bb19b9, user_id=66794d8f1572415d9e6347b36787731c, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:50.664363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e147a-f80c-4ccf-8395-b5e799664dd3 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:50.679288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1457/2884] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:26:50 2022] PUT /identity/v3/projects/5e7e47d09cd44dae943cc7da20bb19b9/users/66794d8f1572415d9e6347b36787731c/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:50.685199 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bb4e5-90f2-4665-89f8-b01f967531b2 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:50.696391 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bb4e5-90f2-4665-89f8-b01f967531b2 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:50.770096 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ef57d-e606-43d0-b145-d0cf33c685ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:50.770803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ef57d-e606-43d0-b145-d0cf33c685ce admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:50.771139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ef57d-e606-43d0-b145-d0cf33c685ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:50.771419 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ef57d-e606-43d0-b145-d0cf33c685ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:50.772196 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ef57d-e606-43d0-b145-d0cf33c685ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:50.773852 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245ef57d-e606-43d0-b145-d0cf33c685ce admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:50.785371 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1428/2885] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:26:50.790109 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e147a-f80c-4ccf-8395-b5e799664dd3 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:50.802649 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e147a-f80c-4ccf-8395-b5e799664dd3 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:50.808006 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cf1cf-ed5c-4649-ab36-246029687b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:50.808925 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cf1cf-ed5c-4649-ab36-246029687b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:50.809205 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cf1cf-ed5c-4649-ab36-246029687b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:50.809484 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cf1cf-ed5c-4649-ab36-246029687b46 admin admin] PATH_INFO: `/v3/projects/5e7e47d09cd44dae943cc7da20bb19b9/users/66794d8f1572415d9e6347b36787731c/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:50.811603 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cf1cf-ed5c-4649-ab36-246029687b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e7e47d09cd44dae943cc7da20bb19b9, user_id=66794d8f1572415d9e6347b36787731c, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:50.814273 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cf1cf-ed5c-4649-ab36-246029687b46 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:50.825866 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1458/2886] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:26:50 2022] PUT /identity/v3/projects/5e7e47d09cd44dae943cc7da20bb19b9/users/66794d8f1572415d9e6347b36787731c/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:50.838031 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e71dd-e8b6-4e1f-aae3-1fc4da639739 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:50.838317 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e71dd-e8b6-4e1f-aae3-1fc4da639739 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:50.838595 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e71dd-e8b6-4e1f-aae3-1fc4da639739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:50.868027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-134e71dd-e8b6-4e1f-aae3-1fc4da639739 None None] MFA Rules not processed for user `66794d8f1572415d9e6347b36787731c`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:26:50.869407 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-134e71dd-e8b6-4e1f-aae3-1fc4da639739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:50.942879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1429/2887] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:26:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:26:50.954693 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cf1cf-ed5c-4649-ab36-246029687b46 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:50.956564 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-af0cf1cf-ed5c-4649-ab36-246029687b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:51.024537 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:51.032088 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cf1cf-ed5c-4649-ab36-246029687b46 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:51.036478 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19f2e9-01a3-400d-8b7d-0ec411050307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:51.037139 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19f2e9-01a3-400d-8b7d-0ec411050307 service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:51.037423 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19f2e9-01a3-400d-8b7d-0ec411050307 service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:51.037678 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19f2e9-01a3-400d-8b7d-0ec411050307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:51.047900 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19f2e9-01a3-400d-8b7d-0ec411050307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:51.049354 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19f2e9-01a3-400d-8b7d-0ec411050307 service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:51.062036 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1459/2888] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:26:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:26:51.147799 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e71dd-e8b6-4e1f-aae3-1fc4da639739 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:51.158405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e71dd-e8b6-4e1f-aae3-1fc4da639739 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:51.163307 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9ab02-f4e9-4996-a0d5-0976c88f0d83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:51.163946 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9ab02-f4e9-4996-a0d5-0976c88f0d83 service cinder] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:51.164263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9ab02-f4e9-4996-a0d5-0976c88f0d83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:51.164517 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9ab02-f4e9-4996-a0d5-0976c88f0d83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:51.217361 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:51.227532 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9ab02-f4e9-4996-a0d5-0976c88f0d83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:51.229108 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9ab02-f4e9-4996-a0d5-0976c88f0d83 service cinder] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:51.238421 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1430/2889] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:26:51 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 16:26:56.063692 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19f2e9-01a3-400d-8b7d-0ec411050307 service cinder] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:56.145117 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19f2e9-01a3-400d-8b7d-0ec411050307 service cinder] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:56.150947 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10c9df-44f7-4f90-8860-2bd31019feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:56.151832 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10c9df-44f7-4f90-8860-2bd31019feb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:56.152108 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10c9df-44f7-4f90-8860-2bd31019feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:56.152363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10c9df-44f7-4f90-8860-2bd31019feb7 admin admin] PATH_INFO: `/v3/users/4ce7d61054064d298e1f43617e61912b` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:56.153660 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10c9df-44f7-4f90-8860-2bd31019feb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ce7d61054064d298e1f43617e61912b)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:56.155650 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a10c9df-44f7-4f90-8860-2bd31019feb7 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:56.208130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5a10c9df-44f7-4f90-8860-2bd31019feb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ce7d61054064d298e1f43617e61912b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:56.220856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5a10c9df-44f7-4f90-8860-2bd31019feb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ce7d61054064d298e1f43617e61912b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:56.230362 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5a10c9df-44f7-4f90-8860-2bd31019feb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ce7d61054064d298e1f43617e61912b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:56.231156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5a10c9df-44f7-4f90-8860-2bd31019feb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ce7d61054064d298e1f43617e61912b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:56.238955 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5a10c9df-44f7-4f90-8860-2bd31019feb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ce7d61054064d298e1f43617e61912b'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:56.244997 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1460/2890] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:26:56 2022] DELETE /identity/v3/users/4ce7d61054064d298e1f43617e61912b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:56.249870 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4258f2-b27a-41ab-84ee-73ffa5ee7994 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:56.250414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4258f2-b27a-41ab-84ee-73ffa5ee7994 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:56.250414 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4258f2-b27a-41ab-84ee-73ffa5ee7994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:56.268126 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-0c4258f2-b27a-41ab-84ee-73ffa5ee7994 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:26:56.269332 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0c4258f2-b27a-41ab-84ee-73ffa5ee7994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:56.342627 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1431/2891] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:26:56.353755 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10c9df-44f7-4f90-8860-2bd31019feb7 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:56.355454 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-5a10c9df-44f7-4f90-8860-2bd31019feb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:56.418665 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10c9df-44f7-4f90-8860-2bd31019feb7 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:56.422895 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b7c77-16d3-4d94-a7cf-4e92504f0bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:56.423566 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7c77-16d3-4d94-a7cf-4e92504f0bab service neutron] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:56.423848 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7c77-16d3-4d94-a7cf-4e92504f0bab service neutron] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:56.424123 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7c77-16d3-4d94-a7cf-4e92504f0bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:56.433810 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b7c77-16d3-4d94-a7cf-4e92504f0bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:56.435303 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b7c77-16d3-4d94-a7cf-4e92504f0bab service neutron] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:56.445005 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1461/2892] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:26:56.732893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4258f2-b27a-41ab-84ee-73ffa5ee7994 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:56.734569 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-0c4258f2-b27a-41ab-84ee-73ffa5ee7994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:56.747621 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4258f2-b27a-41ab-84ee-73ffa5ee7994 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:56.753263 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:56.754192 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:56.754467 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:56.754733 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d admin admin] PATH_INFO: `/v3/projects/d70a5f0c3c274d37952e811f4aa51f5b` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:56.756103 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70a5f0c3c274d37952e811f4aa51f5b)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:56.758053 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:56.814408 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70a5f0c3c274d37952e811f4aa51f5b', 'request_id': 'req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:56.821473 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70a5f0c3c274d37952e811f4aa51f5b', 'request_id': 'req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:56.827810 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70a5f0c3c274d37952e811f4aa51f5b', 'request_id': 'req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:56.841939 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d admin admin] The token cache is being invalidate because project d70a5f0c3c274d37952e811f4aa51f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:26:56.842241 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:56.842933 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:56.844518 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1432/2893] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:26:56 2022] DELETE /identity/v3/projects/d70a5f0c3c274d37952e811f4aa51f5b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:56.849545 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b7c77-16d3-4d94-a7cf-4e92504f0bab service neutron] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:56.864142 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b7c77-16d3-4d94-a7cf-4e92504f0bab service neutron] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:56.876163 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:56.930445 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae737c8-0cd4-427f-88e2-60c2666763f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:56.931288 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae737c8-0cd4-427f-88e2-60c2666763f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:56.931576 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae737c8-0cd4-427f-88e2-60c2666763f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:56.931854 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae737c8-0cd4-427f-88e2-60c2666763f6 admin admin] PATH_INFO: `/v3/users/66794d8f1572415d9e6347b36787731c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:56.933051 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae737c8-0cd4-427f-88e2-60c2666763f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66794d8f1572415d9e6347b36787731c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:56.935074 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae737c8-0cd4-427f-88e2-60c2666763f6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:56.984729 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5ae737c8-0cd4-427f-88e2-60c2666763f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66794d8f1572415d9e6347b36787731c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:56.998951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5ae737c8-0cd4-427f-88e2-60c2666763f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66794d8f1572415d9e6347b36787731c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:57.008560 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5ae737c8-0cd4-427f-88e2-60c2666763f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66794d8f1572415d9e6347b36787731c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:57.009382 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5ae737c8-0cd4-427f-88e2-60c2666763f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66794d8f1572415d9e6347b36787731c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:57.018311 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-5ae737c8-0cd4-427f-88e2-60c2666763f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66794d8f1572415d9e6347b36787731c'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:57.024459 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1462/2894] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:26:56 2022] DELETE /identity/v3/users/66794d8f1572415d9e6347b36787731c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:57.320095 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:57.321617 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:57.335836 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6d68b-d196-4a6a-9514-07a1543dfd9d admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:57.403994 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c43085a-3d53-4f8a-b645-5a75f05cc7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:57.405349 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43085a-3d53-4f8a-b645-5a75f05cc7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:57.405796 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43085a-3d53-4f8a-b645-5a75f05cc7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:57.406247 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c43085a-3d53-4f8a-b645-5a75f05cc7b4 admin admin] PATH_INFO: `/v3/projects/5e7e47d09cd44dae943cc7da20bb19b9` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:57.408281 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43085a-3d53-4f8a-b645-5a75f05cc7b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e7e47d09cd44dae943cc7da20bb19b9)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:57.411336 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c43085a-3d53-4f8a-b645-5a75f05cc7b4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:57.428390 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:57.462893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1c43085a-3d53-4f8a-b645-5a75f05cc7b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e7e47d09cd44dae943cc7da20bb19b9', 'request_id': 'req-1c43085a-3d53-4f8a-b645-5a75f05cc7b4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:57.469314 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1c43085a-3d53-4f8a-b645-5a75f05cc7b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e7e47d09cd44dae943cc7da20bb19b9', 'request_id': 'req-1c43085a-3d53-4f8a-b645-5a75f05cc7b4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:57.475339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1c43085a-3d53-4f8a-b645-5a75f05cc7b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e7e47d09cd44dae943cc7da20bb19b9', 'request_id': 'req-1c43085a-3d53-4f8a-b645-5a75f05cc7b4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:57.491059 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1c43085a-3d53-4f8a-b645-5a75f05cc7b4 admin admin] The token cache is being invalidate because project 5e7e47d09cd44dae943cc7da20bb19b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80253) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:26:57.491347 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1c43085a-3d53-4f8a-b645-5a75f05cc7b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:57.492091 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-1c43085a-3d53-4f8a-b645-5a75f05cc7b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:57.493774 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1433/2895] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:26:57 2022] DELETE /identity/v3/projects/5e7e47d09cd44dae943cc7da20bb19b9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:57.500598 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974b3da-00cd-45ea-bf10-973b7636a0fe None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:57.501142 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974b3da-00cd-45ea-bf10-973b7636a0fe None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:57.501242 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974b3da-00cd-45ea-bf10-973b7636a0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:57.526578 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-9974b3da-00cd-45ea-bf10-973b7636a0fe None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:26:57.527831 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-9974b3da-00cd-45ea-bf10-973b7636a0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:57.592363 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1463/2896] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:26:57.600311 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a2b22-9104-4439-9fda-d9f3cfe5f895 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:57.600601 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a2b22-9104-4439-9fda-d9f3cfe5f895 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:57.600878 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a2b22-9104-4439-9fda-d9f3cfe5f895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:57.619902 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-735a2b22-9104-4439-9fda-d9f3cfe5f895 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:26:57.621148 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-735a2b22-9104-4439-9fda-d9f3cfe5f895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:57.630098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1434/2897] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:26:57.634971 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974b3da-00cd-45ea-bf10-973b7636a0fe None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:57.645357 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974b3da-00cd-45ea-bf10-973b7636a0fe None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:57.650492 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc61082-67f7-4950-9075-e390724f5a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:57.651215 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61082-67f7-4950-9075-e390724f5a1b admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:57.651498 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61082-67f7-4950-9075-e390724f5a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:57.651793 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc61082-67f7-4950-9075-e390724f5a1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:57.652514 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc61082-67f7-4950-9075-e390724f5a1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80252) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:26:57.652824 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc61082-67f7-4950-9075-e390724f5a1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:57.654491 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc61082-67f7-4950-9075-e390724f5a1b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:57.666951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1464/2898] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:26:57.672780 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a2b22-9104-4439-9fda-d9f3cfe5f895 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:57.682720 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a2b22-9104-4439-9fda-d9f3cfe5f895 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:57.687893 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1e510-569d-4b75-b742-c95bab44884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:57.688542 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1e510-569d-4b75-b742-c95bab44884a admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:57.688825 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1e510-569d-4b75-b742-c95bab44884a admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:57.689098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1e510-569d-4b75-b742-c95bab44884a admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:57.689796 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1e510-569d-4b75-b742-c95bab44884a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:57.691752 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1e510-569d-4b75-b742-c95bab44884a admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:57.720750 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1435/2899] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:26:57 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:26:57.725128 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc61082-67f7-4950-9075-e390724f5a1b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:57.736284 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc61082-67f7-4950-9075-e390724f5a1b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:57.750298 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:57.807429 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f59174-7258-416a-a639-29dc400be3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:57.808117 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f59174-7258-416a-a639-29dc400be3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:57.808405 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f59174-7258-416a-a639-29dc400be3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:57.808684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f59174-7258-416a-a639-29dc400be3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:57.809391 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f59174-7258-416a-a639-29dc400be3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:57.811347 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f59174-7258-416a-a639-29dc400be3b6 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:57.835454 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1465/2900] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:26:57 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:26:57.841821 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1e510-569d-4b75-b742-c95bab44884a admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:57.855516 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1e510-569d-4b75-b742-c95bab44884a admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:57.860639 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e09de8-81e4-4a5a-ae9f-75d908423eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:57.861304 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e09de8-81e4-4a5a-ae9f-75d908423eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:57.861582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e09de8-81e4-4a5a-ae9f-75d908423eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:57.861854 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e09de8-81e4-4a5a-ae9f-75d908423eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:57.862587 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e09de8-81e4-4a5a-ae9f-75d908423eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:57.864262 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e09de8-81e4-4a5a-ae9f-75d908423eb3 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:57.875371 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1436/2901] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:26:57.879743 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f59174-7258-416a-a639-29dc400be3b6 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:57.890446 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f59174-7258-416a-a639-29dc400be3b6 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:57.896104 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeba1274-7fd4-4906-9528-7e4af6346eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:57.896796 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba1274-7fd4-4906-9528-7e4af6346eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:57.897072 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba1274-7fd4-4906-9528-7e4af6346eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:57.897352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeba1274-7fd4-4906-9528-7e4af6346eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:57.898123 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba1274-7fd4-4906-9528-7e4af6346eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:57.899786 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeba1274-7fd4-4906-9528-7e4af6346eb8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:57.911204 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1466/2902] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:26:57.915940 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e09de8-81e4-4a5a-ae9f-75d908423eb3 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:57.927245 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e09de8-81e4-4a5a-ae9f-75d908423eb3 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:57.932260 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3053f-220d-4098-b7dc-bae4ecbad3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:57.933141 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3053f-220d-4098-b7dc-bae4ecbad3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:57.933415 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3053f-220d-4098-b7dc-bae4ecbad3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:57.933681 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3053f-220d-4098-b7dc-bae4ecbad3b4 admin admin] PATH_INFO: `/v3/projects/bcbdc4bd216445288b3c5f00fd308aeb/users/6543a4e4a6d34c19b491f79d72d662b4/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:57.951295 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3053f-220d-4098-b7dc-bae4ecbad3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcbdc4bd216445288b3c5f00fd308aeb, user_id=6543a4e4a6d34c19b491f79d72d662b4, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:57.954326 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3053f-220d-4098-b7dc-bae4ecbad3b4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:57.973369 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1437/2903] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:26:57 2022] PUT /identity/v3/projects/bcbdc4bd216445288b3c5f00fd308aeb/users/6543a4e4a6d34c19b491f79d72d662b4/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:57.985057 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8028e-ad71-4c5f-8395-8323920dadea None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:57.985345 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8028e-ad71-4c5f-8395-8323920dadea None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:57.985632 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8028e-ad71-4c5f-8395-8323920dadea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:58.014700 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-d7d8028e-ad71-4c5f-8395-8323920dadea None None] MFA Rules not processed for user `6543a4e4a6d34c19b491f79d72d662b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:26:58.016009 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-d7d8028e-ad71-4c5f-8395-8323920dadea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:58.084784 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1467/2904] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:26:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:26:58.091225 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3053f-220d-4098-b7dc-bae4ecbad3b4 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:58.154116 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3053f-220d-4098-b7dc-bae4ecbad3b4 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:58.158929 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57555d1-5e6d-476a-a5a3-79fd2d7a7925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:58.159602 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57555d1-5e6d-476a-a5a3-79fd2d7a7925 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:58.159897 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57555d1-5e6d-476a-a5a3-79fd2d7a7925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:58.160175 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57555d1-5e6d-476a-a5a3-79fd2d7a7925 admin admin] PATH_INFO: `/v3/projects` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:58.161012 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57555d1-5e6d-476a-a5a3-79fd2d7a7925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:58.162968 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57555d1-5e6d-476a-a5a3-79fd2d7a7925 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:58.190706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1438/2905] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:26:58 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 16:26:58.195091 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8028e-ad71-4c5f-8395-8323920dadea None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:58.211071 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8028e-ad71-4c5f-8395-8323920dadea None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:58.273281 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e267e09-7136-458e-97ef-dab7e6fde2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:58.273880 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e267e09-7136-458e-97ef-dab7e6fde2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:58.274157 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e267e09-7136-458e-97ef-dab7e6fde2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:58.274426 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e267e09-7136-458e-97ef-dab7e6fde2c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:58.275199 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e267e09-7136-458e-97ef-dab7e6fde2c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:58.277125 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e267e09-7136-458e-97ef-dab7e6fde2c0 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:58.301213 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1468/2906] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:26:58 2022] POST /identity/v3/users => generated 296 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:26:58.306248 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57555d1-5e6d-476a-a5a3-79fd2d7a7925 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:58.317800 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57555d1-5e6d-476a-a5a3-79fd2d7a7925 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:58.322489 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c369e0-5de3-489c-b68c-2554108b3e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:58.323296 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c369e0-5de3-489c-b68c-2554108b3e7e admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:58.323435 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c369e0-5de3-489c-b68c-2554108b3e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:58.323709 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c369e0-5de3-489c-b68c-2554108b3e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:58.324472 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c369e0-5de3-489c-b68c-2554108b3e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:58.326085 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c369e0-5de3-489c-b68c-2554108b3e7e admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:58.337278 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1439/2907] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:26:58.341948 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e267e09-7136-458e-97ef-dab7e6fde2c0 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:58.352608 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e267e09-7136-458e-97ef-dab7e6fde2c0 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:58.359410 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c755a-0a5b-4b67-b7fe-c9d26aae26c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:58.360311 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c755a-0a5b-4b67-b7fe-c9d26aae26c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:58.360594 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c755a-0a5b-4b67-b7fe-c9d26aae26c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:58.360865 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c755a-0a5b-4b67-b7fe-c9d26aae26c9 admin admin] PATH_INFO: `/v3/projects/1889ed9321814163bd5458aaa1ff333c/users/28616b37a7a84845a967871c875446a3/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:58.380941 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:58.385389 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c755a-0a5b-4b67-b7fe-c9d26aae26c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1889ed9321814163bd5458aaa1ff333c, user_id=28616b37a7a84845a967871c875446a3, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:58.389424 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c755a-0a5b-4b67-b7fe-c9d26aae26c9 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:58.405564 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1469/2908] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:26:58 2022] PUT /identity/v3/projects/1889ed9321814163bd5458aaa1ff333c/users/28616b37a7a84845a967871c875446a3/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:58.410253 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c369e0-5de3-489c-b68c-2554108b3e7e admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:58.420879 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c369e0-5de3-489c-b68c-2554108b3e7e admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:58.433403 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:58.479937 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99aec98-c297-4558-9c54-bf2cc9e9b0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:58.480617 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aec98-c297-4558-9c54-bf2cc9e9b0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:58.480974 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aec98-c297-4558-9c54-bf2cc9e9b0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:58.481252 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99aec98-c297-4558-9c54-bf2cc9e9b0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:58.481982 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99aec98-c297-4558-9c54-bf2cc9e9b0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:58.483631 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99aec98-c297-4558-9c54-bf2cc9e9b0b4 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:58.493802 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1440/2909] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:26:58.498156 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c755a-0a5b-4b67-b7fe-c9d26aae26c9 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:58.509861 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c755a-0a5b-4b67-b7fe-c9d26aae26c9 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:58.518506 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748662e-ff56-4777-bd6f-158fba9772b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:58.519898 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748662e-ff56-4777-bd6f-158fba9772b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:58.520374 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748662e-ff56-4777-bd6f-158fba9772b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:58.520654 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748662e-ff56-4777-bd6f-158fba9772b8 admin admin] PATH_INFO: `/v3/projects/1889ed9321814163bd5458aaa1ff333c/users/28616b37a7a84845a967871c875446a3/roles/2f14a93ae652476f8bc01915f4fd4f93` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:58.522913 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748662e-ff56-4777-bd6f-158fba9772b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1889ed9321814163bd5458aaa1ff333c, user_id=28616b37a7a84845a967871c875446a3, role_id=2f14a93ae652476f8bc01915f4fd4f93)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:58.525624 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748662e-ff56-4777-bd6f-158fba9772b8 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:58.537011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1470/2910] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:26:58 2022] PUT /identity/v3/projects/1889ed9321814163bd5458aaa1ff333c/users/28616b37a7a84845a967871c875446a3/roles/2f14a93ae652476f8bc01915f4fd4f93 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:58.547595 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcbdfd-6b99-43ec-8e99-bfbc485f96cf None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:58.547891 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcbdfd-6b99-43ec-8e99-bfbc485f96cf None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:58.548171 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcbdfd-6b99-43ec-8e99-bfbc485f96cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:58.575964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-63bcbdfd-6b99-43ec-8e99-bfbc485f96cf None None] MFA Rules not processed for user `28616b37a7a84845a967871c875446a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:26:58.577204 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-63bcbdfd-6b99-43ec-8e99-bfbc485f96cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:58.662582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1441/2911] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:26:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:26:58.673573 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748662e-ff56-4777-bd6f-158fba9772b8 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:58.675414 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-1748662e-ff56-4777-bd6f-158fba9772b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:58.737933 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748662e-ff56-4777-bd6f-158fba9772b8 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:58.742173 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a21136c-9946-4b63-820a-6cc90cbeefcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8c629ecd4014e2b8051b853a0b4c18a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:58.743201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21136c-9946-4b63-820a-6cc90cbeefcf service cinder] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:58.743201 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21136c-9946-4b63-820a-6cc90cbeefcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:58.743648 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a21136c-9946-4b63-820a-6cc90cbeefcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:58.754856 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21136c-9946-4b63-820a-6cc90cbeefcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:58.756336 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a21136c-9946-4b63-820a-6cc90cbeefcf service cinder] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:58.767517 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1471/2912] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:26:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:26:59.155457 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcbdfd-6b99-43ec-8e99-bfbc485f96cf None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:59.226570 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcbdfd-6b99-43ec-8e99-bfbc485f96cf None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:59.231770 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd66d3c-e4ea-445e-af84-08a1ab5f32cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:59.232686 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd66d3c-e4ea-445e-af84-08a1ab5f32cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:59.232972 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd66d3c-e4ea-445e-af84-08a1ab5f32cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:59.233251 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd66d3c-e4ea-445e-af84-08a1ab5f32cd admin admin] PATH_INFO: `/v3/users/6543a4e4a6d34c19b491f79d72d662b4` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:59.234599 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd66d3c-e4ea-445e-af84-08a1ab5f32cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6543a4e4a6d34c19b491f79d72d662b4)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:59.236681 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd66d3c-e4ea-445e-af84-08a1ab5f32cd admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:59.284363 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:26:59.292323 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fbd66d3c-e4ea-445e-af84-08a1ab5f32cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6543a4e4a6d34c19b491f79d72d662b4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:59.300142 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fbd66d3c-e4ea-445e-af84-08a1ab5f32cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6543a4e4a6d34c19b491f79d72d662b4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:59.308220 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fbd66d3c-e4ea-445e-af84-08a1ab5f32cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6543a4e4a6d34c19b491f79d72d662b4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:59.309331 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fbd66d3c-e4ea-445e-af84-08a1ab5f32cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6543a4e4a6d34c19b491f79d72d662b4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:59.310035 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-fbd66d3c-e4ea-445e-af84-08a1ab5f32cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6543a4e4a6d34c19b491f79d72d662b4'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:59.329315 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1442/2913] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:26:59 2022] DELETE /identity/v3/users/6543a4e4a6d34c19b491f79d72d662b4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:59.334130 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57a3a2-2630-4205-9a3a-5747c13c41f6 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:59.334419 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57a3a2-2630-4205-9a3a-5747c13c41f6 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:59.334725 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57a3a2-2630-4205-9a3a-5747c13c41f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:59.353699 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-8c57a3a2-2630-4205-9a3a-5747c13c41f6 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:26:59.354974 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8c57a3a2-2630-4205-9a3a-5747c13c41f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:59.429447 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1472/2914] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 16:26:59.439780 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd66d3c-e4ea-445e-af84-08a1ab5f32cd admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:59.441298 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-fbd66d3c-e4ea-445e-af84-08a1ab5f32cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:59.503242 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd66d3c-e4ea-445e-af84-08a1ab5f32cd admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:59.507235 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e299498-a9f5-4950-83aa-04a622547c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:59.507877 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e299498-a9f5-4950-83aa-04a622547c5a service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:59.508156 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e299498-a9f5-4950-83aa-04a622547c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:59.508428 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e299498-a9f5-4950-83aa-04a622547c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:59.518139 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e299498-a9f5-4950-83aa-04a622547c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:59.519624 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e299498-a9f5-4950-83aa-04a622547c5a service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:59.529386 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1443/2915] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:26:59.814021 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57a3a2-2630-4205-9a3a-5747c13c41f6 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:59.815589 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-8c57a3a2-2630-4205-9a3a-5747c13c41f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:26:59.829744 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57a3a2-2630-4205-9a3a-5747c13c41f6 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:26:59.834882 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2098ad5-60eb-4a26-8bda-b0109427401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:26:59.835936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2098ad5-60eb-4a26-8bda-b0109427401e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:26:59.836235 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2098ad5-60eb-4a26-8bda-b0109427401e admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:26:59.836575 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2098ad5-60eb-4a26-8bda-b0109427401e admin admin] PATH_INFO: `/v3/projects/bcbdc4bd216445288b3c5f00fd308aeb` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:26:59.837931 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2098ad5-60eb-4a26-8bda-b0109427401e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcbdc4bd216445288b3c5f00fd308aeb)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:26:59.840068 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2098ad5-60eb-4a26-8bda-b0109427401e admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:26:59.902532 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a2098ad5-60eb-4a26-8bda-b0109427401e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcbdc4bd216445288b3c5f00fd308aeb', 'request_id': 'req-a2098ad5-60eb-4a26-8bda-b0109427401e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:59.915131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a2098ad5-60eb-4a26-8bda-b0109427401e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcbdc4bd216445288b3c5f00fd308aeb', 'request_id': 'req-a2098ad5-60eb-4a26-8bda-b0109427401e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:59.922684 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a2098ad5-60eb-4a26-8bda-b0109427401e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcbdc4bd216445288b3c5f00fd308aeb', 'request_id': 'req-a2098ad5-60eb-4a26-8bda-b0109427401e'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:59.933457 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a2098ad5-60eb-4a26-8bda-b0109427401e admin admin] The token cache is being invalidate because project bcbdc4bd216445288b3c5f00fd308aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:26:59.933764 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a2098ad5-60eb-4a26-8bda-b0109427401e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:59.934434 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-a2098ad5-60eb-4a26-8bda-b0109427401e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:26:59.936047 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1473/2916] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:26:59 2022] DELETE /identity/v3/projects/bcbdc4bd216445288b3c5f00fd308aeb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:26:59.940437 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e299498-a9f5-4950-83aa-04a622547c5a service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:26:59.950437 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e299498-a9f5-4950-83aa-04a622547c5a service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:27:00.017465 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6db7c-438e-4c14-a06f-ef60c8b7702c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:27:00.018356 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6db7c-438e-4c14-a06f-ef60c8b7702c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:00.018638 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6db7c-438e-4c14-a06f-ef60c8b7702c admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:00.018966 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6db7c-438e-4c14-a06f-ef60c8b7702c admin admin] PATH_INFO: `/v3/users/28616b37a7a84845a967871c875446a3` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:00.020405 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6db7c-438e-4c14-a06f-ef60c8b7702c admin admin] RBAC: Authorizing `identity:delete_user(user_id=28616b37a7a84845a967871c875446a3)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:27:00.022381 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6db7c-438e-4c14-a06f-ef60c8b7702c admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:27:00.076869 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-88f6db7c-438e-4c14-a06f-ef60c8b7702c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28616b37a7a84845a967871c875446a3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:00.084843 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-88f6db7c-438e-4c14-a06f-ef60c8b7702c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28616b37a7a84845a967871c875446a3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:00.091861 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:27:00.098499 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-88f6db7c-438e-4c14-a06f-ef60c8b7702c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28616b37a7a84845a967871c875446a3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:00.099233 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-88f6db7c-438e-4c14-a06f-ef60c8b7702c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28616b37a7a84845a967871c875446a3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:00.101207 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-88f6db7c-438e-4c14-a06f-ef60c8b7702c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28616b37a7a84845a967871c875446a3'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:00.127790 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1444/2917] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:26:59 2022] DELETE /identity/v3/users/28616b37a7a84845a967871c875446a3 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:27:00.412894 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2098ad5-60eb-4a26-8bda-b0109427401e admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:27:00.414571 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-a2098ad5-60eb-4a26-8bda-b0109427401e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:27:00.428055 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:27:00.431879 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2098ad5-60eb-4a26-8bda-b0109427401e admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:27:00.511688 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cefab-1c17-4756-a9b9-11fd377b8416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:27:00.512585 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cefab-1c17-4756-a9b9-11fd377b8416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:00.512872 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cefab-1c17-4756-a9b9-11fd377b8416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:00.513150 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cefab-1c17-4756-a9b9-11fd377b8416 admin admin] PATH_INFO: `/v3/projects/1889ed9321814163bd5458aaa1ff333c` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:00.514404 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cefab-1c17-4756-a9b9-11fd377b8416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1889ed9321814163bd5458aaa1ff333c)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:27:00.516377 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cefab-1c17-4756-a9b9-11fd377b8416 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:27:00.573385 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-725cefab-1c17-4756-a9b9-11fd377b8416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1889ed9321814163bd5458aaa1ff333c', 'request_id': 'req-725cefab-1c17-4756-a9b9-11fd377b8416'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:00.582131 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-725cefab-1c17-4756-a9b9-11fd377b8416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1889ed9321814163bd5458aaa1ff333c', 'request_id': 'req-725cefab-1c17-4756-a9b9-11fd377b8416'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:00.588757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-725cefab-1c17-4756-a9b9-11fd377b8416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1889ed9321814163bd5458aaa1ff333c', 'request_id': 'req-725cefab-1c17-4756-a9b9-11fd377b8416'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:00.599474 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-725cefab-1c17-4756-a9b9-11fd377b8416 admin admin] The token cache is being invalidate because project 1889ed9321814163bd5458aaa1ff333c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:27:00.599757 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-725cefab-1c17-4756-a9b9-11fd377b8416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:00.600525 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-725cefab-1c17-4756-a9b9-11fd377b8416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:00.602146 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1474/2918] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:27:00 2022] DELETE /identity/v3/projects/1889ed9321814163bd5458aaa1ff333c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:27:00.607215 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef97aa-190f-4794-aa0c-d2d80fa3bdea None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:00.607725 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef97aa-190f-4794-aa0c-d2d80fa3bdea None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:00.607833 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef97aa-190f-4794-aa0c-d2d80fa3bdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:00.626582 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-baef97aa-190f-4794-aa0c-d2d80fa3bdea None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:27:00.627706 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-baef97aa-190f-4794-aa0c-d2d80fa3bdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:27:00.688786 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1445/2919] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:27:00.696989 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27add363-99c9-4d66-8a7e-cc57b4ff9b14 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:00.697295 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27add363-99c9-4d66-8a7e-cc57b4ff9b14 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:00.697617 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27add363-99c9-4d66-8a7e-cc57b4ff9b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:00.717687 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-27add363-99c9-4d66-8a7e-cc57b4ff9b14 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:27:00.718930 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-27add363-99c9-4d66-8a7e-cc57b4ff9b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:27:00.728522 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1475/2920] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:27:00.734437 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef97aa-190f-4794-aa0c-d2d80fa3bdea None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:27:00.745515 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef97aa-190f-4794-aa0c-d2d80fa3bdea None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:27:00.752794 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67fa6d-58fb-496b-a140-7b54f5d1c349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:27:00.753463 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67fa6d-58fb-496b-a140-7b54f5d1c349 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:00.753748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67fa6d-58fb-496b-a140-7b54f5d1c349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:00.754008 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e67fa6d-58fb-496b-a140-7b54f5d1c349 admin admin] PATH_INFO: `/v3/domains` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:00.754748 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67fa6d-58fb-496b-a140-7b54f5d1c349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80253) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 16:27:00.755090 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67fa6d-58fb-496b-a140-7b54f5d1c349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:27:00.756803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e67fa6d-58fb-496b-a140-7b54f5d1c349 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:27:00.772223 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1446/2921] 10.222.0.64 () {58 vars in 1152 bytes} [Thu Jul 21 16:27:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 16:27:00.777412 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27add363-99c9-4d66-8a7e-cc57b4ff9b14 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:27:00.787231 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27add363-99c9-4d66-8a7e-cc57b4ff9b14 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:27:00.792311 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff74814-8de3-432d-8096-c6e5d1f2713b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:27:00.792975 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff74814-8de3-432d-8096-c6e5d1f2713b admin admin] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:00.793257 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff74814-8de3-432d-8096-c6e5d1f2713b admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:00.793536 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff74814-8de3-432d-8096-c6e5d1f2713b admin admin] PATH_INFO: `/v3/projects` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:00.794226 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff74814-8de3-432d-8096-c6e5d1f2713b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:27:00.796360 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff74814-8de3-432d-8096-c6e5d1f2713b admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:27:00.838883 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1476/2922] 10.222.0.64 () {60 vars in 1152 bytes} [Thu Jul 21 16:27:00 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:27:00.843562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67fa6d-58fb-496b-a140-7b54f5d1c349 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:27:00.854211 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e67fa6d-58fb-496b-a140-7b54f5d1c349 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:27:00.917803 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a13df-f1c0-439d-8fb2-55eb78119518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:27:00.918485 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a13df-f1c0-439d-8fb2-55eb78119518 admin admin] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:00.918771 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a13df-f1c0-439d-8fb2-55eb78119518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:00.919082 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a13df-f1c0-439d-8fb2-55eb78119518 admin admin] PATH_INFO: `/v3/users` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:00.919807 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a13df-f1c0-439d-8fb2-55eb78119518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:27:00.921826 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a13df-f1c0-439d-8fb2-55eb78119518 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:27:00.945339 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1447/2923] 10.222.0.64 () {60 vars in 1143 bytes} [Thu Jul 21 16:27:00 2022] POST /identity/v3/users => generated 285 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 16:27:00.949967 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff74814-8de3-432d-8096-c6e5d1f2713b admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:27:00.962647 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff74814-8de3-432d-8096-c6e5d1f2713b admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:27:00.968481 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48578ae1-a4bc-4a97-ad58-e3c709bc5087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:27:00.969133 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48578ae1-a4bc-4a97-ad58-e3c709bc5087 admin admin] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:00.969418 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48578ae1-a4bc-4a97-ad58-e3c709bc5087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:00.969671 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48578ae1-a4bc-4a97-ad58-e3c709bc5087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:00.970438 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48578ae1-a4bc-4a97-ad58-e3c709bc5087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:27:00.972093 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48578ae1-a4bc-4a97-ad58-e3c709bc5087 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:27:00.983822 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1477/2924] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 16:27:00.988255 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a13df-f1c0-439d-8fb2-55eb78119518 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:27:00.999411 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a13df-f1c0-439d-8fb2-55eb78119518 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:27:01.005394 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc57e9b-41ab-4d85-ab68-a7fa4e98af24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:27:01.006107 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc57e9b-41ab-4d85-ab68-a7fa4e98af24 admin admin] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:01.007112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc57e9b-41ab-4d85-ab68-a7fa4e98af24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:01.007112 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc57e9b-41ab-4d85-ab68-a7fa4e98af24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:01.007426 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc57e9b-41ab-4d85-ab68-a7fa4e98af24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:27:01.009069 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc57e9b-41ab-4d85-ab68-a7fa4e98af24 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:27:01.020580 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1448/2925] 10.222.0.64 () {58 vars in 1121 bytes} [Thu Jul 21 16:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 16:27:01.025367 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48578ae1-a4bc-4a97-ad58-e3c709bc5087 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:27:01.044255 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48578ae1-a4bc-4a97-ad58-e3c709bc5087 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:27:01.055307 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b04a7e-e80c-4e8a-9b64-8019e435ee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:27:01.057011 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b04a7e-e80c-4e8a-9b64-8019e435ee36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:01.057301 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b04a7e-e80c-4e8a-9b64-8019e435ee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:01.057584 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b04a7e-e80c-4e8a-9b64-8019e435ee36 admin admin] PATH_INFO: `/v3/projects/4254958b444846a78169f54d990b232f/users/648ebb25fbe14f2a9aa4b5a8558ba0de/roles/64e044de7dcc4949acf8ce7eaf08fdaa` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:01.075097 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b04a7e-e80c-4e8a-9b64-8019e435ee36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4254958b444846a78169f54d990b232f, user_id=648ebb25fbe14f2a9aa4b5a8558ba0de, role_id=64e044de7dcc4949acf8ce7eaf08fdaa)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:27:01.077857 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b04a7e-e80c-4e8a-9b64-8019e435ee36 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:27:01.094951 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1478/2926] 10.222.0.64 () {60 vars in 1482 bytes} [Thu Jul 21 16:27:01 2022] PUT /identity/v3/projects/4254958b444846a78169f54d990b232f/users/648ebb25fbe14f2a9aa4b5a8558ba0de/roles/64e044de7dcc4949acf8ce7eaf08fdaa => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:27:01.107552 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f132af9-dcb9-411e-935d-5eb005707e33 None None] REQUEST_METHOD: `POST` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:01.107783 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f132af9-dcb9-411e-935d-5eb005707e33 None None] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:01.108062 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f132af9-dcb9-411e-935d-5eb005707e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:01.139040 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.auth.core [None req-6f132af9-dcb9-411e-935d-5eb005707e33 None None] MFA Rules not processed for user `648ebb25fbe14f2a9aa4b5a8558ba0de`. Rule list: `[]` (Enabled: `True`). {{(pid=80253) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:27:01.140343 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-6f132af9-dcb9-411e-935d-5eb005707e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:27:01.183533 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:27:01.222553 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1449/2927] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:27:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:27:01.235327 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b04a7e-e80c-4e8a-9b64-8019e435ee36 admin admin] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:27:01.237349 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-55b04a7e-e80c-4e8a-9b64-8019e435ee36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:27:01.274042 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:27:01.301209 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b04a7e-e80c-4e8a-9b64-8019e435ee36 admin admin] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:27:01.306689 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f20c0-d747-4435-8b8c-41a7ebba25b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a3418c0b46c404c8ca445cce9db632d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:27:01.307352 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f20c0-d747-4435-8b8c-41a7ebba25b5 service glance] REQUEST_METHOD: `GET` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:01.307635 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f20c0-d747-4435-8b8c-41a7ebba25b5 service glance] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:01.307911 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f20c0-d747-4435-8b8c-41a7ebba25b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:01.317604 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f20c0-d747-4435-8b8c-41a7ebba25b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:27:01.319208 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f20c0-d747-4435-8b8c-41a7ebba25b5 service glance] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:27:01.329039 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1479/2928] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:27:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:27:11.219888 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=12 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:27:11.324371 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=12 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:27:30.786431 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f132af9-dcb9-411e-935d-5eb005707e33 None None] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:27:30.857459 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f132af9-dcb9-411e-935d-5eb005707e33 None None] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:27:30.863550 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9a9e2-7da8-4945-99b9-39841c68a1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:27:30.864453 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9a9e2-7da8-4945-99b9-39841c68a1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:30.864729 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9a9e2-7da8-4945-99b9-39841c68a1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:30.865098 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9a9e2-7da8-4945-99b9-39841c68a1e9 admin admin] PATH_INFO: `/v3/users/648ebb25fbe14f2a9aa4b5a8558ba0de` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:30.866460 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9a9e2-7da8-4945-99b9-39841c68a1e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=648ebb25fbe14f2a9aa4b5a8558ba0de)` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:27:30.868470 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9a9e2-7da8-4945-99b9-39841c68a1e9 admin admin] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:27:30.919229 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bfc9a9e2-7da8-4945-99b9-39841c68a1e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648ebb25fbe14f2a9aa4b5a8558ba0de'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:30.926437 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bfc9a9e2-7da8-4945-99b9-39841c68a1e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648ebb25fbe14f2a9aa4b5a8558ba0de'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:30.935385 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bfc9a9e2-7da8-4945-99b9-39841c68a1e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648ebb25fbe14f2a9aa4b5a8558ba0de'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:30.936027 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bfc9a9e2-7da8-4945-99b9-39841c68a1e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648ebb25fbe14f2a9aa4b5a8558ba0de'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:30.936590 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.notifications [None req-bfc9a9e2-7da8-4945-99b9-39841c68a1e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648ebb25fbe14f2a9aa4b5a8558ba0de'} {{(pid=80253) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:30.954964 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1450/2929] 10.222.0.64 () {58 vars in 1223 bytes} [Thu Jul 21 16:27:30 2022] DELETE /identity/v3/users/648ebb25fbe14f2a9aa4b5a8558ba0de => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:27:30.959656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2782d-5615-46d7-a689-fbc6fb401945 None None] REQUEST_METHOD: `POST` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:30.960175 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2782d-5615-46d7-a689-fbc6fb401945 None None] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:30.960283 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2782d-5615-46d7-a689-fbc6fb401945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:30.978101 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.auth.core [None req-2bf2782d-5615-46d7-a689-fbc6fb401945 None None] MFA Rules not processed for user `a71b1bb7d4ea44e095e9e4bdd64ff70b`. Rule list: `[]` (Enabled: `True`). {{(pid=80252) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 16:27:30.979378 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2bf2782d-5615-46d7-a689-fbc6fb401945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:27:31.043968 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1480/2930] 10.222.0.64 () {58 vars in 957 bytes} [Thu Jul 21 16:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 16:27:31.054562 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9a9e2-7da8-4945-99b9-39841c68a1e9 admin admin] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:27:31.056182 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-bfc9a9e2-7da8-4945-99b9-39841c68a1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:27:31.125729 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9a9e2-7da8-4945-99b9-39841c68a1e9 admin admin] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:27:31.130581 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55427a-3f02-4808-be6f-8556130ae523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b46a82ffe92437fb8205bd186a8b05e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:27:31.131259 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55427a-3f02-4808-be6f-8556130ae523 service neutron] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:31.131544 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55427a-3f02-4808-be6f-8556130ae523 service neutron] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:31.131930 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55427a-3f02-4808-be6f-8556130ae523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:31.142051 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55427a-3f02-4808-be6f-8556130ae523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:27:31.143590 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55427a-3f02-4808-be6f-8556130ae523 service neutron] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:27:31.154595 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1451/2931] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:27:31.494674 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2782d-5615-46d7-a689-fbc6fb401945 None None] Authenticating user token {{(pid=80252) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:27:31.496867 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.fernet_utils [None req-2bf2782d-5615-46d7-a689-fbc6fb401945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80252) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:27:31.517539 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2782d-5615-46d7-a689-fbc6fb401945 None None] Validating token access rules against request {{(pid=80252) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:27:31.525772 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636b037-bab2-4dfb-ba2b-b06c9a9dd1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a71b1bb7d4ea44e095e9e4bdd64ff70b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab5b6764e1c145b69436e883cfb29e46', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80252) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:27:31.527341 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636b037-bab2-4dfb-ba2b-b06c9a9dd1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:27:31.528008 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636b037-bab2-4dfb-ba2b-b06c9a9dd1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:27:31.528189 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636b037-bab2-4dfb-ba2b-b06c9a9dd1c1 admin admin] PATH_INFO: `/v3/projects/4254958b444846a78169f54d990b232f` {{(pid=80252) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:27:31.530505 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636b037-bab2-4dfb-ba2b-b06c9a9dd1c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4254958b444846a78169f54d990b232f)` {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:27:31.534358 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636b037-bab2-4dfb-ba2b-b06c9a9dd1c1 admin admin] RBAC: Authorization granted {{(pid=80252) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:27:31.595656 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b636b037-bab2-4dfb-ba2b-b06c9a9dd1c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4254958b444846a78169f54d990b232f', 'request_id': 'req-b636b037-bab2-4dfb-ba2b-b06c9a9dd1c1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:31.605054 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b636b037-bab2-4dfb-ba2b-b06c9a9dd1c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4254958b444846a78169f54d990b232f', 'request_id': 'req-b636b037-bab2-4dfb-ba2b-b06c9a9dd1c1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:31.612983 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b636b037-bab2-4dfb-ba2b-b06c9a9dd1c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4254958b444846a78169f54d990b232f', 'request_id': 'req-b636b037-bab2-4dfb-ba2b-b06c9a9dd1c1'} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:31.624914 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b636b037-bab2-4dfb-ba2b-b06c9a9dd1c1 admin admin] The token cache is being invalidate because project 4254958b444846a78169f54d990b232f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80252) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 16:27:31.625229 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b636b037-bab2-4dfb-ba2b-b06c9a9dd1c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:31.625885 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG keystone.notifications [None req-b636b037-bab2-4dfb-ba2b-b06c9a9dd1c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80252) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 16:27:31.627555 dv-cinder-850668-1-smb devstack@keystone.service[80252]: [pid: 80252|app: 0|req: 1481/2932] 10.222.0.64 () {58 vars in 1232 bytes} [Thu Jul 21 16:27:31 2022] DELETE /identity/v3/projects/4254958b444846a78169f54d990b232f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 16:27:41.149612 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:27:41.621936 dv-cinder-850668-1-smb devstack@keystone.service[80252]: DEBUG dbcounter [-] [80252] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80252) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 16:29:52.659885 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55427a-3f02-4808-be6f-8556130ae523 service neutron] Authenticating user token {{(pid=80253) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 16:29:52.661600 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-4c55427a-3f02-4808-be6f-8556130ae523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:29:52.742761 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55427a-3f02-4808-be6f-8556130ae523 service neutron] Validating token access rules against request {{(pid=80253) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 16:29:52.815650 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52fded-683f-4827-8415-e235b691f1c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f4a46a051c241a2a47059052735c930', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d717ed2993d4a3ab21195028a16e747', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80253) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 16:29:52.816315 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52fded-683f-4827-8415-e235b691f1c9 service placement] REQUEST_METHOD: `GET` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 16:29:52.816591 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52fded-683f-4827-8415-e235b691f1c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 16:29:52.816867 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52fded-683f-4827-8415-e235b691f1c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80253) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 16:29:52.818791 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.fernet_utils [None req-3c52fded-683f-4827-8415-e235b691f1c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80253) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 16:29:52.831973 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52fded-683f-4827-8415-e235b691f1c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 16:29:52.833585 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52fded-683f-4827-8415-e235b691f1c9 service placement] RBAC: Authorization granted {{(pid=80253) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 16:29:52.844402 dv-cinder-850668-1-smb devstack@keystone.service[80253]: [pid: 80253|app: 0|req: 1452/2933] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Jul 21 16:29:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 16:30:02.839579 dv-cinder-850668-1-smb devstack@keystone.service[80253]: DEBUG dbcounter [-] [80253] Writing DB stats keystone:SELECT=58 {{(pid=80253) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}